Oct 30 21:43:38.238965 ip-10-0-142-154 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 21:43:38.593906 ip-10-0-142-154 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:43:38.593906 ip-10-0-142-154 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 21:43:38.593906 ip-10-0-142-154 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:43:38.593906 ip-10-0-142-154 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:43:38.599796 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599725    2574 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:38.599796 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599793    2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:38.599796 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599798    2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599801    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599804    2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599807    2574 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599810    2574 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599812    2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599815    2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599818    2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599820    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599823    2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599826    2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599828    2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599831    2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599833    2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599835    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599838    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599840    2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599843    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599845    2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599848    2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:38.599883 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599851    2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599854    2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599856    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599859    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599861    2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599873    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599876    2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599879    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599881    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599884    2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599888    2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599891    2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599893    2574 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599896    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599899    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599901    2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599903    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599906    2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599908    2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599911    2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:38.600332 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599913    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599915    2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599918    2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599920    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599923    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599925    2574 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599928    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599930    2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599932    2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599935    2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599937    2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599939    2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599942    2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599945    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599948    2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599951    2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599953    2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599956    2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599959    2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599962    2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:38.600812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599964    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599967    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599969    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599972    2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599975    2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599977    2574 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599979    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599982    2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599985    2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599988    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599992    2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.599996    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600000    2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600003    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600006    2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600009    2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600012    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600015    2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:38.601300 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600017    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600020    2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600024    2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600028    2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600030    2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600034    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600037    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600039    2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600043    2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600046    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600049    2574 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600051    2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600055    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600058    2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600061    2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600064    2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600066    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600068    2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600071    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:38.601769 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600073    2574 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600076    2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600078    2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600081    2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600083    2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600085    2574 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600088    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600905    2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600912    2574 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600915    2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600917    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600920    2574 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600923    2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600926    2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600929    2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600931    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600934    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600936    2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600939    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600941    2574 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:38.602200 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600944    2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600946    2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600950    2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600953    2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600955    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600958    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600960    2574 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600963    2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600966    2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600969    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600971    2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600974    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600976    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600979    2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600981    2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600984    2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600986    2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600989    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600991    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:38.602700 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600994    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600996    2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.600999    2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601001    2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601004    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601007    2574 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601010    2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601013    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601015    2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601018    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601021    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601024    2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601027    2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601030    2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601032    2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601035    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601037    2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601040    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601042    2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:38.603150 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601045    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601048    2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601053    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601057    2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601061    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601064    2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601067    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601070    2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601072    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601074    2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601077    2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601079    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601082    2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601085    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601087    2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601090    2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601092    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601095    2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601097    2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601100    2574 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:38.603695 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601103    2574 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601105    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601108    2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601110    2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601113    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601116    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601118    2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601121    2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601124    2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601126    2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601129    2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601134    2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601137    2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601140    2574 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601143    2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601149    2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601152    2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601154    2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601157    2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:38.604201 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601159    2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601161    2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601164    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601166    2574 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601169    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601171    2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601174    2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601177    2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601180    2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601182    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601184    2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601187    2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601189    2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601192    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601194    2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601197    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601777    2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601784    2574 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601787    2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601791    2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:38.604651 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601794    2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601797    2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601800    2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601802    2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601805    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601807    2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601810    2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601812    2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601820    2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601823    2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601826    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601828    2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601830    2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601833    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601836    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601838    2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601841    2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601844    2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601846    2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:38.605149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601849    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601852    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601854    2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601856    2574 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601859    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601862    2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601864    2574 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601867    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601869    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601871    2574 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601874    2574 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601876    2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601879    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601881    2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601885    2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601889    2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601892    2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601896    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601898    2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:38.605588 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601901    2574 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601904    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601907    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601914    2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601917    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601920    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601922    2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601925    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601928    2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601931    2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601933    2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601936    2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601940    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601943    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601945    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601948    2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601950    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601953    2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601956    2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:38.606048 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601958    2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601961    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601963    2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601966    2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601968    2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601971    2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601973    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601976    2574 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601978    2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601981    2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601983    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601985    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601988    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601990    2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601993    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601996    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.601998    2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602006    2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602008    2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602011    2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:38.606497 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602013    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602016    2574 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602019    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602021    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602023    2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602027    2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602030    2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602032    2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602035    2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602037    2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602039    2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602042    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602044    2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602046    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602049    2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602051    2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602054    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602056    2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602058    2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:38.606977 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602061    2574 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602063    2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602066    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602069    2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602071    2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.602073    2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.602983    2574 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.602997    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603006    2574 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603011    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603015    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603024    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603028    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603036    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603042    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603045    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603048    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603051    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603055    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603058    2574 flags.go:64] FLAG: --cgroup-root=""
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603060    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603063    2574 flags.go:64] FLAG: --client-ca-file=""
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603066    2574 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 21:43:38.607402 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603069    2574 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603075    2574 flags.go:64] FLAG: --cluster-domain=""
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603078    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603081    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603084    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603087    2574 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603091    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603094    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603097    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603100    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603103    2574 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603106    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603109    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603112    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603115    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603119    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603122    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603124    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603127    2574 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603130    2574 flags.go:64] FLAG: --enable-server="true"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603133    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603147    2574 flags.go:64] FLAG: --event-burst="100"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603151    2574 flags.go:64] FLAG: --event-qps="50"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603155    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 21:43:38.607945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603158    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603161    2574 flags.go:64] FLAG: --eviction-hard=""
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603166    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603170    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603172    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603175    2574 flags.go:64] FLAG: --eviction-soft=""
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603178    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603181    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603184    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603187    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603189    2574 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603192    2574 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603195    2574 flags.go:64] FLAG: --feature-gates=""
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603199    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603202    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603205    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603208    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603211    2574 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603214    2574 flags.go:64] FLAG: --help="false"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603216    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603220    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603223    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603225    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 21:43:38.608537 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603229    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603232    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603235    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603238    2574 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603241    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603244    2574 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603246    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603255    2574 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603259    2574 flags.go:64] FLAG: --kube-reserved=""
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603262    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603264    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603267    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603270    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603272    2574 flags.go:64] FLAG: --lock-file=""
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603275    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603278    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603281    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603286    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603288    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603291    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603294    2574 flags.go:64] FLAG: --logging-format="text"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603297    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603300    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603303    2574 flags.go:64] FLAG: --manifest-url=""
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603305    2574 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 21:43:38.609087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603310    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603313    2574 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603316    2574 flags.go:64] FLAG: --max-pods="110"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603319    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603322    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603325    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603327    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603330    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603333    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603336    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603349    2574 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603352    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603355    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603358    2574 flags.go:64] FLAG: --pod-cidr=""
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603360    2574 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603369    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603372    2574 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603375    2574 flags.go:64] FLAG: --port="10250"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603378    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603381    2574 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0c8b9cf9e79a72622"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603383    2574 flags.go:64] FLAG: --qos-reserved=""
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603386    2574 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603389    2574 flags.go:64] FLAG: --register-node="true"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603392    2574 flags.go:64] FLAG: --register-with-taints=""
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603395    2574 flags.go:64] FLAG: --registry-burst="10"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603398    2574 flags.go:64] FLAG: --registry-qps="5"
Oct 30 21:43:38.609670 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603401    2574 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603404    2574 flags.go:64] FLAG: --reserved-memory=""
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603409    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603412    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603415    2574 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603417    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603420    2574 flags.go:64] FLAG: --runonce="false"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603423    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603426    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603428    2574 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603431    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603434    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603437    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603440    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603443    2574 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603446    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603449    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603451    2574 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603454    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603457    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603460    2574 flags.go:64] FLAG: --system-cgroups=""
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603462    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603473    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603479    2574 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603482    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 21:43:38.610368 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603488    2574 flags.go:64] FLAG: --tls-min-version=""
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603491    2574 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603494    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603496    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603499    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603502    2574 flags.go:64] FLAG: --v="2"
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603506    2574 flags.go:64] FLAG: --version="false"
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603510    2574 flags.go:64] FLAG: --vmodule=""
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603514    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.603519    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603724    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603729    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603733    2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603735    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603738    2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603740    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603743    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603745    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603748    2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603751    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603753    2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:38.611248 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603756    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603758    2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603761    2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603763    2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603766    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603768    2574 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603771    2574 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603773    2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603775    2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603783    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603786    2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603788    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603791    2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603793    2574 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603796    2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603798    2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603801    2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603803    2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603806    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603808    2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:38.611767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603813    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603815    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603818    2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603820    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603823    2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603825    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603828    2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603830    2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603832    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603836    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603839    2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603841    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603844    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603846    2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603849    2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603851    2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603854    2574 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603856    2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603859    2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:38.612232 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603861    2574 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603863    2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.603866    2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604224    2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604227    2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604230    2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604232    2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604235    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604238    2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604240    2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604243    2574 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604245    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604248    2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604252    2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604254    2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604258    2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604261    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604264    2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604267    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:38.612699 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604269    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604271    2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604274    2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604277    2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604280    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604282    2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604285    2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604287    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604290    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604292    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604295    2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604297    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604300    2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604302    2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604305    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604308    2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604310    2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604313    2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604317    2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:38.613183 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604321    2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604324    2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604326    2574 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604329    2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604331    2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604334    2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604336    2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604340    2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604342    2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604345    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604347    2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604350    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604352    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604355    2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604357    2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604360    2574 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604364    2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:38.613629 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604366    2574 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:38.614040 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.604395    2574 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:43:38.614040 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604436    2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:38.614040 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604440    2574 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:38.614040 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604443    2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:38.614040 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604446    2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:38.614040 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604448    2574 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:38.614040 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604451    2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:38.614040 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604454    2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:38.614040 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604456    2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:38.614040 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604459    2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:38.614040 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604462    2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:38.614040 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604464    2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:38.614040 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604467    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:38.614040 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604472    2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:38.614040 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604475    2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:38.614040 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604477    2574 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604480    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604482    2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604485    2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604487    2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604491    2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604497    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604499    2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604502    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604504    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604507    2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604509    2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604512    2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604514    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604517    2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604519    2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604523    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604526    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604528    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:38.614417 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604531    2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604533    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604536    2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604538    2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604541    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604544    2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604546    2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604548    2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604552    2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604555    2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604558    2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604561    2574 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604563    2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604566    2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604568    2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604571    2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604573    2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604576    2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604578    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:38.614868 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604582    2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604584    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604587    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604590    2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604592    2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604594    2574 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604597    2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604599    2574 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604602    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604605    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604609    2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604612    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604614    2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604617    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604619    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604621    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604624    2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604627    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604629    2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604631    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:38.615293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604634    2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604636    2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604639    2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604641    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604644    2574 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604646    2574 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604649    2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604652    2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604655    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604657    2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604660    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604662    2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604666    2574 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604669    2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604671    2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604673    2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604676    2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604693    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604695    2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604698    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:38.615767 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604700    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604703    2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604707    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604709    2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604712    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604715    2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604717    2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604720    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604722    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604726    2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604729    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604731    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604734    2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.604736    2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.612635    2574 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.612650    2574 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.613312    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.613318    2574 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613376    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:38.616227 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613382    2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613385    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613388    2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613391    2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613393    2574 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613396    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613399    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613401    2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613404    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613406    2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613409    2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613411    2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613414    2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613416    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613419    2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613422    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613425    2574 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613427    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613430    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613432    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:38.616647 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613435    2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613437    2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613440    2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613443    2574 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613445    2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613448    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613450    2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613453    2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613456    2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613461    2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613465    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613468    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613471    2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613474    2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613477    2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613479    2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613482    2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613484    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613487    2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:38.617131 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613489    2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613492    2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613494    2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613497    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613499    2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613502    2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613504    2574 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613507    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613510    2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613512    2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613514    2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613517    2574 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613520    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613522    2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613525    2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613528    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613530    2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613533    2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613535    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613537    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:38.617572 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613540    2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613543    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613546    2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613548    2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613551    2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613554    2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613556    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613558    2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613561    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613564    2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613566    2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613569    2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613571    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613574    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613576    2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613579    2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613581    2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613584    2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613586    2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613589    2574 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:38.618079 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613592    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613594    2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613597    2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613599    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613602    2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613604    2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613607    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613609    2574 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613611    2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613614    2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613616    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613619    2574 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613622    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613624    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613626    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613629    2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613633    2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613637    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613640    2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:38.618531 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613643    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:38.618986 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613646    2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:38.618986 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613648    2574 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:38.618986 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613651    2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:38.618986 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613653    2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:38.618986 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613656    2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:38.618986 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613658    2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:38.618986 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.613703    2574 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:43:38.618986 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613852    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:38.618986 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613858    2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:38.618986 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613861    2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:38.618986 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613864    2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:38.618986 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613866    2574 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:38.618986 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613869    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:38.618986 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613872    2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:38.618986 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613874    2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:38.618986 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613877    2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613879    2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613882    2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613884    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613887    2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613890    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613892    2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613895    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613897    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613900    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613903    2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613906    2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613908    2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613911    2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613913    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613916    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613918    2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613921    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613923    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:38.619356 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613926    2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613928    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613930    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613933    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613935    2574 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613937    2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613940    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613942    2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613945    2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613947    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613950    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613953    2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613956    2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613958    2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613961    2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613963    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613965    2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613968    2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613970    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:38.619807 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613973    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613975    2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613978    2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613980    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613983    2574 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613985    2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613988    2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613990    2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613993    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613995    2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.613998    2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614000    2574 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614003    2574 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614005    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614007    2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614010    2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614012    2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614015    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614017    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:38.620241 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614020    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614022    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614025    2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614027    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614030    2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614034    2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614038    2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614041    2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614045    2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614048    2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614050    2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614053    2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614055    2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614058    2574 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614060    2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614063    2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614065    2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614068    2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614070    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:38.620812 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614072    2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614077    2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614080    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614082    2574 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614084    2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614087    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614089    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614092    2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614094    2574 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614097    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614099    2574 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614101    2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614104    2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614107    2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614111    2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614114    2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614116    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614119    2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614122    2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:38.621249 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614124    2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:38.621698 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614127    2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:38.621698 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614130    2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:38.621698 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.614154    2574 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:43:38.621698 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614189    2574 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:43:38.621698 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614193    2574 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:43:38.621698 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614196    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:43:38.621698 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614198    2574 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:43:38.621698 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614201    2574 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:43:38.621698 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614203    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:43:38.621698 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614205    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:43:38.621698 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614208    2574 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:43:38.621698 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614210    2574 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:43:38.621698 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614213    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:43:38.621698 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614220    2574 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:43:38.621698 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614222    2574 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:43:38.621698 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614225    2574 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614227    2574 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614230    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614232    2574 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614235    2574 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614237    2574 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614240    2574 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614242    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614245    2574 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614247    2574 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614249    2574 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614252    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614254    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614257    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614259    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614262    2574 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614265    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614267    2574 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614272    2574 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:43:38.622074 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614276    2574 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614279    2574 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614281    2574 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614284    2574 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614286    2574 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614289    2574 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614291    2574 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614293    2574 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614296    2574 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614298    2574 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614301    2574 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614304    2574 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614306    2574 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614309    2574 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614311    2574 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614314    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614316    2574 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614319    2574 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614321    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614324    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:43:38.622501 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614326    2574 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614328    2574 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614331    2574 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614333    2574 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614336    2574 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614338    2574 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614342    2574 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614345    2574 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614347    2574 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614350    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614352    2574 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614355    2574 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614358    2574 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614360    2574 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614363    2574 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614365    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614368    2574 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614370    2574 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614373    2574 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614375    2574 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:43:38.622993 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614378    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614380    2574 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614382    2574 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614386    2574 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614388    2574 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614391    2574 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614393    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614396    2574 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614401    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614404    2574 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614406    2574 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614409    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614411    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614414    2574 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614417    2574 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614419    2574 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614422    2574 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614425    2574 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614428    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:43:38.623432 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614430    2574 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614433    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614435    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614437    2574 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614440    2574 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614443    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614446    2574 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614448    2574 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614451    2574 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614453    2574 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614455    2574 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614459    2574 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614461    2574 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614464    2574 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614466    2574 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:38.614468    2574 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.614519    2574 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.616770    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 21:43:38.623879 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.617753    2574 server.go:1014] "Starting client certificate rotation"
Oct 30 21:43:38.624306 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.617845    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:43:38.624306 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.618582    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:43:38.624306 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.619826    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:43:38.624306 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.620972    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:43:38.631750 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.631724    2574 log.go:25] "Validated CRI v1 runtime API"
Oct 30 21:43:38.635177 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.635158    2574 log.go:25] "Validated CRI v1 image API"
Oct 30 21:43:38.635969 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.635946    2574 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 21:43:38.638748 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.638730    2574 fs.go:135] Filesystem UUIDs: map[466e2c41-e43e-4db4-ab45-6fa1f1367a8f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f2d0958a-194e-4d8d-9845-412d9e8b04cd:/dev/nvme0n1p3]
Oct 30 21:43:38.638807 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.638748    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 21:43:38.645253 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.645144    2574 manager.go:217] Machine: {Timestamp:2026-10-30 21:43:38.64377481 +0000 UTC m=+0.305592635 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100468 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28df65027434141408c5c2e328bded SystemUUID:ec28df65-0274-3414-1408-c5c2e328bded BootID:d1b50514-2f43-4b95-91f4-8b1ec9a45ed2 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:bc:ee:48:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:bc:ee:48:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:24:0d:36:d0:3f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 21:43:38.645967 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.645957    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 21:43:38.646041 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.646029    2574 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 21:43:38.649673 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.649651    2574 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 21:43:38.649840 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.649675    2574 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-154.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 21:43:38.650453 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.650444    2574 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 21:43:38.650484 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.650456    2574 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 21:43:38.650484 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.650480    2574 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:43:38.650535 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.650495    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:43:38.651475 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.651465    2574 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 21:43:38.655746 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.655731    2574 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 21:43:38.655867 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.655858    2574 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 21:43:38.656660 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.656651    2574 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 21:43:38.656705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.656667    2574 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 21:43:38.656705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.656694    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 21:43:38.656705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.656704    2574 kubelet.go:405] "Adding apiserver pod source"
Oct 30 21:43:38.656811 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.656711    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 21:43:38.657015 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.657002    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:43:38.659424 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.659410    2574 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 21:43:38.665867 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.665853    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:43:38.666839 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.666826    2574 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 21:43:38.666873 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.666858    2574 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 21:43:38.667047 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.667037    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 21:43:38.667080 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.667053    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 21:43:38.667080 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.667059    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 21:43:38.667080 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.667064    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 21:43:38.667080 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.667069    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 21:43:38.667080 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.667075    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 21:43:38.667776 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.667704    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 21:43:38.667805 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.667781    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 21:43:38.667805 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.667789    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 21:43:38.667805 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.667795    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 21:43:38.667805 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.667804    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 21:43:38.667958 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.667813    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 21:43:38.669430 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.669419    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 21:43:38.669462 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.669434    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 21:43:38.673451 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.673438    2574 server.go:1263] "Started kubelet"
Oct 30 21:43:38.673588 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.673533    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 21:43:38.673654 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.673615    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 21:43:38.673654 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.673623    2574 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 21:43:38.674387 ip-10-0-142-154 systemd[1]: Started Kubernetes Kubelet.
Oct 30 21:43:38.676893 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.676878    2574 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 21:43:38.678630 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.678615    2574 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 21:43:38.680279 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:38.680262    2574 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 21:43:38.684711 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.684562    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 21:43:38.685189 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.685169    2574 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 21:43:38.685790 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:38.685769    2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-154.us-west-1.compute.internal\" not found"
Oct 30 21:43:38.685919 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.685886    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 21:43:38.685919 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.685897    2574 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 21:43:38.685919 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.685913    2574 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 21:43:38.685919 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.685917    2574 factory.go:55] Registering systemd factory
Oct 30 21:43:38.686068 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.685929    2574 factory.go:223] Registration of the systemd container factory successfully
Oct 30 21:43:38.686068 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.685981    2574 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 21:43:38.686068 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.685989    2574 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 21:43:38.686175 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.686143    2574 factory.go:153] Registering CRI-O factory
Oct 30 21:43:38.686175 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.686154    2574 factory.go:223] Registration of the crio container factory successfully
Oct 30 21:43:38.686253 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.686195    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 21:43:38.686253 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.686208    2574 factory.go:103] Registering Raw factory
Oct 30 21:43:38.686253 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.686218    2574 manager.go:1199] Started watching for new ooms in manager
Oct 30 21:43:38.687108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.687094    2574 manager.go:319] Starting recovery of all containers
Oct 30 21:43:38.698026 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.698010    2574 manager.go:324] Recovery completed
Oct 30 21:43:38.701907 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.701894    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:38.703593 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.703561    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:38.703673 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.703612    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:38.703673 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.703626    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:38.704082 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.704067    2574 cpu_manager.go:226] "Starting" policy="none"
Oct 30 21:43:38.704082 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.704079    2574 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 21:43:38.704191 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.704094    2574 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 21:43:38.704191 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.704106    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:38.705607 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.705590    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:38.705656 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.705619    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:38.705656 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.705629    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:38.706222 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.706210    2574 policy_none.go:50] "Start"
Oct 30 21:43:38.706262 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.706226    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 21:43:38.706262 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.706239    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 21:43:38.708204 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.708193    2574 policy_none.go:44] "Start"
Oct 30 21:43:38.767310 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.746998    2574 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 21:43:38.767310 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.749343    2574 manager.go:341] "Starting Device Plugin manager"
Oct 30 21:43:38.767310 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:38.749997    2574 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 21:43:38.767310 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.750010    2574 server.go:87] "Starting device plugin registration server"
Oct 30 21:43:38.767310 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.750195    2574 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 21:43:38.767310 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.750204    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 21:43:38.767310 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.750304    2574 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 21:43:38.767310 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.750384    2574 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 21:43:38.767310 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.750391    2574 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 21:43:38.767310 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:38.750904    2574 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 21:43:38.767310 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:38.750956    2574 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-154.us-west-1.compute.internal\" not found"
Oct 30 21:43:38.767310 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.756622    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 21:43:38.767310 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.757849    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 21:43:38.767310 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.757867    2574 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 21:43:38.767310 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.757889    2574 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 21:43:38.767310 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:38.757918    2574 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 21:43:38.819984 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:38.819942    2574 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-154.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 21:43:38.819984 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.819960    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-154.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 21:43:38.821098 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:38.819959    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-154.us-west-1.compute.internal.18e36cb90d6a49f2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-154.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-154.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 21:43:38.673408498 +0000 UTC m=+0.335226322,LastTimestamp:2026-10-30 21:43:38.673408498 +0000 UTC m=+0.335226322,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-154.us-west-1.compute.internal,}"
Oct 30 21:43:38.850849 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.850799    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:38.851457 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.851441    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:38.851543 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.851471    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:38.851543 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.851485    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:38.851543 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.851513    2574 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:38.858116 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.858098    2574 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal"]
Oct 30 21:43:38.858199 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.858157    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:38.858812 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.858797    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:38.858893 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.858826    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:38.858893 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.858842    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:38.860802 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.860788    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:38.860938 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.860924    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:38.860983 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.860954    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:38.861497 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.861483    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:38.861497 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.861491    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:38.861642 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.861514    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:38.861642 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.861529    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:38.861642 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.861515    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:38.861642 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.861602    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:38.863553 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.863537    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:38.863637 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.863559    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:38.864151 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.864135    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:38.864227 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.864159    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:38.864227 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.864171    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:38.881717 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:38.881698    2574 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-154.us-west-1.compute.internal\" not found" node="ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:38.883452 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:38.883434    2574 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-154.us-west-1.compute.internal\" not found" node="ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:38.887647 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.887631    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e4bbb2b70f21f2ae358c77963ab899a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"0e4bbb2b70f21f2ae358c77963ab899a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:38.887712 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.887655    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e4bbb2b70f21f2ae358c77963ab899a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"0e4bbb2b70f21f2ae358c77963ab899a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:38.887712 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.887673    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7338dfe0a44a7307924a221163b5ea2d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"7338dfe0a44a7307924a221163b5ea2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:38.894551 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.894535    2574 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 21:43:38.894613 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.894584    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b9kkd"
Oct 30 21:43:38.922002 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:38.921931    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-154.us-west-1.compute.internal.18e36cb90f36dc12  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-154.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-154.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-154.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 21:43:38.703592466 +0000 UTC m=+0.365410298,LastTimestamp:2026-10-30 21:43:38.703592466 +0000 UTC m=+0.365410298,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-154.us-west-1.compute.internal,}"
Oct 30 21:43:38.922666 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:38.922644    2574 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-154.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 30 21:43:38.922748 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:38.922647    2574 reflector.go:204] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass"
Oct 30 21:43:38.922748 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:38.922649    2574 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 21:43:38.971737 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:38.971713    2574 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 21:43:38.978566 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:38.978552    2574 kubelet_node_status.go:115] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-154.us-west-1.compute.internal\" not found" node="ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:38.988531 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.988514    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e4bbb2b70f21f2ae358c77963ab899a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"0e4bbb2b70f21f2ae358c77963ab899a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:38.988595 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.988539    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e4bbb2b70f21f2ae358c77963ab899a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"0e4bbb2b70f21f2ae358c77963ab899a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:38.988595 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.988557    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7338dfe0a44a7307924a221163b5ea2d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"7338dfe0a44a7307924a221163b5ea2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:38.988595 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.988581    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7338dfe0a44a7307924a221163b5ea2d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"7338dfe0a44a7307924a221163b5ea2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:38.988701 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.988602    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e4bbb2b70f21f2ae358c77963ab899a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"0e4bbb2b70f21f2ae358c77963ab899a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:38.988701 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:38.988608    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e4bbb2b70f21f2ae358c77963ab899a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"0e4bbb2b70f21f2ae358c77963ab899a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:39.123592 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:39.123545    2574 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-154.us-west-1.compute.internal\" not found" node="ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:39.179198 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:39.179171    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:39.179989 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:39.179974    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:39.180064 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:39.180004    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:39.180064 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:39.180015    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:39.180064 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:39.180044    2574 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:39.187206 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:39.187192    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:39.188314 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:39.188298    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:39.237838 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:39.237820    2574 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:39.237838 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:39.237842    2574 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-154.us-west-1.compute.internal\": node \"ip-10-0-142-154.us-west-1.compute.internal\" not found"
Oct 30 21:43:39.351840 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:39.351821    2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-154.us-west-1.compute.internal\" not found"
Oct 30 21:43:39.452507 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:39.452455    2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-154.us-west-1.compute.internal\" not found"
Oct 30 21:43:39.553277 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:39.553255    2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-154.us-west-1.compute.internal\" not found"
Oct 30 21:43:39.617481 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:39.617461    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 21:43:39.618147 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:39.617613    2574 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a9858833090b34fb5b824294711bfe6c-e75a63cf43fa0c23.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-142-154.us-west-1.compute.internal.18e36cb90f374672\": read tcp 10.0.142.154:46358->52.15.110.238:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-142-154.us-west-1.compute.internal.18e36cb90f374672  default   4798 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-154.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-154.us-west-1.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-154.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 21:43:38 +0000 UTC,LastTimestamp:2026-10-30 21:43:38.858832957 +0000 UTC m=+0.520650783,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-154.us-west-1.compute.internal,}"
Oct 30 21:43:39.653766 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:39.653743    2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-154.us-west-1.compute.internal\" not found"
Oct 30 21:43:39.754661 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:39.754609    2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-154.us-west-1.compute.internal\" not found"
Oct 30 21:43:39.854888 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:39.854865    2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-154.us-west-1.compute.internal\" not found"
Oct 30 21:43:39.900428 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:39.900397    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:38:39 +0000 UTC" deadline="2028-05-26 14:44:16.97703401 +0000 UTC"
Oct 30 21:43:39.900428 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:39.900421    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13769h0m37.076615292s"
Oct 30 21:43:39.940359 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:39.940338    2574 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:43:39.941650 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:39.941631    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:43:39.941729 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:39.941669    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:43:39.941729 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:39.941700    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:43:39.955875 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:39.955856    2574 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-154.us-west-1.compute.internal\" not found"
Oct 30 21:43:40.033190 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.033128    2574 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:43:40.033278 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.033194    2574 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:43:40.086594 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.086565    2574 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:40.149094 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.149072    2574 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:43:40.150829 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.150814    2574 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:43:40.208105 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.208085    2574 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:43:40.329559 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:40.329519    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4bbb2b70f21f2ae358c77963ab899a.slice/crio-a9925d2a0152b4eb2e6974f20c8ef6b56811626fff9439fb873a0fe88968f8ab WatchSource:0}: Error finding container a9925d2a0152b4eb2e6974f20c8ef6b56811626fff9439fb873a0fe88968f8ab: Status 404 returned error can't find the container with id a9925d2a0152b4eb2e6974f20c8ef6b56811626fff9439fb873a0fe88968f8ab
Oct 30 21:43:40.329982 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:40.329961    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7338dfe0a44a7307924a221163b5ea2d.slice/crio-3272ae76cd49213018fdf91d4cecc7a6bf47da3a1b787122b86f5c7a4fae7938 WatchSource:0}: Error finding container 3272ae76cd49213018fdf91d4cecc7a6bf47da3a1b787122b86f5c7a4fae7938: Status 404 returned error can't find the container with id 3272ae76cd49213018fdf91d4cecc7a6bf47da3a1b787122b86f5c7a4fae7938
Oct 30 21:43:40.334659 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.334643    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:43:40.427774 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.427747    2574 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:43:40.549854 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.549825    2574 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:43:40.657050 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.657026    2574 apiserver.go:52] "Watching apiserver"
Oct 30 21:43:40.685646 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.685622    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 21:43:40.762430 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.762373    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal" event={"ID":"0e4bbb2b70f21f2ae358c77963ab899a","Type":"ContainerStarted","Data":"a9925d2a0152b4eb2e6974f20c8ef6b56811626fff9439fb873a0fe88968f8ab"}
Oct 30 21:43:40.763439 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.763415    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal" event={"ID":"7338dfe0a44a7307924a221163b5ea2d","Type":"ContainerStarted","Data":"3272ae76cd49213018fdf91d4cecc7a6bf47da3a1b787122b86f5c7a4fae7938"}
Oct 30 21:43:40.768821 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.768801    2574 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 21:43:40.769121 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.769104    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th","openshift-network-diagnostics/network-check-target-r54tb","openshift-image-registry/node-ca-j6x9n","openshift-multus/multus-additional-cni-plugins-pjtvc","openshift-multus/network-metrics-daemon-jdg72","openshift-ovn-kubernetes/ovnkube-node-mnpfz","kube-system/global-pull-secret-syncer-8c64w","openshift-cluster-node-tuning-operator/tuned-ccgs8","openshift-dns/node-resolver-zhhh4","openshift-network-operator/iptables-alerter-z8qm8","kube-system/konnectivity-agent-kfvjg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal","openshift-multus/multus-zldds"]
Oct 30 21:43:40.773163 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.773143    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.775387 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.775366    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.777626 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.777608    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:43:40.780019 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.779997    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:43:40.782294 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.782270    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:40.782405 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:40.782344    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jdg72" podUID="f1c0a201-8b48-44fb-b107-a5f2bb798235"
Oct 30 21:43:40.784633 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.784606    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.786872 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.786848    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:40.786943 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:40.786915    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c64w" podUID="9b06a5cb-5c28-4146-bbea-bfbe2297136c"
Oct 30 21:43:40.789273 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.789252    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:40.791614 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.791591    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:40.791699 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:40.791663    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r54tb" podUID="ec41ebc2-3ff6-4453-8eb4-c420b02516c2"
Oct 30 21:43:40.794030 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.794015    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:43:40.796474 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.796457    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:43:40.799623 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.799597    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:40.799964 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.799782    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9q2b\" (UniqueName: \"kubernetes.io/projected/6d58dca9-093d-416e-b353-9e9b792d6c23-kube-api-access-h9q2b\") pod \"node-resolver-zhhh4\" (UID: \"6d58dca9-093d-416e-b353-9e9b792d6c23\") " pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:43:40.799964 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.799829    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.799964 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.799925    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-kubelet\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.800179 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.800021    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-systemd-units\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.800179 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.800104    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-cni-netd\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.800179 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.800162    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-multus-certs\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.800624 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.800600    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b06a5cb-5c28-4146-bbea-bfbe2297136c-kubelet-config\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:40.800677 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.800641    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b06a5cb-5c28-4146-bbea-bfbe2297136c-dbus\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:40.800730 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.800672    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-cni-bin\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.800730 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.800699    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zccg7\" (UniqueName: \"kubernetes.io/projected/03c4973c-9623-4cb4-a239-efdae2ff0b90-kube-api-access-zccg7\") pod \"node-ca-j6x9n\" (UID: \"03c4973c-9623-4cb4-a239-efdae2ff0b90\") " pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:43:40.800842 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.800749    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-cni-bin\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.800842 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.800774    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-ovnkube-script-lib\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.800842 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.800801    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:40.800951 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.800847    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-var-lib-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.800951 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.800884    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.801078 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.800944    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cni-binary-copy\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.801078 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.800992    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d58dca9-093d-416e-b353-9e9b792d6c23-hosts-file\") pod \"node-resolver-zhhh4\" (UID: \"6d58dca9-093d-416e-b353-9e9b792d6c23\") " pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:43:40.801078 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801023    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03c4973c-9623-4cb4-a239-efdae2ff0b90-serviceca\") pod \"node-ca-j6x9n\" (UID: \"03c4973c-9623-4cb4-a239-efdae2ff0b90\") " pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:43:40.801078 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801048    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-ovn\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.801078 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801074    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-run-ovn-kubernetes\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.801302 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801102    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/add4a18a-fa1b-45c7-8719-2c88634c6488-ovn-node-metrics-cert\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.801302 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801150    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.801302 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801215    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-cnibin\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.801302 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801254    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-k8s-cni-cncf-io\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.801477 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801305    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-run-netns\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.801477 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801333    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-cni-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.801477 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801360    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-kubelet\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.801477 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801403    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-env-overrides\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.801477 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801440    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d58dca9-093d-416e-b353-9e9b792d6c23-tmp-dir\") pod \"node-resolver-zhhh4\" (UID: \"6d58dca9-093d-416e-b353-9e9b792d6c23\") " pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:43:40.801706 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801484    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-hostroot\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.801706 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801509    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-daemon-config\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.801706 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801525    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03c4973c-9623-4cb4-a239-efdae2ff0b90-host\") pod \"node-ca-j6x9n\" (UID: \"03c4973c-9623-4cb4-a239-efdae2ff0b90\") " pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:43:40.801706 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801541    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cnibin\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.801706 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801558    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-etc-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.801706 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801594    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5zvx\" (UniqueName: \"kubernetes.io/projected/f1c0a201-8b48-44fb-b107-a5f2bb798235-kube-api-access-j5zvx\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:40.801706 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801629    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-system-cni-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.802108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801728    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-socket-dir-parent\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.802108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801762    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-netns\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.802108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801799    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-system-cni-dir\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.802108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801831    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.802108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801857    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:40.802108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801874    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-cni-multus\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.802108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801894    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdnlt\" (UniqueName: \"kubernetes.io/projected/5a9a228b-279e-4895-972f-dbd2de5a9304-kube-api-access-mdnlt\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.802108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801914    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-slash\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.802108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801935    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlbpz\" (UniqueName: \"kubernetes.io/projected/add4a18a-fa1b-45c7-8719-2c88634c6488-kube-api-access-nlbpz\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.802108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801953    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-log-socket\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.802108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801976    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.802108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.801994    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqzpn\" (UniqueName: \"kubernetes.io/projected/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-kube-api-access-mqzpn\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.802108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.802022    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a9a228b-279e-4895-972f-dbd2de5a9304-cni-binary-copy\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.802108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.802056    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-systemd\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.802108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.802086    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-node-log\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.802108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.802104    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-ovnkube-config\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.802990 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.802131    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-conf-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.802990 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.802150    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-etc-kubernetes\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.830333 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.830126    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9vv2h\""
Oct 30 21:43:40.830333 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.830137    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 21:43:40.830333 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.830137    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 21:43:40.830333 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.830155    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 21:43:40.830333 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.830162    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 21:43:40.830333 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.830166    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 21:43:40.831192 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.831178    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 21:43:40.831327 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.831313    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-fqpcl\""
Oct 30 21:43:40.833616 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.833597    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 21:43:40.833737 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.833720    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 21:43:40.833886 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.833873    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5pc99\""
Oct 30 21:43:40.836398 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.836382    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 21:43:40.836479 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.836403    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 21:43:40.836479 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.836426    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 21:43:40.836479 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.836441    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6hfjp\""
Oct 30 21:43:40.878731 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.878704    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 21:43:40.878731 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.878721    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 21:43:40.878888 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.878780    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 21:43:40.878888 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.878798    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hkrw6\""
Oct 30 21:43:40.878888 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.878799    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 21:43:40.878888 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.878837    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 21:43:40.879020 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.878937    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 21:43:40.880940 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.880924    2574 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 21:43:40.880988 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.880973    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w26gg"
Oct 30 21:43:40.886993 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.886979    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 21:43:40.902567 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902524    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d58dca9-093d-416e-b353-9e9b792d6c23-tmp-dir\") pod \"node-resolver-zhhh4\" (UID: \"6d58dca9-093d-416e-b353-9e9b792d6c23\") " pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:43:40.902567 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902554    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-hostroot\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.902715 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-daemon-config\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.902715 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902585    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03c4973c-9623-4cb4-a239-efdae2ff0b90-host\") pod \"node-ca-j6x9n\" (UID: \"03c4973c-9623-4cb4-a239-efdae2ff0b90\") " pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:43:40.902715 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902599    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cnibin\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.902715 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902631    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03c4973c-9623-4cb4-a239-efdae2ff0b90-host\") pod \"node-ca-j6x9n\" (UID: \"03c4973c-9623-4cb4-a239-efdae2ff0b90\") " pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:43:40.902715 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902634    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-hostroot\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.902715 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902668    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-etc-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.902715 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902683    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5zvx\" (UniqueName: \"kubernetes.io/projected/f1c0a201-8b48-44fb-b107-a5f2bb798235-kube-api-access-j5zvx\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902726    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cnibin\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902729    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-etc-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902750    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-system-cni-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902770    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-socket-dir-parent\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902791    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-netns\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902789    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-system-cni-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902809    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-device-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902834    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-socket-dir-parent\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902807    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d58dca9-093d-416e-b353-9e9b792d6c23-tmp-dir\") pod \"node-resolver-zhhh4\" (UID: \"6d58dca9-093d-416e-b353-9e9b792d6c23\") " pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902863    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-system-cni-dir\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902837    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-system-cni-dir\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902836    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-netns\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902913    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902941    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.902963    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/877a7e09-3007-4c2a-97ef-690e99a27dc5-tmp\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903019    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-cni-multus\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:40.903028    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:43:40.903081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903037    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdnlt\" (UniqueName: \"kubernetes.io/projected/5a9a228b-279e-4895-972f-dbd2de5a9304-kube-api-access-mdnlt\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.903936 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903054    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-slash\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.903936 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903071    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlbpz\" (UniqueName: \"kubernetes.io/projected/add4a18a-fa1b-45c7-8719-2c88634c6488-kube-api-access-nlbpz\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.903936 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903082    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-cni-multus\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.903936 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:40.903095    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs podName:f1c0a201-8b48-44fb-b107-a5f2bb798235 nodeName:}" failed. No retries permitted until 2026-10-30 21:43:41.403073564 +0000 UTC m=+3.064891397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs") pod "network-metrics-daemon-jdg72" (UID: "f1c0a201-8b48-44fb-b107-a5f2bb798235") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:43:40.903936 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903124    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-modprobe-d\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:40.903936 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903129    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-slash\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.903936 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903150    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-run\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:40.903936 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903175    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-host\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:40.903936 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903199    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nrnx\" (UniqueName: \"kubernetes.io/projected/6af24624-056b-44b8-bef3-8a894bf0078b-kube-api-access-8nrnx\") pod \"iptables-alerter-z8qm8\" (UID: \"6af24624-056b-44b8-bef3-8a894bf0078b\") " pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:43:40.903936 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903233    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-daemon-config\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.903936 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903252    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-log-socket\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.903936 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903309    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-log-socket\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.903936 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903302    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.903936 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903330    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.903936 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903336    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqzpn\" (UniqueName: \"kubernetes.io/projected/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-kube-api-access-mqzpn\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.903936 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903354    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a9a228b-279e-4895-972f-dbd2de5a9304-cni-binary-copy\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903372    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwq8k\" (UniqueName: \"kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k\") pod \"network-check-target-r54tb\" (UID: \"ec41ebc2-3ff6-4453-8eb4-c420b02516c2\") " pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903389    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysctl-d\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903451    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-systemd\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903458    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903482    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-node-log\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903500    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-systemd\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903507    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-ovnkube-config\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903523    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-conf-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903539    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-etc-kubernetes\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903522    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-node-log\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903564    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6af24624-056b-44b8-bef3-8a894bf0078b-host-slash\") pod \"iptables-alerter-z8qm8\" (UID: \"6af24624-056b-44b8-bef3-8a894bf0078b\") " pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903587    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-conf-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903591    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9q2b\" (UniqueName: \"kubernetes.io/projected/6d58dca9-093d-416e-b353-9e9b792d6c23-kube-api-access-h9q2b\") pod \"node-resolver-zhhh4\" (UID: \"6d58dca9-093d-416e-b353-9e9b792d6c23\") " pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903618    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903623    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-etc-kubernetes\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903724    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq9cs\" (UniqueName: \"kubernetes.io/projected/976afac6-c62a-4e90-aaa1-5cc80852e988-kube-api-access-cq9cs\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:40.904425 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903825    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-lib-modules\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903856    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-kubelet\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903882    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-systemd-units\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903906    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-cni-netd\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903921    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-kubelet\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903924    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-etc-selinux\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903966    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-systemd-units\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.903996    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-cni-netd\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904014    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-tuned\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904042    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-multus-certs\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904070    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b06a5cb-5c28-4146-bbea-bfbe2297136c-kubelet-config\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904105    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b06a5cb-5c28-4146-bbea-bfbe2297136c-kubelet-config\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904094    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b06a5cb-5c28-4146-bbea-bfbe2297136c-dbus\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904069    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-multus-certs\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904140    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-cni-bin\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904161    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zccg7\" (UniqueName: \"kubernetes.io/projected/03c4973c-9623-4cb4-a239-efdae2ff0b90-kube-api-access-zccg7\") pod \"node-ca-j6x9n\" (UID: \"03c4973c-9623-4cb4-a239-efdae2ff0b90\") " pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904180    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-sys-fs\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:40.905187 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904194    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b06a5cb-5c28-4146-bbea-bfbe2297136c-dbus\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904195    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-sys\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904206    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-cni-bin\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904247    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-var-lib-kubelet\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904284    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-cni-bin\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904334    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-ovnkube-script-lib\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904380    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-cni-bin\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904380    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904424    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-socket-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:40.904462    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:40.904500    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret podName:9b06a5cb-5c28-4146-bbea-bfbe2297136c nodeName:}" failed. No retries permitted until 2026-10-30 21:43:41.404487679 +0000 UTC m=+3.066305494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret") pod "global-pull-secret-syncer-8c64w" (UID: "9b06a5cb-5c28-4146-bbea-bfbe2297136c") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904527    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6af24624-056b-44b8-bef3-8a894bf0078b-iptables-alerter-script\") pod \"iptables-alerter-z8qm8\" (UID: \"6af24624-056b-44b8-bef3-8a894bf0078b\") " pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904553    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-var-lib-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904577    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904593    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cni-binary-copy\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904616    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d58dca9-093d-416e-b353-9e9b792d6c23-hosts-file\") pod \"node-resolver-zhhh4\" (UID: \"6d58dca9-093d-416e-b353-9e9b792d6c23\") " pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904616    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-var-lib-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.905705 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904653    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03c4973c-9623-4cb4-a239-efdae2ff0b90-serviceca\") pod \"node-ca-j6x9n\" (UID: \"03c4973c-9623-4cb4-a239-efdae2ff0b90\") " pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904660    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904655    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a9a228b-279e-4895-972f-dbd2de5a9304-cni-binary-copy\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904740    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0df7f3e5-6d57-46f7-a23b-fd130d949fe2-konnectivity-ca\") pod \"konnectivity-agent-kfvjg\" (UID: \"0df7f3e5-6d57-46f7-a23b-fd130d949fe2\") " pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904746    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d58dca9-093d-416e-b353-9e9b792d6c23-hosts-file\") pod \"node-resolver-zhhh4\" (UID: \"6d58dca9-093d-416e-b353-9e9b792d6c23\") " pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904790    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-registration-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904812    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-ovnkube-config\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904829    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysconfig\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904860    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-ovn\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904890    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-run-ovn-kubernetes\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904912    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/add4a18a-fa1b-45c7-8719-2c88634c6488-ovn-node-metrics-cert\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904914    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-ovn\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904928    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904944    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-cnibin\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904958    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-k8s-cni-cncf-io\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904967    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-run-ovn-kubernetes\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.904981    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-kubernetes\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:40.906247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905000    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-systemd\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905006    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905063    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-cnibin\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905075    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-run-netns\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905016    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-run-netns\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905098    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-k8s-cni-cncf-io\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905117    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-cni-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905139    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03c4973c-9623-4cb4-a239-efdae2ff0b90-serviceca\") pod \"node-ca-j6x9n\" (UID: \"03c4973c-9623-4cb4-a239-efdae2ff0b90\") " pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905147    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0df7f3e5-6d57-46f7-a23b-fd130d949fe2-agent-certs\") pod \"konnectivity-agent-kfvjg\" (UID: \"0df7f3e5-6d57-46f7-a23b-fd130d949fe2\") " pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905144    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905174    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cni-binary-copy\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905142    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-ovnkube-script-lib\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905182    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysctl-conf\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905184    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-cni-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905221    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-kubelet\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905240    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-kubelet\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905241    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-env-overrides\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.906785 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905284    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:40.907317 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905311    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s68fv\" (UniqueName: \"kubernetes.io/projected/877a7e09-3007-4c2a-97ef-690e99a27dc5-kube-api-access-s68fv\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:40.907317 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905371    2574 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 21:43:40.907317 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.905488    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-env-overrides\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.908522 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.908505    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/add4a18a-fa1b-45c7-8719-2c88634c6488-ovn-node-metrics-cert\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:40.939619 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.939593    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 21:43:40.939763 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.939739    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:43:40.939882 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.939741    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 21:43:40.939882 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.939776    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s7wrh\""
Oct 30 21:43:40.939882 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.939792    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 21:43:40.939882 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.939825    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 21:43:40.940105 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.939943    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-gmj65\""
Oct 30 21:43:40.940105 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.939972    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:43:40.940105 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.940043    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 21:43:40.940105 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.940052    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 21:43:40.940105 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.940068    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 21:43:40.940105 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.940081    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vv25x\""
Oct 30 21:43:40.940445 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.940429    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 21:43:40.940492 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.940435    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-22kpt\""
Oct 30 21:43:40.971219 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.971192    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zccg7\" (UniqueName: \"kubernetes.io/projected/03c4973c-9623-4cb4-a239-efdae2ff0b90-kube-api-access-zccg7\") pod \"node-ca-j6x9n\" (UID: \"03c4973c-9623-4cb4-a239-efdae2ff0b90\") " pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:43:40.971219 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.971209    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdnlt\" (UniqueName: \"kubernetes.io/projected/5a9a228b-279e-4895-972f-dbd2de5a9304-kube-api-access-mdnlt\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:43:40.971672 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.971651    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5zvx\" (UniqueName: \"kubernetes.io/projected/f1c0a201-8b48-44fb-b107-a5f2bb798235-kube-api-access-j5zvx\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:40.971792 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.971679    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqzpn\" (UniqueName: \"kubernetes.io/projected/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-kube-api-access-mqzpn\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:40.971792 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.971755    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9q2b\" (UniqueName: \"kubernetes.io/projected/6d58dca9-093d-416e-b353-9e9b792d6c23-kube-api-access-h9q2b\") pod \"node-resolver-zhhh4\" (UID: \"6d58dca9-093d-416e-b353-9e9b792d6c23\") " pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:43:40.971956 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:40.971934    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlbpz\" (UniqueName: \"kubernetes.io/projected/add4a18a-fa1b-45c7-8719-2c88634c6488-kube-api-access-nlbpz\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:41.005949 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.005924    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-device-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:41.006011 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.005970    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-device-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:41.006056 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006010    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/877a7e09-3007-4c2a-97ef-690e99a27dc5-tmp\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.006056 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006027    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-modprobe-d\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.006056 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006041    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-run\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.006056 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006054    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-host\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.006228 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006070    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nrnx\" (UniqueName: \"kubernetes.io/projected/6af24624-056b-44b8-bef3-8a894bf0078b-kube-api-access-8nrnx\") pod \"iptables-alerter-z8qm8\" (UID: \"6af24624-056b-44b8-bef3-8a894bf0078b\") " pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:43:41.006228 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006089    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwq8k\" (UniqueName: \"kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k\") pod \"network-check-target-r54tb\" (UID: \"ec41ebc2-3ff6-4453-8eb4-c420b02516c2\") " pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:41.006228 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006115    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysctl-d\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.006228 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006143    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6af24624-056b-44b8-bef3-8a894bf0078b-host-slash\") pod \"iptables-alerter-z8qm8\" (UID: \"6af24624-056b-44b8-bef3-8a894bf0078b\") " pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:43:41.006228 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006147    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-run\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.006228 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006146    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-host\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.006228 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006142    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-modprobe-d\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.006228 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006174    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq9cs\" (UniqueName: \"kubernetes.io/projected/976afac6-c62a-4e90-aaa1-5cc80852e988-kube-api-access-cq9cs\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:41.006228 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006205    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6af24624-056b-44b8-bef3-8a894bf0078b-host-slash\") pod \"iptables-alerter-z8qm8\" (UID: \"6af24624-056b-44b8-bef3-8a894bf0078b\") " pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:43:41.006228 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006214    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-lib-modules\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006267    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-etc-selinux\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006295    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-tuned\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006321    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysctl-d\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006326    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-sys-fs\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006341    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-lib-modules\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006327    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-etc-selinux\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006360    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-sys\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006409    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-var-lib-kubelet\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006415    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-sys-fs\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006440    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-sys\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006450    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-socket-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006485    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6af24624-056b-44b8-bef3-8a894bf0078b-iptables-alerter-script\") pod \"iptables-alerter-z8qm8\" (UID: \"6af24624-056b-44b8-bef3-8a894bf0078b\") " pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006511    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-var-lib-kubelet\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006518    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0df7f3e5-6d57-46f7-a23b-fd130d949fe2-konnectivity-ca\") pod \"konnectivity-agent-kfvjg\" (UID: \"0df7f3e5-6d57-46f7-a23b-fd130d949fe2\") " pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006544    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-registration-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006548    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-socket-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:41.006924 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006594    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-registration-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:41.007828 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006653    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysconfig\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.007828 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006711    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-kubernetes\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.007828 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006737    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-systemd\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.007828 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006740    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysconfig\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.007828 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006766    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0df7f3e5-6d57-46f7-a23b-fd130d949fe2-agent-certs\") pod \"konnectivity-agent-kfvjg\" (UID: \"0df7f3e5-6d57-46f7-a23b-fd130d949fe2\") " pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:43:41.007828 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006790    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysctl-conf\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.007828 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006802    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-kubernetes\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.007828 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006816    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:41.007828 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006820    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-systemd\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.007828 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006843    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s68fv\" (UniqueName: \"kubernetes.io/projected/877a7e09-3007-4c2a-97ef-690e99a27dc5-kube-api-access-s68fv\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.007828 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.006910    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:41.007828 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.007419    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0df7f3e5-6d57-46f7-a23b-fd130d949fe2-konnectivity-ca\") pod \"konnectivity-agent-kfvjg\" (UID: \"0df7f3e5-6d57-46f7-a23b-fd130d949fe2\") " pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:43:41.007828 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.007438    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6af24624-056b-44b8-bef3-8a894bf0078b-iptables-alerter-script\") pod \"iptables-alerter-z8qm8\" (UID: \"6af24624-056b-44b8-bef3-8a894bf0078b\") " pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:43:41.007828 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.007494    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysctl-conf\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.008776 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.008729    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/877a7e09-3007-4c2a-97ef-690e99a27dc5-tmp\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.008859 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.008794    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-tuned\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.011241 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.011219    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0df7f3e5-6d57-46f7-a23b-fd130d949fe2-agent-certs\") pod \"konnectivity-agent-kfvjg\" (UID: \"0df7f3e5-6d57-46f7-a23b-fd130d949fe2\") " pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:43:41.071645 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:41.071624    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:43:41.071645 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:41.071649    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:43:41.071816 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:41.071664    2574 projected.go:196] Error preparing data for projected volume kube-api-access-wwq8k for pod openshift-network-diagnostics/network-check-target-r54tb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:43:41.071816 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:41.071741    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k podName:ec41ebc2-3ff6-4453-8eb4-c420b02516c2 nodeName:}" failed. No retries permitted until 2026-10-30 21:43:41.571723993 +0000 UTC m=+3.233541827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wwq8k" (UniqueName: "kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k") pod "network-check-target-r54tb" (UID: "ec41ebc2-3ff6-4453-8eb4-c420b02516c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:43:41.073717 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.073692    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nrnx\" (UniqueName: \"kubernetes.io/projected/6af24624-056b-44b8-bef3-8a894bf0078b-kube-api-access-8nrnx\") pod \"iptables-alerter-z8qm8\" (UID: \"6af24624-056b-44b8-bef3-8a894bf0078b\") " pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:43:41.073803 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.073782    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq9cs\" (UniqueName: \"kubernetes.io/projected/976afac6-c62a-4e90-aaa1-5cc80852e988-kube-api-access-cq9cs\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:41.074050 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.074029    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s68fv\" (UniqueName: \"kubernetes.io/projected/877a7e09-3007-4c2a-97ef-690e99a27dc5-kube-api-access-s68fv\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.098447 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.098429    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zldds"
Oct 30 21:43:41.101716 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.101696    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:43:41.107347 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.107327    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:43:41.108309 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.108284    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:43:41.109678 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:41.109658    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a9a228b_279e_4895_972f_dbd2de5a9304.slice/crio-54618a48223180f91a3942925ae0c744fc44b0ed2b84822fe15e7056016196bc WatchSource:0}: Error finding container 54618a48223180f91a3942925ae0c744fc44b0ed2b84822fe15e7056016196bc: Status 404 returned error can't find the container with id 54618a48223180f91a3942925ae0c744fc44b0ed2b84822fe15e7056016196bc
Oct 30 21:43:41.112057 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:41.112037    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d58dca9_093d_416e_b353_9e9b792d6c23.slice/crio-108f8f98f88f9573dd71c80539ca3c275c5b0ddc0c6b150a40c7e0d092ffb173 WatchSource:0}: Error finding container 108f8f98f88f9573dd71c80539ca3c275c5b0ddc0c6b150a40c7e0d092ffb173: Status 404 returned error can't find the container with id 108f8f98f88f9573dd71c80539ca3c275c5b0ddc0c6b150a40c7e0d092ffb173
Oct 30 21:43:41.119567 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:41.119386    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ffd66e_ea60_4d77_820e_2a8740fe9dff.slice/crio-17ea496d2bef069555b5a45bce6d506e43f1e5bd63786d1810fe615d8e65c1f8 WatchSource:0}: Error finding container 17ea496d2bef069555b5a45bce6d506e43f1e5bd63786d1810fe615d8e65c1f8: Status 404 returned error can't find the container with id 17ea496d2bef069555b5a45bce6d506e43f1e5bd63786d1810fe615d8e65c1f8
Oct 30 21:43:41.122033 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:41.122010    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c4973c_9623_4cb4_a239_efdae2ff0b90.slice/crio-573e2380204b11176ea87e4994cbe3436664fed46aba7036ddf7ed01404b24cb WatchSource:0}: Error finding container 573e2380204b11176ea87e4994cbe3436664fed46aba7036ddf7ed01404b24cb: Status 404 returned error can't find the container with id 573e2380204b11176ea87e4994cbe3436664fed46aba7036ddf7ed01404b24cb
Oct 30 21:43:41.123999 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.123983    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:43:41.126309 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.126292    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:43:41.133456 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.133436    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:43:41.134042 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:41.134021    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod877a7e09_3007_4c2a_97ef_690e99a27dc5.slice/crio-01e7b48167f377e872b27397aa1019bc72598cea548a797b2ed0947d16180478 WatchSource:0}: Error finding container 01e7b48167f377e872b27397aa1019bc72598cea548a797b2ed0947d16180478: Status 404 returned error can't find the container with id 01e7b48167f377e872b27397aa1019bc72598cea548a797b2ed0947d16180478
Oct 30 21:43:41.135045 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.135024    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:43:41.136345 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:41.136329    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af24624_056b_44b8_bef3_8a894bf0078b.slice/crio-ab944082c2d29e0c693bd7f6c07e974045fe66eb23f6823933e80e3dc1f2f3b8 WatchSource:0}: Error finding container ab944082c2d29e0c693bd7f6c07e974045fe66eb23f6823933e80e3dc1f2f3b8: Status 404 returned error can't find the container with id ab944082c2d29e0c693bd7f6c07e974045fe66eb23f6823933e80e3dc1f2f3b8
Oct 30 21:43:41.141870 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.141850    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:43:41.143484 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:41.143462    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadd4a18a_fa1b_45c7_8719_2c88634c6488.slice/crio-96b35a47e253ba97607c370162084e2df6934f3deaabfc1051448ce70ec5346f WatchSource:0}: Error finding container 96b35a47e253ba97607c370162084e2df6934f3deaabfc1051448ce70ec5346f: Status 404 returned error can't find the container with id 96b35a47e253ba97607c370162084e2df6934f3deaabfc1051448ce70ec5346f
Oct 30 21:43:41.147334 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:41.147313    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df7f3e5_6d57_46f7_a23b_fd130d949fe2.slice/crio-74e6709ea0288c88f4d7cf3508517260c3e2cb1c5347f937f09e5969b84bd434 WatchSource:0}: Error finding container 74e6709ea0288c88f4d7cf3508517260c3e2cb1c5347f937f09e5969b84bd434: Status 404 returned error can't find the container with id 74e6709ea0288c88f4d7cf3508517260c3e2cb1c5347f937f09e5969b84bd434
Oct 30 21:43:41.151619 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:43:41.151600    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod976afac6_c62a_4e90_aaa1_5cc80852e988.slice/crio-e390bf6da2c4105107855636df5aee61ee7f4880bc0d35ab40e0ba6b6861a92b WatchSource:0}: Error finding container e390bf6da2c4105107855636df5aee61ee7f4880bc0d35ab40e0ba6b6861a92b: Status 404 returned error can't find the container with id e390bf6da2c4105107855636df5aee61ee7f4880bc0d35ab40e0ba6b6861a92b
Oct 30 21:43:41.409266 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.409161    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:41.409266 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.409243    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:41.409471 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:41.409359    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:43:41.409471 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:41.409420    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret podName:9b06a5cb-5c28-4146-bbea-bfbe2297136c nodeName:}" failed. No retries permitted until 2026-10-30 21:43:42.409396416 +0000 UTC m=+4.071214230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret") pod "global-pull-secret-syncer-8c64w" (UID: "9b06a5cb-5c28-4146-bbea-bfbe2297136c") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:43:41.409569 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:41.409481    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:43:41.409569 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:41.409519    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs podName:f1c0a201-8b48-44fb-b107-a5f2bb798235 nodeName:}" failed. No retries permitted until 2026-10-30 21:43:42.409507264 +0000 UTC m=+4.071325080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs") pod "network-metrics-daemon-jdg72" (UID: "f1c0a201-8b48-44fb-b107-a5f2bb798235") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:43:41.611355 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.611316    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwq8k\" (UniqueName: \"kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k\") pod \"network-check-target-r54tb\" (UID: \"ec41ebc2-3ff6-4453-8eb4-c420b02516c2\") " pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:41.611596 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:41.611491    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:43:41.611596 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:41.611510    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:43:41.611596 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:41.611523    2574 projected.go:196] Error preparing data for projected volume kube-api-access-wwq8k for pod openshift-network-diagnostics/network-check-target-r54tb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:43:41.611596 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:41.611568    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k podName:ec41ebc2-3ff6-4453-8eb4-c420b02516c2 nodeName:}" failed. No retries permitted until 2026-10-30 21:43:42.611555676 +0000 UTC m=+4.273373489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwq8k" (UniqueName: "kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k") pod "network-check-target-r54tb" (UID: "ec41ebc2-3ff6-4453-8eb4-c420b02516c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:43:41.767247 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.767057    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz" event={"ID":"add4a18a-fa1b-45c7-8719-2c88634c6488","Type":"ContainerStarted","Data":"96b35a47e253ba97607c370162084e2df6934f3deaabfc1051448ce70ec5346f"}
Oct 30 21:43:41.768339 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.768312    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ccgs8" event={"ID":"877a7e09-3007-4c2a-97ef-690e99a27dc5","Type":"ContainerStarted","Data":"01e7b48167f377e872b27397aa1019bc72598cea548a797b2ed0947d16180478"}
Oct 30 21:43:41.769706 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.769666    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zldds" event={"ID":"5a9a228b-279e-4895-972f-dbd2de5a9304","Type":"ContainerStarted","Data":"54618a48223180f91a3942925ae0c744fc44b0ed2b84822fe15e7056016196bc"}
Oct 30 21:43:41.770969 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.770939    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th" event={"ID":"976afac6-c62a-4e90-aaa1-5cc80852e988","Type":"ContainerStarted","Data":"e390bf6da2c4105107855636df5aee61ee7f4880bc0d35ab40e0ba6b6861a92b"}
Oct 30 21:43:41.772220 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.772193    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kfvjg" event={"ID":"0df7f3e5-6d57-46f7-a23b-fd130d949fe2","Type":"ContainerStarted","Data":"74e6709ea0288c88f4d7cf3508517260c3e2cb1c5347f937f09e5969b84bd434"}
Oct 30 21:43:41.773700 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.773661    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z8qm8" event={"ID":"6af24624-056b-44b8-bef3-8a894bf0078b","Type":"ContainerStarted","Data":"ab944082c2d29e0c693bd7f6c07e974045fe66eb23f6823933e80e3dc1f2f3b8"}
Oct 30 21:43:41.775479 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.775433    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j6x9n" event={"ID":"03c4973c-9623-4cb4-a239-efdae2ff0b90","Type":"ContainerStarted","Data":"573e2380204b11176ea87e4994cbe3436664fed46aba7036ddf7ed01404b24cb"}
Oct 30 21:43:41.778445 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.778420    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pjtvc" event={"ID":"c4ffd66e-ea60-4d77-820e-2a8740fe9dff","Type":"ContainerStarted","Data":"17ea496d2bef069555b5a45bce6d506e43f1e5bd63786d1810fe615d8e65c1f8"}
Oct 30 21:43:41.780853 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.780827    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zhhh4" event={"ID":"6d58dca9-093d-416e-b353-9e9b792d6c23","Type":"ContainerStarted","Data":"108f8f98f88f9573dd71c80539ca3c275c5b0ddc0c6b150a40c7e0d092ffb173"}
Oct 30 21:43:41.884211 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.884171    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:38:41 +0000 UTC" deadline="2028-07-16 21:52:08.05663852 +0000 UTC"
Oct 30 21:43:41.884211 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:41.884205    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15000h8m26.172438344s"
Oct 30 21:43:42.418558 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:42.418521    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:42.418787 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:42.418632    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:42.418912 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:42.418891    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:43:42.418996 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:42.418978    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs podName:f1c0a201-8b48-44fb-b107-a5f2bb798235 nodeName:}" failed. No retries permitted until 2026-10-30 21:43:44.418956751 +0000 UTC m=+6.080774580 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs") pod "network-metrics-daemon-jdg72" (UID: "f1c0a201-8b48-44fb-b107-a5f2bb798235") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:43:42.420582 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:42.420549    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:43:42.420681 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:42.420637    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret podName:9b06a5cb-5c28-4146-bbea-bfbe2297136c nodeName:}" failed. No retries permitted until 2026-10-30 21:43:44.420618654 +0000 UTC m=+6.082436484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret") pod "global-pull-secret-syncer-8c64w" (UID: "9b06a5cb-5c28-4146-bbea-bfbe2297136c") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:43:42.621462 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:42.621142    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwq8k\" (UniqueName: \"kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k\") pod \"network-check-target-r54tb\" (UID: \"ec41ebc2-3ff6-4453-8eb4-c420b02516c2\") " pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:42.621462 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:42.621322    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:43:42.621462 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:42.621348    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:43:42.621462 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:42.621362    2574 projected.go:196] Error preparing data for projected volume kube-api-access-wwq8k for pod openshift-network-diagnostics/network-check-target-r54tb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:43:42.621462 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:42.621431    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k podName:ec41ebc2-3ff6-4453-8eb4-c420b02516c2 nodeName:}" failed. No retries permitted until 2026-10-30 21:43:44.621411334 +0000 UTC m=+6.283229164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwq8k" (UniqueName: "kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k") pod "network-check-target-r54tb" (UID: "ec41ebc2-3ff6-4453-8eb4-c420b02516c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:43:42.760974 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:42.760899    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:42.761139 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:42.761051    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jdg72" podUID="f1c0a201-8b48-44fb-b107-a5f2bb798235"
Oct 30 21:43:42.761211 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:42.761145    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:42.761267 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:42.761217    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r54tb" podUID="ec41ebc2-3ff6-4453-8eb4-c420b02516c2"
Oct 30 21:43:42.761465 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:42.761441    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:42.761571 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:42.761540    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c64w" podUID="9b06a5cb-5c28-4146-bbea-bfbe2297136c"
Oct 30 21:43:42.885354 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:42.885286    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:38:41 +0000 UTC" deadline="2028-05-22 15:55:36.650298236 +0000 UTC"
Oct 30 21:43:42.885354 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:42.885351    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13674h11m53.764950946s"
Oct 30 21:43:43.815364 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:43.815268    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal" event={"ID":"7338dfe0a44a7307924a221163b5ea2d","Type":"ContainerStarted","Data":"e329ee3c4d0796cb3f62f421327a96b64f3259c5a59a2735ccfd865a86c0fa10"}
Oct 30 21:43:44.439441 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:44.438881    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:44.439441 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:44.438953    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:44.439441 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:44.439173    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:43:44.439441 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:44.439238    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs podName:f1c0a201-8b48-44fb-b107-a5f2bb798235 nodeName:}" failed. No retries permitted until 2026-10-30 21:43:48.439216146 +0000 UTC m=+10.101033978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs") pod "network-metrics-daemon-jdg72" (UID: "f1c0a201-8b48-44fb-b107-a5f2bb798235") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:43:44.439441 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:44.439311    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:43:44.439441 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:44.439365    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret podName:9b06a5cb-5c28-4146-bbea-bfbe2297136c nodeName:}" failed. No retries permitted until 2026-10-30 21:43:48.439351795 +0000 UTC m=+10.101169626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret") pod "global-pull-secret-syncer-8c64w" (UID: "9b06a5cb-5c28-4146-bbea-bfbe2297136c") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:43:44.641354 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:44.641008    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwq8k\" (UniqueName: \"kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k\") pod \"network-check-target-r54tb\" (UID: \"ec41ebc2-3ff6-4453-8eb4-c420b02516c2\") " pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:44.641354 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:44.641176    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:43:44.641354 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:44.641196    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:43:44.641354 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:44.641208    2574 projected.go:196] Error preparing data for projected volume kube-api-access-wwq8k for pod openshift-network-diagnostics/network-check-target-r54tb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:43:44.641354 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:44.641264    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k podName:ec41ebc2-3ff6-4453-8eb4-c420b02516c2 nodeName:}" failed. No retries permitted until 2026-10-30 21:43:48.641243567 +0000 UTC m=+10.303061387 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwq8k" (UniqueName: "kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k") pod "network-check-target-r54tb" (UID: "ec41ebc2-3ff6-4453-8eb4-c420b02516c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:43:44.760270 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:44.759839    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:44.760270 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:44.759971    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c64w" podUID="9b06a5cb-5c28-4146-bbea-bfbe2297136c"
Oct 30 21:43:44.760270 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:44.760023    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:44.760270 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:44.760089    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r54tb" podUID="ec41ebc2-3ff6-4453-8eb4-c420b02516c2"
Oct 30 21:43:44.760270 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:44.760129    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:44.760270 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:44.760206    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jdg72" podUID="f1c0a201-8b48-44fb-b107-a5f2bb798235"
Oct 30 21:43:44.834831 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:44.834655    2574 generic.go:356] "Generic (PLEG): container finished" podID="c4ffd66e-ea60-4d77-820e-2a8740fe9dff" containerID="8c834e5344095910a1fd124536b7d9a1e3931ce9515a1f892ecbeb537b1de09a" exitCode=0
Oct 30 21:43:44.836154 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:44.834745    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pjtvc" event={"ID":"c4ffd66e-ea60-4d77-820e-2a8740fe9dff","Type":"ContainerDied","Data":"8c834e5344095910a1fd124536b7d9a1e3931ce9515a1f892ecbeb537b1de09a"}
Oct 30 21:43:44.843659 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:44.842667    2574 generic.go:356] "Generic (PLEG): container finished" podID="0e4bbb2b70f21f2ae358c77963ab899a" containerID="4f1501ded0a82f1993bf67c8c4b1ee604ea3c38a7e8e119b39b2b30676d0b898" exitCode=0
Oct 30 21:43:44.843659 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:44.843593    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal" event={"ID":"0e4bbb2b70f21f2ae358c77963ab899a","Type":"ContainerDied","Data":"4f1501ded0a82f1993bf67c8c4b1ee604ea3c38a7e8e119b39b2b30676d0b898"}
Oct 30 21:43:44.970698 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:44.970600    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal" podStartSLOduration=4.970580517 podStartE2EDuration="4.970580517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:43.940937835 +0000 UTC m=+5.602755675" watchObservedRunningTime="2026-10-30 21:43:44.970580517 +0000 UTC m=+6.632398355"
Oct 30 21:43:45.850589 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:45.849791    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal" event={"ID":"0e4bbb2b70f21f2ae358c77963ab899a","Type":"ContainerStarted","Data":"c1081ed5de167db35e34f4c917ec88c614c15cfb2dec0c11c28552691adbe679"}
Oct 30 21:43:46.759893 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:46.759424    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:46.759893 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:46.759472    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:46.759893 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:46.759617    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r54tb" podUID="ec41ebc2-3ff6-4453-8eb4-c420b02516c2"
Oct 30 21:43:46.759893 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:46.759664    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:46.759893 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:46.759778    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jdg72" podUID="f1c0a201-8b48-44fb-b107-a5f2bb798235"
Oct 30 21:43:46.759893 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:46.759858    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c64w" podUID="9b06a5cb-5c28-4146-bbea-bfbe2297136c"
Oct 30 21:43:46.866904 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:46.866864    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kfvjg" event={"ID":"0df7f3e5-6d57-46f7-a23b-fd130d949fe2","Type":"ContainerStarted","Data":"80d17d52b8757457609a5a70c41e370447cd87c260aa36f7f207995c593eb9a8"}
Oct 30 21:43:46.992797 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:46.992420    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal" podStartSLOduration=6.992399522 podStartE2EDuration="6.992399522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:45.975216279 +0000 UTC m=+7.637034117" watchObservedRunningTime="2026-10-30 21:43:46.992399522 +0000 UTC m=+8.654217363"
Oct 30 21:43:47.367887 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:47.367663    2574 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:43:47.368532 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:47.368509    2574 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:43:47.494884 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:47.494393    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kfvjg" podStartSLOduration=2.90111885 podStartE2EDuration="7.494373933s" totalImagesPullingTime="4.593255083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:46.993187529 +0000 UTC m=+8.655005371" watchObservedRunningTime="2026-10-30 21:43:47.494373933 +0000 UTC m=+9.156191771"
Oct 30 21:43:47.877404 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:47.877152    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j6x9n" event={"ID":"03c4973c-9623-4cb4-a239-efdae2ff0b90","Type":"ContainerStarted","Data":"6baaf6e57ccdb6b24dba9006de6b8578b3b73790fd037f44cf0f04ad6cc36372"}
Oct 30 21:43:48.002569 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:48.002514    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j6x9n" podStartSLOduration=2.071114854 podStartE2EDuration="8.002495127s" totalImagesPullingTime="5.931380273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:48.002146877 +0000 UTC m=+9.663964715" watchObservedRunningTime="2026-10-30 21:43:48.002495127 +0000 UTC m=+9.664312966"
Oct 30 21:43:48.477240 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:48.476946    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:48.477403 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:48.477248    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:48.485893 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:48.485316    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:43:48.485893 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:48.485399    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret podName:9b06a5cb-5c28-4146-bbea-bfbe2297136c nodeName:}" failed. No retries permitted until 2026-10-30 21:43:56.485376598 +0000 UTC m=+18.147194412 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret") pod "global-pull-secret-syncer-8c64w" (UID: "9b06a5cb-5c28-4146-bbea-bfbe2297136c") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:43:48.486137 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:48.486054    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:43:48.486137 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:48.486117    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs podName:f1c0a201-8b48-44fb-b107-a5f2bb798235 nodeName:}" failed. No retries permitted until 2026-10-30 21:43:56.486099111 +0000 UTC m=+18.147916948 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs") pod "network-metrics-daemon-jdg72" (UID: "f1c0a201-8b48-44fb-b107-a5f2bb798235") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:43:48.679769 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:48.679730    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwq8k\" (UniqueName: \"kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k\") pod \"network-check-target-r54tb\" (UID: \"ec41ebc2-3ff6-4453-8eb4-c420b02516c2\") " pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:48.679954 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:48.679898    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:43:48.679954 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:48.679918    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:43:48.679954 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:48.679931    2574 projected.go:196] Error preparing data for projected volume kube-api-access-wwq8k for pod openshift-network-diagnostics/network-check-target-r54tb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:43:48.680130 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:48.679988    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k podName:ec41ebc2-3ff6-4453-8eb4-c420b02516c2 nodeName:}" failed. No retries permitted until 2026-10-30 21:43:56.67996982 +0000 UTC m=+18.341787639 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwq8k" (UniqueName: "kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k") pod "network-check-target-r54tb" (UID: "ec41ebc2-3ff6-4453-8eb4-c420b02516c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:43:48.761891 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:48.761109    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:48.761891 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:48.761224    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c64w" podUID="9b06a5cb-5c28-4146-bbea-bfbe2297136c"
Oct 30 21:43:48.761891 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:48.761650    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:48.761891 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:48.761782    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jdg72" podUID="f1c0a201-8b48-44fb-b107-a5f2bb798235"
Oct 30 21:43:48.762208 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:48.761998    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:48.762208 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:48.762101    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r54tb" podUID="ec41ebc2-3ff6-4453-8eb4-c420b02516c2"
Oct 30 21:43:48.884042 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:48.883999    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th" event={"ID":"976afac6-c62a-4e90-aaa1-5cc80852e988","Type":"ContainerStarted","Data":"1768971e9423cfa37d6722a04230daa8e85e95d489b57560b688eeea07680483"}
Oct 30 21:43:48.884556 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:48.884098    2574 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:43:50.328493 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:50.328475    2574 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 21:43:50.759012 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:50.758939    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:50.759012 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:50.758988    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:50.759199 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:50.759021    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:50.759199 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:50.759113    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r54tb" podUID="ec41ebc2-3ff6-4453-8eb4-c420b02516c2"
Oct 30 21:43:50.759199 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:50.759162    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c64w" podUID="9b06a5cb-5c28-4146-bbea-bfbe2297136c"
Oct 30 21:43:50.759400 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:50.759240    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jdg72" podUID="f1c0a201-8b48-44fb-b107-a5f2bb798235"
Oct 30 21:43:50.764212 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:50.764132    2574 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:43:50.328491992Z","UUID":"280abcee-93de-4fcd-a7ad-eb06e69bad42","Handler":null,"Name":"","Endpoint":""}
Oct 30 21:43:50.766081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:50.766061    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 21:43:50.766081 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:50.766085    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 21:43:50.889154 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:50.889124    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zldds" event={"ID":"5a9a228b-279e-4895-972f-dbd2de5a9304","Type":"ContainerStarted","Data":"cec43d31cae83198142d555a75019f74c1fde8c48910081e2023878f4bceb667"}
Oct 30 21:43:50.891222 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:50.891196    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th" event={"ID":"976afac6-c62a-4e90-aaa1-5cc80852e988","Type":"ContainerStarted","Data":"67e666df3f4cf93385db03005d73ebef987acc54cc57bdf99316c3500639945e"}
Oct 30 21:43:50.893082 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:50.893058    2574 generic.go:356] "Generic (PLEG): container finished" podID="c4ffd66e-ea60-4d77-820e-2a8740fe9dff" containerID="729399371d922e95a5442922315ad7c46a0d32be7a69e56d9890543f77990b36" exitCode=0
Oct 30 21:43:50.893199 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:50.893182    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pjtvc" event={"ID":"c4ffd66e-ea60-4d77-820e-2a8740fe9dff","Type":"ContainerDied","Data":"729399371d922e95a5442922315ad7c46a0d32be7a69e56d9890543f77990b36"}
Oct 30 21:43:50.894771 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:50.894746    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zhhh4" event={"ID":"6d58dca9-093d-416e-b353-9e9b792d6c23","Type":"ContainerStarted","Data":"c09368a00f055a2061c415eefb553229ccab5f4cbc369dac7a3606376540697f"}
Oct 30 21:43:51.007366 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:51.007322    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-zldds" podStartSLOduration=3.265544032 podStartE2EDuration="12.007309967s" totalImagesPullingTime="8.741765935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:51.006396745 +0000 UTC m=+12.668214581" watchObservedRunningTime="2026-10-30 21:43:51.007309967 +0000 UTC m=+12.669127800"
Oct 30 21:43:51.900892 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:51.900817    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z8qm8" event={"ID":"6af24624-056b-44b8-bef3-8a894bf0078b","Type":"ContainerStarted","Data":"1bdffd0af6e0d9dfc55359e8878067903078a21b72848cfb6b07d44e2739be1a"}
Oct 30 21:43:52.014811 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:52.014761    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-zhhh4" podStartSLOduration=3.861896034 podStartE2EDuration="13.01474513s" totalImagesPullingTime="9.152849096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:51.241723204 +0000 UTC m=+12.903541036" watchObservedRunningTime="2026-10-30 21:43:52.01474513 +0000 UTC m=+13.676562972"
Oct 30 21:43:52.014953 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:52.014889    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z8qm8" podStartSLOduration=3.103402574 podStartE2EDuration="12.014883072s" totalImagesPullingTime="8.911480498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:52.014048469 +0000 UTC m=+13.675866303" watchObservedRunningTime="2026-10-30 21:43:52.014883072 +0000 UTC m=+13.676700907"
Oct 30 21:43:52.759017 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:52.758807    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:52.759142 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:52.758853    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:52.759142 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:52.759114    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r54tb" podUID="ec41ebc2-3ff6-4453-8eb4-c420b02516c2"
Oct 30 21:43:52.759249 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:52.759171    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c64w" podUID="9b06a5cb-5c28-4146-bbea-bfbe2297136c"
Oct 30 21:43:52.759249 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:52.758885    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:52.759329 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:52.759263    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jdg72" podUID="f1c0a201-8b48-44fb-b107-a5f2bb798235"
Oct 30 21:43:52.903199 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:52.903171    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th" event={"ID":"976afac6-c62a-4e90-aaa1-5cc80852e988","Type":"ContainerStarted","Data":"6a0e734c54941636370139bb9260d02083f7adbc3c32b52c31bde724c616f1ce"}
Oct 30 21:43:52.905291 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:52.905268    2574 generic.go:356] "Generic (PLEG): container finished" podID="c4ffd66e-ea60-4d77-820e-2a8740fe9dff" containerID="92b81534cec45c9e7745581b6c23179ab4b6e72a86ceb197af39a5376b0a8b2f" exitCode=0
Oct 30 21:43:52.905849 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:52.905793    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pjtvc" event={"ID":"c4ffd66e-ea60-4d77-820e-2a8740fe9dff","Type":"ContainerDied","Data":"92b81534cec45c9e7745581b6c23179ab4b6e72a86ceb197af39a5376b0a8b2f"}
Oct 30 21:43:52.910086 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:52.909998    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ccgs8" event={"ID":"877a7e09-3007-4c2a-97ef-690e99a27dc5","Type":"ContainerStarted","Data":"0b907ab95a89c56a3e5a5ccc371dd1b27e50b65876fdd1838f6109eb5a89336b"}
Oct 30 21:43:53.020309 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:53.020266    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th" podStartSLOduration=2.033436476 podStartE2EDuration="13.020254442s" totalImagesPullingTime="10.986817966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:53.019928624 +0000 UTC m=+14.681746458" watchObservedRunningTime="2026-10-30 21:43:53.020254442 +0000 UTC m=+14.682072273"
Oct 30 21:43:53.136026 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:53.135984    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ccgs8" podStartSLOduration=1.749881335 podStartE2EDuration="13.135972764s" totalImagesPullingTime="11.386091429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:53.135744213 +0000 UTC m=+14.797562044" watchObservedRunningTime="2026-10-30 21:43:53.135972764 +0000 UTC m=+14.797790598"
Oct 30 21:43:54.758961 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:54.758933    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:54.759413 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:54.758994    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:54.759413 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:54.759002    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:54.759413 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:54.759096    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r54tb" podUID="ec41ebc2-3ff6-4453-8eb4-c420b02516c2"
Oct 30 21:43:54.759413 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:54.759182    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c64w" podUID="9b06a5cb-5c28-4146-bbea-bfbe2297136c"
Oct 30 21:43:54.759413 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:54.759285    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jdg72" podUID="f1c0a201-8b48-44fb-b107-a5f2bb798235"
Oct 30 21:43:54.886113 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:54.886085    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:43:54.886273 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:54.886220    2574 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:43:54.886699 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:54.886654    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:43:54.916961 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:54.916934    2574 generic.go:356] "Generic (PLEG): container finished" podID="c4ffd66e-ea60-4d77-820e-2a8740fe9dff" containerID="f6b25e889c83c56cc2aeb064230739756aa4ddf3cc857e88db2e55a334ee681c" exitCode=0
Oct 30 21:43:54.917067 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:54.917019    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pjtvc" event={"ID":"c4ffd66e-ea60-4d77-820e-2a8740fe9dff","Type":"ContainerDied","Data":"f6b25e889c83c56cc2aeb064230739756aa4ddf3cc857e88db2e55a334ee681c"}
Oct 30 21:43:56.544018 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:56.543974    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:56.544499 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:56.544043    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:56.544499 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:56.544128    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:43:56.544499 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:56.544128    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:43:56.544499 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:56.544186    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs podName:f1c0a201-8b48-44fb-b107-a5f2bb798235 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:12.544168789 +0000 UTC m=+34.205986615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs") pod "network-metrics-daemon-jdg72" (UID: "f1c0a201-8b48-44fb-b107-a5f2bb798235") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:43:56.544499 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:56.544203    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret podName:9b06a5cb-5c28-4146-bbea-bfbe2297136c nodeName:}" failed. No retries permitted until 2026-10-30 21:44:12.544193848 +0000 UTC m=+34.206011664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret") pod "global-pull-secret-syncer-8c64w" (UID: "9b06a5cb-5c28-4146-bbea-bfbe2297136c") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:43:56.745577 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:56.745545    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwq8k\" (UniqueName: \"kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k\") pod \"network-check-target-r54tb\" (UID: \"ec41ebc2-3ff6-4453-8eb4-c420b02516c2\") " pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:56.745769 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:56.745718    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:43:56.745769 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:56.745737    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:43:56.745769 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:56.745749    2574 projected.go:196] Error preparing data for projected volume kube-api-access-wwq8k for pod openshift-network-diagnostics/network-check-target-r54tb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:43:56.745873 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:56.745803    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k podName:ec41ebc2-3ff6-4453-8eb4-c420b02516c2 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:12.745786829 +0000 UTC m=+34.407604648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wwq8k" (UniqueName: "kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k") pod "network-check-target-r54tb" (UID: "ec41ebc2-3ff6-4453-8eb4-c420b02516c2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:43:56.759811 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:56.759783    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:56.759972 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:56.759895    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c64w" podUID="9b06a5cb-5c28-4146-bbea-bfbe2297136c"
Oct 30 21:43:56.759972 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:56.759970    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:56.760054 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:56.760029    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jdg72" podUID="f1c0a201-8b48-44fb-b107-a5f2bb798235"
Oct 30 21:43:56.760106 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:56.760075    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:56.760151 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:56.760120    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r54tb" podUID="ec41ebc2-3ff6-4453-8eb4-c420b02516c2"
Oct 30 21:43:57.924616 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:57.924583    2574 generic.go:356] "Generic (PLEG): container finished" podID="c4ffd66e-ea60-4d77-820e-2a8740fe9dff" containerID="734de77c9c45de536aad7d8c905028480c5ef41f9935037cb2f9f0647ea8396d" exitCode=0
Oct 30 21:43:57.924967 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:57.924628    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pjtvc" event={"ID":"c4ffd66e-ea60-4d77-820e-2a8740fe9dff","Type":"ContainerDied","Data":"734de77c9c45de536aad7d8c905028480c5ef41f9935037cb2f9f0647ea8396d"}
Oct 30 21:43:58.759140 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:58.758899    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:43:58.759277 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:58.759000    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:43:58.759277 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:58.759159    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c64w" podUID="9b06a5cb-5c28-4146-bbea-bfbe2297136c"
Oct 30 21:43:58.759277 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:58.759074    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:43:58.759432 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:58.759271    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jdg72" podUID="f1c0a201-8b48-44fb-b107-a5f2bb798235"
Oct 30 21:43:58.759432 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:43:58.759373    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r54tb" podUID="ec41ebc2-3ff6-4453-8eb4-c420b02516c2"
Oct 30 21:43:58.929801 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:58.929771    2574 generic.go:356] "Generic (PLEG): container finished" podID="c4ffd66e-ea60-4d77-820e-2a8740fe9dff" containerID="8d3e8c5003c64e6dfe50b3dd2c0db3007546f0fbaebc640cfbf0d64bfc8ad52c" exitCode=0
Oct 30 21:43:58.930524 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:58.929860    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pjtvc" event={"ID":"c4ffd66e-ea60-4d77-820e-2a8740fe9dff","Type":"ContainerDied","Data":"8d3e8c5003c64e6dfe50b3dd2c0db3007546f0fbaebc640cfbf0d64bfc8ad52c"}
Oct 30 21:43:58.932980 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:58.932957    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz" event={"ID":"add4a18a-fa1b-45c7-8719-2c88634c6488","Type":"ContainerStarted","Data":"89768ee51fc9e4eba147d0dabf66bcaab3a96101b70cd2f12adb444cd089871d"}
Oct 30 21:43:58.933090 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:58.933029    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz" event={"ID":"add4a18a-fa1b-45c7-8719-2c88634c6488","Type":"ContainerStarted","Data":"5f1478c407d27c39b10e75de0274e752cb947e54bb92994eea2830aa5d039c75"}
Oct 30 21:43:58.933090 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:58.933077    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz" event={"ID":"add4a18a-fa1b-45c7-8719-2c88634c6488","Type":"ContainerStarted","Data":"4f5925d28f827a6341a7b7664a27fe8136c69399a434482e17590912d744d018"}
Oct 30 21:43:58.933212 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:58.933121    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz" event={"ID":"add4a18a-fa1b-45c7-8719-2c88634c6488","Type":"ContainerStarted","Data":"75e958f424ebd120a91ee4607efb8dad1d86e115f449e0931eaa199864381cf9"}
Oct 30 21:43:58.933212 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:58.933168    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz" event={"ID":"add4a18a-fa1b-45c7-8719-2c88634c6488","Type":"ContainerStarted","Data":"a6c0a77fcefc155faf27a372e733a3c5ddc9636d2cd9f407873dc9e46e7dfad0"}
Oct 30 21:43:58.933298 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:58.933217    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz" event={"ID":"add4a18a-fa1b-45c7-8719-2c88634c6488","Type":"ContainerStarted","Data":"aca49b6c5342f109aae9de3f29bafd144d3db4f2e0c31dd29906844d05b1c158"}
Oct 30 21:43:59.938496 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:43:59.938467    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pjtvc" event={"ID":"c4ffd66e-ea60-4d77-820e-2a8740fe9dff","Type":"ContainerStarted","Data":"6019c65ea2a4cbd0e8f03a388620ce1c1bd8f0340b283fc11781886b974a2c3f"}
Oct 30 21:44:00.063535 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:00.063486    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pjtvc" podStartSLOduration=7.035226102 podStartE2EDuration="21.063474422s" totalImagesPullingTime="14.02824832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:00.063006818 +0000 UTC m=+21.724824651" watchObservedRunningTime="2026-10-30 21:44:00.063474422 +0000 UTC m=+21.725292255"
Oct 30 21:44:00.758614 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:00.758581    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:00.758779 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:00.758638    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:00.758779 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:00.758650    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:44:00.758849 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:00.758776    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r54tb" podUID="ec41ebc2-3ff6-4453-8eb4-c420b02516c2"
Oct 30 21:44:00.758849 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:00.758812    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c64w" podUID="9b06a5cb-5c28-4146-bbea-bfbe2297136c"
Oct 30 21:44:00.758934 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:00.758880    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jdg72" podUID="f1c0a201-8b48-44fb-b107-a5f2bb798235"
Oct 30 21:44:00.944165 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:00.944132    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz" event={"ID":"add4a18a-fa1b-45c7-8719-2c88634c6488","Type":"ContainerStarted","Data":"741f1343465c64be9dbbcc5bac2590d0869db138147c7035384e4bfbedc694f7"}
Oct 30 21:44:02.758556 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:02.758526    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:02.758998 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:02.758527    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:02.758998 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:02.758672    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jdg72" podUID="f1c0a201-8b48-44fb-b107-a5f2bb798235"
Oct 30 21:44:02.758998 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:02.758702    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:44:02.758998 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:02.758800    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c64w" podUID="9b06a5cb-5c28-4146-bbea-bfbe2297136c"
Oct 30 21:44:02.758998 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:02.758905    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r54tb" podUID="ec41ebc2-3ff6-4453-8eb4-c420b02516c2"
Oct 30 21:44:02.953869 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:02.953528    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz" event={"ID":"add4a18a-fa1b-45c7-8719-2c88634c6488","Type":"ContainerStarted","Data":"73c6b956ca4836585961af63846714006df3b57a7d091d0df28cab63cb1d2436"}
Oct 30 21:44:02.953869 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:02.953849    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:02.954077 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:02.953913    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:02.954077 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:02.953960    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:02.970203 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:02.970178    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:02.970348 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:02.970302    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:03.232307 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:03.232213    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz" podStartSLOduration=6.140327412 podStartE2EDuration="23.232199211s" totalImagesPullingTime="17.091871799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:03.182361127 +0000 UTC m=+24.844178971" watchObservedRunningTime="2026-10-30 21:44:03.232199211 +0000 UTC m=+24.894017045"
Oct 30 21:44:04.759098 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:04.759067    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:04.759098 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:04.759087    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:04.759525 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:04.759130    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:44:04.759525 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:04.759214    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r54tb" podUID="ec41ebc2-3ff6-4453-8eb4-c420b02516c2"
Oct 30 21:44:04.759525 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:04.759323    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c64w" podUID="9b06a5cb-5c28-4146-bbea-bfbe2297136c"
Oct 30 21:44:04.759525 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:04.759411    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jdg72" podUID="f1c0a201-8b48-44fb-b107-a5f2bb798235"
Oct 30 21:44:05.349071 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:05.349026    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jdg72"]
Oct 30 21:44:05.349230 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:05.349149    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:05.349284 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:05.349257    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jdg72" podUID="f1c0a201-8b48-44fb-b107-a5f2bb798235"
Oct 30 21:44:05.352041 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:05.352018    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r54tb"]
Oct 30 21:44:05.352165 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:05.352096    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:44:05.352216 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:05.352189    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r54tb" podUID="ec41ebc2-3ff6-4453-8eb4-c420b02516c2"
Oct 30 21:44:05.352802 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:05.352784    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8c64w"]
Oct 30 21:44:05.352881 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:05.352868    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:05.352987 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:05.352963    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c64w" podUID="9b06a5cb-5c28-4146-bbea-bfbe2297136c"
Oct 30 21:44:06.762352 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:06.762324    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:06.762352 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:06.762350    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:06.762757 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:06.762350    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:44:06.762757 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:06.762454    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c64w" podUID="9b06a5cb-5c28-4146-bbea-bfbe2297136c"
Oct 30 21:44:06.762757 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:06.762542    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jdg72" podUID="f1c0a201-8b48-44fb-b107-a5f2bb798235"
Oct 30 21:44:06.762757 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:06.762627    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r54tb" podUID="ec41ebc2-3ff6-4453-8eb4-c420b02516c2"
Oct 30 21:44:08.762450 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:08.762415    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:08.762450 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:08.762433    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:44:08.763069 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:08.762460    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:08.763069 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:08.762555    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jdg72" podUID="f1c0a201-8b48-44fb-b107-a5f2bb798235"
Oct 30 21:44:08.763069 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:08.762627    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r54tb" podUID="ec41ebc2-3ff6-4453-8eb4-c420b02516c2"
Oct 30 21:44:08.763069 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:08.762732    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8c64w" podUID="9b06a5cb-5c28-4146-bbea-bfbe2297136c"
Oct 30 21:44:10.597544 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.597518    2574 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeReady"
Oct 30 21:44:10.597907 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.597653    2574 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 21:44:10.716659 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.716623    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sdtr4"]
Oct 30 21:44:10.755459 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.755422    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-t9r98"]
Oct 30 21:44:10.755611 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.755545    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-sdtr4"
Oct 30 21:44:10.774482 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.774445    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-t9r98"
Oct 30 21:44:10.774482 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.774446    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:44:10.774672 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.774524    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:10.774672 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.774561    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:10.778283 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.778256    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-chqp7"]
Oct 30 21:44:10.797366 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.797330    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7zlst"]
Oct 30 21:44:10.798524 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.798505    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-chqp7"
Oct 30 21:44:10.809181 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.809160    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4hw29"]
Oct 30 21:44:10.809318 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.809301    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7zlst"
Oct 30 21:44:10.812208 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.812188    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 21:44:10.813392 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.813372    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 21:44:10.821715 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.821661    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-775f87bbf6-82p7v"]
Oct 30 21:44:10.821891 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.821858    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:10.827216 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.827194    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6d865d79dc-z4f64"]
Oct 30 21:44:10.827407 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.827343    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-ph4bx\""
Oct 30 21:44:10.827510 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.827425    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:44:10.827625 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.827605    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:10.827754 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.827737    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:44:10.827823 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.827769    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j2rr9\""
Oct 30 21:44:10.830791 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.830773    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"]
Oct 30 21:44:10.830891 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.830878    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:10.849837 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.849816    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnmdv\" (UniqueName: \"kubernetes.io/projected/e2357ae3-0e6b-427c-84f5-fda3350920c4-kube-api-access-rnmdv\") pod \"kas-connection-checker-685895c7c9-sdtr4\" (UID: \"e2357ae3-0e6b-427c-84f5-fda3350920c4\") " pod="kube-system/kas-connection-checker-685895c7c9-sdtr4"
Oct 30 21:44:10.849909 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.849844    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xblpt\" (UniqueName: \"kubernetes.io/projected/aab14d71-ddf4-41c6-80a8-70b258aee1d4-kube-api-access-xblpt\") pod \"kas-connection-checker-685895c7c9-t9r98\" (UID: \"aab14d71-ddf4-41c6-80a8-70b258aee1d4\") " pod="kube-system/kas-connection-checker-685895c7c9-t9r98"
Oct 30 21:44:10.859945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.859921    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"]
Oct 30 21:44:10.860026 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.860014    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:10.877284 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.877257    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-vbwwf"]
Oct 30 21:44:10.877371 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.877356    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:10.879189 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.879172    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8d78449d9-mmjp2"]
Oct 30 21:44:10.879341 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.879290    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:10.882296 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.882282    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"]
Oct 30 21:44:10.882410 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.882397    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:10.885060 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.885045    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"]
Oct 30 21:44:10.885160 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.885146    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:10.887822 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.887804    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-8hc58"]
Oct 30 21:44:10.887944 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.887931    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:10.890223 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.890198    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"]
Oct 30 21:44:10.890379 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.890362    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:10.892963 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.892947    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-ghx6v"]
Oct 30 21:44:10.893075 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.893059    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:10.896507 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.896489    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tnx6d"]
Oct 30 21:44:10.896606 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.896596    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-ghx6v"
Oct 30 21:44:10.899550 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899534    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sdtr4"]
Oct 30 21:44:10.899656 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899586    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-t9r98"]
Oct 30 21:44:10.899656 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899615    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7zlst"]
Oct 30 21:44:10.899656 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899639    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4hw29"]
Oct 30 21:44:10.899840 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899671    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d865d79dc-z4f64"]
Oct 30 21:44:10.899840 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899639    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tnx6d"
Oct 30 21:44:10.899840 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899714    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-775f87bbf6-82p7v"]
Oct 30 21:44:10.899840 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899734    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"]
Oct 30 21:44:10.899840 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899754    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"]
Oct 30 21:44:10.899840 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899780    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-vbwwf"]
Oct 30 21:44:10.899840 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899800    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"]
Oct 30 21:44:10.900106 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899865    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"]
Oct 30 21:44:10.900106 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899888    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8d78449d9-mmjp2"]
Oct 30 21:44:10.900106 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899908    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-chqp7"]
Oct 30 21:44:10.900106 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899937    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-ghx6v"]
Oct 30 21:44:10.900106 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899957    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tnx6d"]
Oct 30 21:44:10.900106 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899976    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-8hc58"]
Oct 30 21:44:10.900106 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.899996    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"]
Oct 30 21:44:10.909008 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.908989    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 21:44:10.909108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.909021    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:44:10.909108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.909033    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 21:44:10.909108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.909060    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 21:44:10.909108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.909090    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 21:44:10.909305 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.909123    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 21:44:10.909305 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.909142    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 21:44:10.909305 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.909146    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 21:44:10.910226 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.910207    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 21:44:10.911912 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.911898    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 21:44:10.927695 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.927660    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 21:44:10.927808 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.927793    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 21:44:10.927881 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.927832    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 21:44:10.927881 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.927842    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 21:44:10.927881 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.927860    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 21:44:10.928034 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.927894    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 21:44:10.928088 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.928058    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-6ptf6\""
Oct 30 21:44:10.928157 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.928136    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qjn2k\""
Oct 30 21:44:10.928309 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.928296    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-4f9tw\""
Oct 30 21:44:10.928363 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.928307    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 21:44:10.928363 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.928325    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 21:44:10.951031 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951008    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:10.951124 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951034    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:10.951124 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951052    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-certificates\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:10.951124 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951077    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnmdv\" (UniqueName: \"kubernetes.io/projected/e2357ae3-0e6b-427c-84f5-fda3350920c4-kube-api-access-rnmdv\") pod \"kas-connection-checker-685895c7c9-sdtr4\" (UID: \"e2357ae3-0e6b-427c-84f5-fda3350920c4\") " pod="kube-system/kas-connection-checker-685895c7c9-sdtr4"
Oct 30 21:44:10.951124 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951096    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xblpt\" (UniqueName: \"kubernetes.io/projected/aab14d71-ddf4-41c6-80a8-70b258aee1d4-kube-api-access-xblpt\") pod \"kas-connection-checker-685895c7c9-t9r98\" (UID: \"aab14d71-ddf4-41c6-80a8-70b258aee1d4\") " pod="kube-system/kas-connection-checker-685895c7c9-t9r98"
Oct 30 21:44:10.951301 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951162    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a447a17d-b65e-40a2-b200-635ee45355ba-config-volume\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:10.951301 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951218    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a447a17d-b65e-40a2-b200-635ee45355ba-tmp-dir\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:10.951301 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951260    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-bound-sa-token\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:10.951424 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951323    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:10.951424 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951347    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:10.951424 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951362    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-trusted-ca\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:10.951424 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951379    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pspz2\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-kube-api-access-pspz2\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:10.951584 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951566    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7nrc\" (UniqueName: \"kubernetes.io/projected/a447a17d-b65e-40a2-b200-635ee45355ba-kube-api-access-k7nrc\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:10.951638 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951593    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-default-certificate\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:10.951710 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951651    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh2dx\" (UniqueName: \"kubernetes.io/projected/a4e14574-aa2d-4fc4-ba26-a07f4a669296-kube-api-access-dh2dx\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:10.951769 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951715    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-installation-pull-secrets\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:10.951811 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951763    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-stats-auth\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:10.951843 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951818    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-image-registry-private-configuration\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:10.951877 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951843    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:10.951877 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951860    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bwj9\" (UniqueName: \"kubernetes.io/projected/f3017ee4-5edc-43b8-ad16-107517393622-kube-api-access-6bwj9\") pod \"volume-data-source-validator-58c9f5f46d-7zlst\" (UID: \"f3017ee4-5edc-43b8-ad16-107517393622\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7zlst"
Oct 30 21:44:10.951934 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951886    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:10.951934 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951911    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f695b\" (UniqueName: \"kubernetes.io/projected/7e81cfe7-52d2-474c-8261-66ce6cf58945-kube-api-access-f695b\") pod \"kas-connection-checker-685895c7c9-chqp7\" (UID: \"7e81cfe7-52d2-474c-8261-66ce6cf58945\") " pod="kube-system/kas-connection-checker-685895c7c9-chqp7"
Oct 30 21:44:10.951992 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:10.951941    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/186ffaf9-fc18-4605-9c8c-c9c31bda5379-ca-trust-extracted\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.008964 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.008934    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 21:44:11.008964 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.008950    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 21:44:11.009171 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009004    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 21:44:11.009171 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009038    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 21:44:11.009273 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009180    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:44:11.009273 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009221    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 21:44:11.009273 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009264    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:44:11.009421 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009264    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 21:44:11.009421 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009290    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:44:11.009421 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009347    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:44:11.009421 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009382    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 21:44:11.009421 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009415    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 21:44:11.009626 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009432    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 21:44:11.009626 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009478    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 21:44:11.009626 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009492    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 21:44:11.009626 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009564    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 21:44:11.009626 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009594    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 21:44:11.009626 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009601    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:44:11.009857 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.009635    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:44:11.010442 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.010417    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 21:44:11.011127 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.011109    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 21:44:11.011234 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.011187    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 21:44:11.014071 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.014048    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnmdv\" (UniqueName: \"kubernetes.io/projected/e2357ae3-0e6b-427c-84f5-fda3350920c4-kube-api-access-rnmdv\") pod \"kas-connection-checker-685895c7c9-sdtr4\" (UID: \"e2357ae3-0e6b-427c-84f5-fda3350920c4\") " pod="kube-system/kas-connection-checker-685895c7c9-sdtr4"
Oct 30 21:44:11.014147 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.014080    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xblpt\" (UniqueName: \"kubernetes.io/projected/aab14d71-ddf4-41c6-80a8-70b258aee1d4-kube-api-access-xblpt\") pod \"kas-connection-checker-685895c7c9-t9r98\" (UID: \"aab14d71-ddf4-41c6-80a8-70b258aee1d4\") " pod="kube-system/kas-connection-checker-685895c7c9-t9r98"
Oct 30 21:44:11.040338 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.040275    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 21:44:11.040338 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.040287    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 21:44:11.040338 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.040279    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 21:44:11.040338 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.040325    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 21:44:11.040338 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.040330    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 21:44:11.040583 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.040350    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 21:44:11.040583 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.040375    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 21:44:11.040583 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.040395    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h7hc5\""
Oct 30 21:44:11.040583 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.040459    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-vzpnp\""
Oct 30 21:44:11.052877 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.052820    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-skmhv\" (UID: \"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:11.052877 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.052850    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d03f7bd1-7d99-438a-aa20-e614e86c1235-cert\") pod \"ingress-canary-tnx6d\" (UID: \"d03f7bd1-7d99-438a-aa20-e614e86c1235\") " pod="openshift-ingress-canary/ingress-canary-tnx6d"
Oct 30 21:44:11.052999 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.052877    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c28402b8-cc54-4896-955c-a0dc2d5e156d-snapshots\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.052999 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.052941    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:11.052999 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.052969    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdwl5\" (UniqueName: \"kubernetes.io/projected/0d921c53-691c-4969-bdd4-f7b87db0e61b-kube-api-access-zdwl5\") pod \"network-check-source-6f78d59f99-ghx6v\" (UID: \"0d921c53-691c-4969-bdd4-f7b87db0e61b\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-ghx6v"
Oct 30 21:44:11.053108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.052997    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-bound-sa-token\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.053145 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053111    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-image-registry-private-configuration\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.053254 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053150    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-default-certificate\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:11.053254 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053189    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh2dx\" (UniqueName: \"kubernetes.io/projected/a4e14574-aa2d-4fc4-ba26-a07f4a669296-kube-api-access-dh2dx\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:11.053254 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053249    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm82w\" (UniqueName: \"kubernetes.io/projected/6b1746a5-d5b0-4786-908b-09797786de96-kube-api-access-tm82w\") pod \"service-ca-operator-544d749c8c-tp26d\" (UID: \"6b1746a5-d5b0-4786-908b-09797786de96\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:11.053392 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053373    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c28402b8-cc54-4896-955c-a0dc2d5e156d-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.053447 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053400    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:11.053447 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053418    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwj9\" (UniqueName: \"kubernetes.io/projected/f3017ee4-5edc-43b8-ad16-107517393622-kube-api-access-6bwj9\") pod \"volume-data-source-validator-58c9f5f46d-7zlst\" (UID: \"f3017ee4-5edc-43b8-ad16-107517393622\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7zlst"
Oct 30 21:44:11.053447 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053435    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n6jd\" (UniqueName: \"kubernetes.io/projected/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-kube-api-access-2n6jd\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-skmhv\" (UID: \"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:11.053585 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053452    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:11.053585 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053495    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b9112244-9e99-4f1d-b2a5-576d56dc0718-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:11.053585 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.053525    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:44:11.053748 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053599    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-skmhv\" (UID: \"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:11.053748 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.053611    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:44:11.053748 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.053620    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:11.553600851 +0000 UTC m=+33.215418682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : secret "router-metrics-certs-default" not found
Oct 30 21:44:11.053748 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053642    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:11.053748 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053674    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjrrb\" (UniqueName: \"kubernetes.io/projected/d03f7bd1-7d99-438a-aa20-e614e86c1235-kube-api-access-pjrrb\") pod \"ingress-canary-tnx6d\" (UID: \"d03f7bd1-7d99-438a-aa20-e614e86c1235\") " pod="openshift-ingress-canary/ingress-canary-tnx6d"
Oct 30 21:44:11.053748 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.053717    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert podName:b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:11.553700874 +0000 UTC m=+33.215518700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pfzwt" (UID: "b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5") : secret "networking-console-plugin-cert" not found
Oct 30 21:44:11.054054 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053754    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h68gq\" (UniqueName: \"kubernetes.io/projected/18b98618-898b-4a48-bb05-51e61ca7fe0a-kube-api-access-h68gq\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:11.054054 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053780    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c28402b8-cc54-4896-955c-a0dc2d5e156d-service-ca-bundle\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.054054 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053851    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gns8k\" (UniqueName: \"kubernetes.io/projected/c28402b8-cc54-4896-955c-a0dc2d5e156d-kube-api-access-gns8k\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.054054 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053911    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c28402b8-cc54-4896-955c-a0dc2d5e156d-tmp\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.054054 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053964    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c28402b8-cc54-4896-955c-a0dc2d5e156d-serving-cert\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.054054 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.053993    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrc2w\" (UniqueName: \"kubernetes.io/projected/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-kube-api-access-mrc2w\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:11.054054 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054017    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.054054 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054041    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-installation-pull-secrets\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.054427 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054073    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-bound-sa-token\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.054427 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054099    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b1746a5-d5b0-4786-908b-09797786de96-config\") pod \"service-ca-operator-544d749c8c-tp26d\" (UID: \"6b1746a5-d5b0-4786-908b-09797786de96\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:11.054427 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054116    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-certificates\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.054427 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054135    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.054427 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054154    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-trusted-ca\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.054427 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054199    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/795237f3-0ac3-4842-90f3-0378a80e5c33-ca-trust-extracted\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.054427 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.054250    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:11.054427 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.054266    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775f87bbf6-82p7v: secret "image-registry-tls" not found
Oct 30 21:44:11.054427 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054329    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7nrc\" (UniqueName: \"kubernetes.io/projected/a447a17d-b65e-40a2-b200-635ee45355ba-kube-api-access-k7nrc\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:11.054427 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054363    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5w4l\" (UniqueName: \"kubernetes.io/projected/b9112244-9e99-4f1d-b2a5-576d56dc0718-kube-api-access-d5w4l\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:11.054427 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.054403    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls podName:186ffaf9-fc18-4605-9c8c-c9c31bda5379 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:11.554385403 +0000 UTC m=+33.216203215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls") pod "image-registry-775f87bbf6-82p7v" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379") : secret "image-registry-tls" not found
Oct 30 21:44:11.054954 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054447    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-installation-pull-secrets\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.054954 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054480    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:11.054954 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054509    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b1746a5-d5b0-4786-908b-09797786de96-serving-cert\") pod \"service-ca-operator-544d749c8c-tp26d\" (UID: \"6b1746a5-d5b0-4786-908b-09797786de96\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:11.054954 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054535    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:11.054954 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054561    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc9l8\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-kube-api-access-fc9l8\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.054954 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054621    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-stats-auth\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:11.054954 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054646    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-image-registry-private-configuration\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.054954 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054665    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18b98618-898b-4a48-bb05-51e61ca7fe0a-trusted-ca\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:11.054954 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054790    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f695b\" (UniqueName: \"kubernetes.io/projected/7e81cfe7-52d2-474c-8261-66ce6cf58945-kube-api-access-f695b\") pod \"kas-connection-checker-685895c7c9-chqp7\" (UID: \"7e81cfe7-52d2-474c-8261-66ce6cf58945\") " pod="kube-system/kas-connection-checker-685895c7c9-chqp7"
Oct 30 21:44:11.054954 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054816    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18b98618-898b-4a48-bb05-51e61ca7fe0a-config\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:11.054954 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054846    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18b98618-898b-4a48-bb05-51e61ca7fe0a-serving-cert\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:11.054954 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054874    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/186ffaf9-fc18-4605-9c8c-c9c31bda5379-ca-trust-extracted\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.055463 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.054959    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:11.055463 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.055009    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pspz2\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-kube-api-access-pspz2\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.055463 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.055036    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:11.055463 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.055058    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-certificates\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.055463 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.055072    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-trusted-ca\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.055463 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.055085    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:11.055463 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.055112    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-trusted-ca\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.055463 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.055131    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:44:11.055845 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.055467    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls podName:a447a17d-b65e-40a2-b200-635ee45355ba nodeName:}" failed. No retries permitted until 2026-10-30 21:44:11.55544976 +0000 UTC m=+33.217267572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls") pod "dns-default-4hw29" (UID: "a447a17d-b65e-40a2-b200-635ee45355ba") : secret "dns-default-metrics-tls" not found
Oct 30 21:44:11.055845 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.055515    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a447a17d-b65e-40a2-b200-635ee45355ba-config-volume\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:11.055845 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.055533    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:11.555517465 +0000 UTC m=+33.217335297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : configmap references non-existent config key: service-ca.crt
Oct 30 21:44:11.055845 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.055569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a447a17d-b65e-40a2-b200-635ee45355ba-tmp-dir\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:11.055845 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.055838    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-certificates\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.056087 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.056039    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a447a17d-b65e-40a2-b200-635ee45355ba-config-volume\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:11.056263 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.056238    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/186ffaf9-fc18-4605-9c8c-c9c31bda5379-ca-trust-extracted\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.056411 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.056386    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-default-certificate\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:11.056480 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.056444    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a447a17d-b65e-40a2-b200-635ee45355ba-tmp-dir\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:11.057096 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.057080    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-installation-pull-secrets\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.057277 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.057261    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-image-registry-private-configuration\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.057374 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.057354    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-stats-auth\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:11.084780 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.084760    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-sdtr4"
Oct 30 21:44:11.108236 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.108216    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-t9r98"
Oct 30 21:44:11.115101 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.115079    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-bound-sa-token\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.115321 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.115296    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bwj9\" (UniqueName: \"kubernetes.io/projected/f3017ee4-5edc-43b8-ad16-107517393622-kube-api-access-6bwj9\") pod \"volume-data-source-validator-58c9f5f46d-7zlst\" (UID: \"f3017ee4-5edc-43b8-ad16-107517393622\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7zlst"
Oct 30 21:44:11.115483 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.115460    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f695b\" (UniqueName: \"kubernetes.io/projected/7e81cfe7-52d2-474c-8261-66ce6cf58945-kube-api-access-f695b\") pod \"kas-connection-checker-685895c7c9-chqp7\" (UID: \"7e81cfe7-52d2-474c-8261-66ce6cf58945\") " pod="kube-system/kas-connection-checker-685895c7c9-chqp7"
Oct 30 21:44:11.115582 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.115567    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7nrc\" (UniqueName: \"kubernetes.io/projected/a447a17d-b65e-40a2-b200-635ee45355ba-kube-api-access-k7nrc\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:11.116066 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.116050    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh2dx\" (UniqueName: \"kubernetes.io/projected/a4e14574-aa2d-4fc4-ba26-a07f4a669296-kube-api-access-dh2dx\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:11.116348 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.116327    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pspz2\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-kube-api-access-pspz2\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.156184 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156160    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdwl5\" (UniqueName: \"kubernetes.io/projected/0d921c53-691c-4969-bdd4-f7b87db0e61b-kube-api-access-zdwl5\") pod \"network-check-source-6f78d59f99-ghx6v\" (UID: \"0d921c53-691c-4969-bdd4-f7b87db0e61b\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-ghx6v"
Oct 30 21:44:11.156309 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156191    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-bound-sa-token\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.156309 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156211    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-image-registry-private-configuration\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.156416 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156335    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm82w\" (UniqueName: \"kubernetes.io/projected/6b1746a5-d5b0-4786-908b-09797786de96-kube-api-access-tm82w\") pod \"service-ca-operator-544d749c8c-tp26d\" (UID: \"6b1746a5-d5b0-4786-908b-09797786de96\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:11.156416 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156369    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c28402b8-cc54-4896-955c-a0dc2d5e156d-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.156540 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156516    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n6jd\" (UniqueName: \"kubernetes.io/projected/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-kube-api-access-2n6jd\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-skmhv\" (UID: \"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:11.156602 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156575    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b9112244-9e99-4f1d-b2a5-576d56dc0718-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:11.156739 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156718    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-skmhv\" (UID: \"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:11.156833 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156758    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjrrb\" (UniqueName: \"kubernetes.io/projected/d03f7bd1-7d99-438a-aa20-e614e86c1235-kube-api-access-pjrrb\") pod \"ingress-canary-tnx6d\" (UID: \"d03f7bd1-7d99-438a-aa20-e614e86c1235\") " pod="openshift-ingress-canary/ingress-canary-tnx6d"
Oct 30 21:44:11.156833 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156788    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h68gq\" (UniqueName: \"kubernetes.io/projected/18b98618-898b-4a48-bb05-51e61ca7fe0a-kube-api-access-h68gq\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:11.156833 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156813    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c28402b8-cc54-4896-955c-a0dc2d5e156d-service-ca-bundle\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.157114 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156843    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gns8k\" (UniqueName: \"kubernetes.io/projected/c28402b8-cc54-4896-955c-a0dc2d5e156d-kube-api-access-gns8k\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.157114 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156887    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c28402b8-cc54-4896-955c-a0dc2d5e156d-tmp\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.157114 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156921    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c28402b8-cc54-4896-955c-a0dc2d5e156d-serving-cert\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.157114 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156949    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrc2w\" (UniqueName: \"kubernetes.io/projected/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-kube-api-access-mrc2w\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:11.157114 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156973    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.157114 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.156996    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-installation-pull-secrets\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.157114 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157022    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b1746a5-d5b0-4786-908b-09797786de96-config\") pod \"service-ca-operator-544d749c8c-tp26d\" (UID: \"6b1746a5-d5b0-4786-908b-09797786de96\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:11.157114 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157044    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-certificates\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.157114 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157079    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/795237f3-0ac3-4842-90f3-0378a80e5c33-ca-trust-extracted\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.157114 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157116    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5w4l\" (UniqueName: \"kubernetes.io/projected/b9112244-9e99-4f1d-b2a5-576d56dc0718-kube-api-access-d5w4l\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:11.157560 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157169    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:11.157560 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157199    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b1746a5-d5b0-4786-908b-09797786de96-serving-cert\") pod \"service-ca-operator-544d749c8c-tp26d\" (UID: \"6b1746a5-d5b0-4786-908b-09797786de96\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:11.157560 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157227    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:11.157560 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157251    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc9l8\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-kube-api-access-fc9l8\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.157560 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157295    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18b98618-898b-4a48-bb05-51e61ca7fe0a-trusted-ca\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:11.157560 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157330    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18b98618-898b-4a48-bb05-51e61ca7fe0a-config\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:11.157560 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157357    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18b98618-898b-4a48-bb05-51e61ca7fe0a-serving-cert\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:11.157560 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157371    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b9112244-9e99-4f1d-b2a5-576d56dc0718-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:11.157560 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157407    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-skmhv\" (UID: \"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:11.157560 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157421    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:11.157560 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-trusted-ca\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.157560 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157491    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-skmhv\" (UID: \"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:11.157560 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157516    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d03f7bd1-7d99-438a-aa20-e614e86c1235-cert\") pod \"ingress-canary-tnx6d\" (UID: \"d03f7bd1-7d99-438a-aa20-e614e86c1235\") " pod="openshift-ingress-canary/ingress-canary-tnx6d"
Oct 30 21:44:11.157560 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.157521    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:44:11.157560 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157547    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c28402b8-cc54-4896-955c-a0dc2d5e156d-snapshots\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.158340 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.157582    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls podName:40cb9ea7-fe94-41e7-abd3-70a2c6d31fff nodeName:}" failed. No retries permitted until 2026-10-30 21:44:11.657562485 +0000 UTC m=+33.319380513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-z67rm" (UID: "40cb9ea7-fe94-41e7-abd3-70a2c6d31fff") : secret "samples-operator-tls" not found
Oct 30 21:44:11.158340 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.157375    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c28402b8-cc54-4896-955c-a0dc2d5e156d-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.158549 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.158528    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:11.158611 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.158591    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls podName:b9112244-9e99-4f1d-b2a5-576d56dc0718 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:11.658574528 +0000 UTC m=+33.320392364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-54ntg" (UID: "b9112244-9e99-4f1d-b2a5-576d56dc0718") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:11.160325 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.160306    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:11.160448 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.160436    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d78449d9-mmjp2: secret "image-registry-tls" not found
Oct 30 21:44:11.162060 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.160521    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/795237f3-0ac3-4842-90f3-0378a80e5c33-ca-trust-extracted\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.162060 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.160567    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls podName:795237f3-0ac3-4842-90f3-0378a80e5c33 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:11.660547787 +0000 UTC m=+33.322365617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls") pod "image-registry-8d78449d9-mmjp2" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33") : secret "image-registry-tls" not found
Oct 30 21:44:11.162060 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.160981    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-trusted-ca\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.162060 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.161080    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:11.162060 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.161342    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c28402b8-cc54-4896-955c-a0dc2d5e156d-tmp\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.162060 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.161450    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c28402b8-cc54-4896-955c-a0dc2d5e156d-snapshots\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.162060 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.161675    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-image-registry-private-configuration\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.162060 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.162017    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-certificates\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.162533 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.162398    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18b98618-898b-4a48-bb05-51e61ca7fe0a-config\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:11.162874 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.162827    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18b98618-898b-4a48-bb05-51e61ca7fe0a-trusted-ca\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:11.163145 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.163124    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b1746a5-d5b0-4786-908b-09797786de96-config\") pod \"service-ca-operator-544d749c8c-tp26d\" (UID: \"6b1746a5-d5b0-4786-908b-09797786de96\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:11.163757 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.163736    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c28402b8-cc54-4896-955c-a0dc2d5e156d-serving-cert\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.164181 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.164162    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-installation-pull-secrets\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.164437 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.164416    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18b98618-898b-4a48-bb05-51e61ca7fe0a-serving-cert\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:11.165654 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.165637    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b1746a5-d5b0-4786-908b-09797786de96-serving-cert\") pod \"service-ca-operator-544d749c8c-tp26d\" (UID: \"6b1746a5-d5b0-4786-908b-09797786de96\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:11.165771 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.165704    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d03f7bd1-7d99-438a-aa20-e614e86c1235-cert\") pod \"ingress-canary-tnx6d\" (UID: \"d03f7bd1-7d99-438a-aa20-e614e86c1235\") " pod="openshift-ingress-canary/ingress-canary-tnx6d"
Oct 30 21:44:11.166958 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.166936    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c28402b8-cc54-4896-955c-a0dc2d5e156d-service-ca-bundle\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.168890 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.168872    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-skmhv\" (UID: \"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:11.174866 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.174847    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7zlst"
Oct 30 21:44:11.179107 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.179077    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-chqp7"
Oct 30 21:44:11.234362 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.234291    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h68gq\" (UniqueName: \"kubernetes.io/projected/18b98618-898b-4a48-bb05-51e61ca7fe0a-kube-api-access-h68gq\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:11.235695 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.235633    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrc2w\" (UniqueName: \"kubernetes.io/projected/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-kube-api-access-mrc2w\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:11.237207 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.237183    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gns8k\" (UniqueName: \"kubernetes.io/projected/c28402b8-cc54-4896-955c-a0dc2d5e156d-kube-api-access-gns8k\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.237578 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.237560    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-bound-sa-token\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.238266 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.238246    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5w4l\" (UniqueName: \"kubernetes.io/projected/b9112244-9e99-4f1d-b2a5-576d56dc0718-kube-api-access-d5w4l\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:11.238266 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.238259    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdwl5\" (UniqueName: \"kubernetes.io/projected/0d921c53-691c-4969-bdd4-f7b87db0e61b-kube-api-access-zdwl5\") pod \"network-check-source-6f78d59f99-ghx6v\" (UID: \"0d921c53-691c-4969-bdd4-f7b87db0e61b\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-ghx6v"
Oct 30 21:44:11.238744 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.238718    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n6jd\" (UniqueName: \"kubernetes.io/projected/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-kube-api-access-2n6jd\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-skmhv\" (UID: \"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:11.238827 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.238812    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc9l8\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-kube-api-access-fc9l8\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.239108 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.239087    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm82w\" (UniqueName: \"kubernetes.io/projected/6b1746a5-d5b0-4786-908b-09797786de96-kube-api-access-tm82w\") pod \"service-ca-operator-544d749c8c-tp26d\" (UID: \"6b1746a5-d5b0-4786-908b-09797786de96\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:11.239255 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.239239    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjrrb\" (UniqueName: \"kubernetes.io/projected/d03f7bd1-7d99-438a-aa20-e614e86c1235-kube-api-access-pjrrb\") pod \"ingress-canary-tnx6d\" (UID: \"d03f7bd1-7d99-438a-aa20-e614e86c1235\") " pod="openshift-ingress-canary/ingress-canary-tnx6d"
Oct 30 21:44:11.496390 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.496360    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:11.507498 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.507480    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:11.515452 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.515430    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:11.522649 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.522625    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:11.527565 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.527538    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sdtr4"]
Oct 30 21:44:11.529672 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.529651    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-t9r98"]
Oct 30 21:44:11.531784 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:44:11.531755    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2357ae3_0e6b_427c_84f5_fda3350920c4.slice/crio-62ec01ac891fc45a2e052298f4b7686ccca67649c33cdde0f76b8a08411363cc WatchSource:0}: Error finding container 62ec01ac891fc45a2e052298f4b7686ccca67649c33cdde0f76b8a08411363cc: Status 404 returned error can't find the container with id 62ec01ac891fc45a2e052298f4b7686ccca67649c33cdde0f76b8a08411363cc
Oct 30 21:44:11.533746 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.533722    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-ghx6v"
Oct 30 21:44:11.533960 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:44:11.533937    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab14d71_ddf4_41c6_80a8_70b258aee1d4.slice/crio-650ca8e18a3eaae136cb3e0e0cd4aed0964cdf2030737442b21c9919c02e9a4b WatchSource:0}: Error finding container 650ca8e18a3eaae136cb3e0e0cd4aed0964cdf2030737442b21c9919c02e9a4b: Status 404 returned error can't find the container with id 650ca8e18a3eaae136cb3e0e0cd4aed0964cdf2030737442b21c9919c02e9a4b
Oct 30 21:44:11.538013 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.537997    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tnx6d"
Oct 30 21:44:11.562581 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.561665    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:11.562581 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.561774    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:11.562581 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.561940    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:44:11.562581 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.562007    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert podName:b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:12.561985697 +0000 UTC m=+34.223803523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pfzwt" (UID: "b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5") : secret "networking-console-plugin-cert" not found
Oct 30 21:44:11.562581 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.562328    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:11.562581 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.562347    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775f87bbf6-82p7v: secret "image-registry-tls" not found
Oct 30 21:44:11.562581 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.562398    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls podName:186ffaf9-fc18-4605-9c8c-c9c31bda5379 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:12.562380983 +0000 UTC m=+34.224198837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls") pod "image-registry-775f87bbf6-82p7v" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379") : secret "image-registry-tls" not found
Oct 30 21:44:11.563332 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.562826    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:11.563332 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.562866    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:11.563332 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.562929    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:11.563332 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.562972    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:44:11.563332 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.563024    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls podName:a447a17d-b65e-40a2-b200-635ee45355ba nodeName:}" failed. No retries permitted until 2026-10-30 21:44:12.563007831 +0000 UTC m=+34.224825645 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls") pod "dns-default-4hw29" (UID: "a447a17d-b65e-40a2-b200-635ee45355ba") : secret "dns-default-metrics-tls" not found
Oct 30 21:44:11.563332 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.563075    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:44:11.563332 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.563137    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:12.563120893 +0000 UTC m=+34.224938719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : secret "router-metrics-certs-default" not found
Oct 30 21:44:11.563332 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.563155    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:12.563145341 +0000 UTC m=+34.224963153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : configmap references non-existent config key: service-ca.crt
Oct 30 21:44:11.580320 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.580240    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7zlst"]
Oct 30 21:44:11.592788 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:44:11.592226    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3017ee4_5edc_43b8_ad16_107517393622.slice/crio-dbceb973a6721ddaedb19d6a3fbb2091c905931770de353f416cf68decc079c6 WatchSource:0}: Error finding container dbceb973a6721ddaedb19d6a3fbb2091c905931770de353f416cf68decc079c6: Status 404 returned error can't find the container with id dbceb973a6721ddaedb19d6a3fbb2091c905931770de353f416cf68decc079c6
Oct 30 21:44:11.606216 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.606102    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-chqp7"]
Oct 30 21:44:11.614021 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:44:11.613993    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e81cfe7_52d2_474c_8261_66ce6cf58945.slice/crio-0bdfed7799032034feb774cc9987d238deff6e8b39b33865a3765a1bc6514d9b WatchSource:0}: Error finding container 0bdfed7799032034feb774cc9987d238deff6e8b39b33865a3765a1bc6514d9b: Status 404 returned error can't find the container with id 0bdfed7799032034feb774cc9987d238deff6e8b39b33865a3765a1bc6514d9b
Oct 30 21:44:11.687355 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.679225    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:11.687355 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.679317    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:11.687355 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.679349    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:11.687355 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.679563    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:44:11.687355 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.679631    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls podName:40cb9ea7-fe94-41e7-abd3-70a2c6d31fff nodeName:}" failed. No retries permitted until 2026-10-30 21:44:12.679612285 +0000 UTC m=+34.341430115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-z67rm" (UID: "40cb9ea7-fe94-41e7-abd3-70a2c6d31fff") : secret "samples-operator-tls" not found
Oct 30 21:44:11.687355 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.679724    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:11.687355 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.679736    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d78449d9-mmjp2: secret "image-registry-tls" not found
Oct 30 21:44:11.687355 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.679775    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls podName:795237f3-0ac3-4842-90f3-0378a80e5c33 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:12.679762374 +0000 UTC m=+34.341580201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls") pod "image-registry-8d78449d9-mmjp2" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33") : secret "image-registry-tls" not found
Oct 30 21:44:11.687355 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.680072    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:11.687355 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:11.680121    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls podName:b9112244-9e99-4f1d-b2a5-576d56dc0718 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:12.68010768 +0000 UTC m=+34.341925506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-54ntg" (UID: "b9112244-9e99-4f1d-b2a5-576d56dc0718") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:11.881782 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.881750    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-vbwwf"]
Oct 30 21:44:11.884472 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:44:11.884446    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc28402b8_cc54_4896_955c_a0dc2d5e156d.slice/crio-f4cd8abff3569d0c4b364ff41564c305e3e6841d4282effa4ee873483561548e WatchSource:0}: Error finding container f4cd8abff3569d0c4b364ff41564c305e3e6841d4282effa4ee873483561548e: Status 404 returned error can't find the container with id f4cd8abff3569d0c4b364ff41564c305e3e6841d4282effa4ee873483561548e
Oct 30 21:44:11.912956 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.912930    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"]
Oct 30 21:44:11.915820 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:44:11.915797    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1746a5_d5b0_4786_908b_09797786de96.slice/crio-032a97f4ff580cb0b89424ca7b9d6de6f73a32b13d2da0e14973265816231e58 WatchSource:0}: Error finding container 032a97f4ff580cb0b89424ca7b9d6de6f73a32b13d2da0e14973265816231e58: Status 404 returned error can't find the container with id 032a97f4ff580cb0b89424ca7b9d6de6f73a32b13d2da0e14973265816231e58
Oct 30 21:44:11.975063 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.975019    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d" event={"ID":"6b1746a5-d5b0-4786-908b-09797786de96","Type":"ContainerStarted","Data":"032a97f4ff580cb0b89424ca7b9d6de6f73a32b13d2da0e14973265816231e58"}
Oct 30 21:44:11.976359 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.976336    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7zlst" event={"ID":"f3017ee4-5edc-43b8-ad16-107517393622","Type":"ContainerStarted","Data":"dbceb973a6721ddaedb19d6a3fbb2091c905931770de353f416cf68decc079c6"}
Oct 30 21:44:11.977855 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.977835    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-t9r98" event={"ID":"aab14d71-ddf4-41c6-80a8-70b258aee1d4","Type":"ContainerStarted","Data":"8ca970c124d1d9eb64ca1efeb170a077b9b121924f99ae8f5c91da389b79b05f"}
Oct 30 21:44:11.977945 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.977883    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-t9r98" event={"ID":"aab14d71-ddf4-41c6-80a8-70b258aee1d4","Type":"ContainerStarted","Data":"650ca8e18a3eaae136cb3e0e0cd4aed0964cdf2030737442b21c9919c02e9a4b"}
Oct 30 21:44:11.979543 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.979512    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-sdtr4" event={"ID":"e2357ae3-0e6b-427c-84f5-fda3350920c4","Type":"ContainerStarted","Data":"961fdfe0968dc0a3a633e256bac971570cc35650b9bce6804eaa260b58c5ba99"}
Oct 30 21:44:11.979645 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.979558    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-sdtr4" event={"ID":"e2357ae3-0e6b-427c-84f5-fda3350920c4","Type":"ContainerStarted","Data":"62ec01ac891fc45a2e052298f4b7686ccca67649c33cdde0f76b8a08411363cc"}
Oct 30 21:44:11.980936 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.980909    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-chqp7" event={"ID":"7e81cfe7-52d2-474c-8261-66ce6cf58945","Type":"ContainerStarted","Data":"1e8bfef13afecd49c1cd9913314b04de798c5a2e9bfb45bf9f5603cd1005d76f"}
Oct 30 21:44:11.981029 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.980952    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-chqp7" event={"ID":"7e81cfe7-52d2-474c-8261-66ce6cf58945","Type":"ContainerStarted","Data":"0bdfed7799032034feb774cc9987d238deff6e8b39b33865a3765a1bc6514d9b"}
Oct 30 21:44:11.982004 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.981983    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-vbwwf" event={"ID":"c28402b8-cc54-4896-955c-a0dc2d5e156d","Type":"ContainerStarted","Data":"f4cd8abff3569d0c4b364ff41564c305e3e6841d4282effa4ee873483561548e"}
Oct 30 21:44:11.998991 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:11.998971    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"]
Oct 30 21:44:12.002149 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:44:12.002108    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aab5a63_4de8_4a6e_a9e7_f7ba260754c8.slice/crio-00c2fc719980d06fbe5338968f08435f860b36c6b55a3d672bc1f8f2ddb4d702 WatchSource:0}: Error finding container 00c2fc719980d06fbe5338968f08435f860b36c6b55a3d672bc1f8f2ddb4d702: Status 404 returned error can't find the container with id 00c2fc719980d06fbe5338968f08435f860b36c6b55a3d672bc1f8f2ddb4d702
Oct 30 21:44:12.040871 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.040845    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tnx6d"]
Oct 30 21:44:12.044032 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.043962    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-8hc58"]
Oct 30 21:44:12.044603 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:44:12.044536    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd03f7bd1_7d99_438a_aa20_e614e86c1235.slice/crio-d58df008cc31f0fc5ada3bd63593725e12bfa186173287452d0e498b920a825c WatchSource:0}: Error finding container d58df008cc31f0fc5ada3bd63593725e12bfa186173287452d0e498b920a825c: Status 404 returned error can't find the container with id d58df008cc31f0fc5ada3bd63593725e12bfa186173287452d0e498b920a825c
Oct 30 21:44:12.045392 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.045247    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-ghx6v"]
Oct 30 21:44:12.047293 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:44:12.047273    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d921c53_691c_4969_bdd4_f7b87db0e61b.slice/crio-210bf3ffbd69f859eb0a7c0fece8dbfb64f9a1576b63c260f374e9cd4286d3e8 WatchSource:0}: Error finding container 210bf3ffbd69f859eb0a7c0fece8dbfb64f9a1576b63c260f374e9cd4286d3e8: Status 404 returned error can't find the container with id 210bf3ffbd69f859eb0a7c0fece8dbfb64f9a1576b63c260f374e9cd4286d3e8
Oct 30 21:44:12.077512 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:44:12.077481    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b98618_898b_4a48_bb05_51e61ca7fe0a.slice/crio-ad9e9b3612a0b02cf8902f3a225470be4fb1ae7b0d22dfb200d739602c145f3b WatchSource:0}: Error finding container ad9e9b3612a0b02cf8902f3a225470be4fb1ae7b0d22dfb200d739602c145f3b: Status 404 returned error can't find the container with id ad9e9b3612a0b02cf8902f3a225470be4fb1ae7b0d22dfb200d739602c145f3b
Oct 30 21:44:12.589850 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.589810    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:12.590144 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.589891    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:12.590144 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.589924    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:12.590144 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.589997    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:12.590144 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.590023    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:12.590144 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.590027    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:12.590144 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.590049    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775f87bbf6-82p7v: secret "image-registry-tls" not found
Oct 30 21:44:12.590144 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.590084    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:12.590144 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.590102    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 21:44:12.590144 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.590103    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:44:12.590447 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.590110    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls podName:186ffaf9-fc18-4605-9c8c-c9c31bda5379 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:14.590090358 +0000 UTC m=+36.251908193 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls") pod "image-registry-775f87bbf6-82p7v" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379") : secret "image-registry-tls" not found
Oct 30 21:44:12.590447 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.590165    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:44:12.590447 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.590193    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs podName:f1c0a201-8b48-44fb-b107-a5f2bb798235 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:44.590176964 +0000 UTC m=+66.251994777 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs") pod "network-metrics-daemon-jdg72" (UID: "f1c0a201-8b48-44fb-b107-a5f2bb798235") : secret "metrics-daemon-secret" not found
Oct 30 21:44:12.590447 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.590208    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:14.590202238 +0000 UTC m=+36.252020051 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : configmap references non-existent config key: service-ca.crt
Oct 30 21:44:12.590447 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.590227    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls podName:a447a17d-b65e-40a2-b200-635ee45355ba nodeName:}" failed. No retries permitted until 2026-10-30 21:44:14.590222364 +0000 UTC m=+36.252040176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls") pod "dns-default-4hw29" (UID: "a447a17d-b65e-40a2-b200-635ee45355ba") : secret "dns-default-metrics-tls" not found
Oct 30 21:44:12.590447 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.590240    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:14.590234636 +0000 UTC m=+36.252052447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : secret "router-metrics-certs-default" not found
Oct 30 21:44:12.590447 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.590254    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:12.590447 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.590323    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:44:12.590447 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.590352    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert podName:b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:14.590345815 +0000 UTC m=+36.252163667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pfzwt" (UID: "b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5") : secret "networking-console-plugin-cert" not found
Oct 30 21:44:12.592419 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.592403    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:12.632320 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.632290    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:12.691042 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.691003    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:12.691211 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.691055    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:12.691211 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.691170    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:44:12.691211 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.691172    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:12.691359 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.691240    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls podName:40cb9ea7-fe94-41e7-abd3-70a2c6d31fff nodeName:}" failed. No retries permitted until 2026-10-30 21:44:14.691222241 +0000 UTC m=+36.353040069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-z67rm" (UID: "40cb9ea7-fe94-41e7-abd3-70a2c6d31fff") : secret "samples-operator-tls" not found
Oct 30 21:44:12.691359 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.691272    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls podName:b9112244-9e99-4f1d-b2a5-576d56dc0718 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:14.69126237 +0000 UTC m=+36.353080185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-54ntg" (UID: "b9112244-9e99-4f1d-b2a5-576d56dc0718") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:12.691471 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.691424    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:12.691581 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.691566    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:12.691653 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.691583    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d78449d9-mmjp2: secret "image-registry-tls" not found
Oct 30 21:44:12.691653 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:12.691617    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls podName:795237f3-0ac3-4842-90f3-0378a80e5c33 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:14.691606938 +0000 UTC m=+36.353424753 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls") pod "image-registry-8d78449d9-mmjp2" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33") : secret "image-registry-tls" not found
Oct 30 21:44:12.792869 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.792836    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwq8k\" (UniqueName: \"kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k\") pod \"network-check-target-r54tb\" (UID: \"ec41ebc2-3ff6-4453-8eb4-c420b02516c2\") " pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:44:12.795952 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.795920    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwq8k\" (UniqueName: \"kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k\") pod \"network-check-target-r54tb\" (UID: \"ec41ebc2-3ff6-4453-8eb4-c420b02516c2\") " pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:44:12.850823 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.850662    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-sdtr4" podStartSLOduration=401.850642976 podStartE2EDuration="6m41.850642976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:12.848984778 +0000 UTC m=+34.510802605" watchObservedRunningTime="2026-10-30 21:44:12.850642976 +0000 UTC m=+34.512460814"
Oct 30 21:44:12.952542 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.952512    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:44:12.986824 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.986742    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv" event={"ID":"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8","Type":"ContainerStarted","Data":"00c2fc719980d06fbe5338968f08435f860b36c6b55a3d672bc1f8f2ddb4d702"}
Oct 30 21:44:12.988291 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.988264    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tnx6d" event={"ID":"d03f7bd1-7d99-438a-aa20-e614e86c1235","Type":"ContainerStarted","Data":"d58df008cc31f0fc5ada3bd63593725e12bfa186173287452d0e498b920a825c"}
Oct 30 21:44:12.991485 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.991396    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58" event={"ID":"18b98618-898b-4a48-bb05-51e61ca7fe0a","Type":"ContainerStarted","Data":"ad9e9b3612a0b02cf8902f3a225470be4fb1ae7b0d22dfb200d739602c145f3b"}
Oct 30 21:44:12.997838 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:12.997781    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-ghx6v" event={"ID":"0d921c53-691c-4969-bdd4-f7b87db0e61b","Type":"ContainerStarted","Data":"210bf3ffbd69f859eb0a7c0fece8dbfb64f9a1576b63c260f374e9cd4286d3e8"}
Oct 30 21:44:13.028290 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:13.028105    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-t9r98" podStartSLOduration=402.028087417 podStartE2EDuration="6m42.028087417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:12.963844768 +0000 UTC m=+34.625662603" watchObservedRunningTime="2026-10-30 21:44:13.028087417 +0000 UTC m=+34.689905252"
Oct 30 21:44:13.033993 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:13.033906    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8c64w"]
Oct 30 21:44:13.079207 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:13.079119    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-chqp7" podStartSLOduration=402.079104262 podStartE2EDuration="6m42.079104262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:13.077955508 +0000 UTC m=+34.739773343" watchObservedRunningTime="2026-10-30 21:44:13.079104262 +0000 UTC m=+34.740922100"
Oct 30 21:44:13.357713 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:13.354773    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r54tb"]
Oct 30 21:44:14.008607 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:14.008571    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8c64w" event={"ID":"9b06a5cb-5c28-4146-bbea-bfbe2297136c","Type":"ContainerStarted","Data":"7b962b1196c00206a6b9bbf0362de72844d5b2f7e0e815c5ca713f5daa682bcb"}
Oct 30 21:44:14.010808 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:14.010746    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r54tb" event={"ID":"ec41ebc2-3ff6-4453-8eb4-c420b02516c2","Type":"ContainerStarted","Data":"1e16d817ad0d9e0bf239b4f985344bd17e9f519b7afc5685c60613d7609868c9"}
Oct 30 21:44:14.614712 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:14.613984    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:14.614712 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:14.614037    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:14.614712 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:14.614096    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:14.614712 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:14.614125    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:14.614712 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:14.614191    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:14.614712 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.614341    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:14.614712 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.614357    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775f87bbf6-82p7v: secret "image-registry-tls" not found
Oct 30 21:44:14.614712 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.614428    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls podName:186ffaf9-fc18-4605-9c8c-c9c31bda5379 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:18.614410179 +0000 UTC m=+40.276228007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls") pod "image-registry-775f87bbf6-82p7v" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379") : secret "image-registry-tls" not found
Oct 30 21:44:14.615146 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.614860    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:44:14.615146 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.614913    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls podName:a447a17d-b65e-40a2-b200-635ee45355ba nodeName:}" failed. No retries permitted until 2026-10-30 21:44:18.614897785 +0000 UTC m=+40.276715611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls") pod "dns-default-4hw29" (UID: "a447a17d-b65e-40a2-b200-635ee45355ba") : secret "dns-default-metrics-tls" not found
Oct 30 21:44:14.615146 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.614985    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:18.614973695 +0000 UTC m=+40.276791522 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : configmap references non-existent config key: service-ca.crt
Oct 30 21:44:14.615146 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.615047    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:44:14.615146 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.615079    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:18.615069331 +0000 UTC m=+40.276887156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : secret "router-metrics-certs-default" not found
Oct 30 21:44:14.615146 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.615129    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:44:14.615325 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.615161    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert podName:b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:18.615150724 +0000 UTC m=+40.276968552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pfzwt" (UID: "b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5") : secret "networking-console-plugin-cert" not found
Oct 30 21:44:14.715401 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:14.714827    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:14.715401 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:14.714907    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:14.715401 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:14.714937    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:14.715401 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.715095    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:44:14.715401 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.715153    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls podName:40cb9ea7-fe94-41e7-abd3-70a2c6d31fff nodeName:}" failed. No retries permitted until 2026-10-30 21:44:18.715136431 +0000 UTC m=+40.376954263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-z67rm" (UID: "40cb9ea7-fe94-41e7-abd3-70a2c6d31fff") : secret "samples-operator-tls" not found
Oct 30 21:44:14.715401 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.715221    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:14.715401 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.715232    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d78449d9-mmjp2: secret "image-registry-tls" not found
Oct 30 21:44:14.715401 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.715275    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls podName:795237f3-0ac3-4842-90f3-0378a80e5c33 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:18.715264309 +0000 UTC m=+40.377082126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls") pod "image-registry-8d78449d9-mmjp2" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33") : secret "image-registry-tls" not found
Oct 30 21:44:14.715401 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.715335    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:14.715401 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:14.715369    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls podName:b9112244-9e99-4f1d-b2a5-576d56dc0718 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:18.715358996 +0000 UTC m=+40.377176812 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-54ntg" (UID: "b9112244-9e99-4f1d-b2a5-576d56dc0718") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:15.021074 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:15.020529    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7zlst" event={"ID":"f3017ee4-5edc-43b8-ad16-107517393622","Type":"ContainerStarted","Data":"e862a983ffe8e0cf19613d3528ff375c06e81124f2c3317aff1d42deb423be30"}
Oct 30 21:44:15.139456 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:15.137780    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7zlst" podStartSLOduration=392.650914864 podStartE2EDuration="6m35.137760987s" totalImagesPullingTime="2.486846123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:15.137528783 +0000 UTC m=+36.799346610" watchObservedRunningTime="2026-10-30 21:44:15.137760987 +0000 UTC m=+36.799578824"
Oct 30 21:44:15.560240 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:15.560201    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:15.908080 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:15.907995    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:17.029612 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:17.029450    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-vbwwf" event={"ID":"c28402b8-cc54-4896-955c-a0dc2d5e156d","Type":"ContainerStarted","Data":"910441c9dd50604ace290ea9959fd5a07f38bec5a1819f57e3c7687f81bf2405"}
Oct 30 21:44:18.036521 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.035351    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/0.log"
Oct 30 21:44:18.036521 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.035395    2574 generic.go:356] "Generic (PLEG): container finished" podID="18b98618-898b-4a48-bb05-51e61ca7fe0a" containerID="92ac6e108cd8ebbf85dcfa37a3e6e49c5bf1a3c4038f83e1decd853eeb9c6046" exitCode=255
Oct 30 21:44:18.036521 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.036121    2574 scope.go:122] "RemoveContainer" containerID="92ac6e108cd8ebbf85dcfa37a3e6e49c5bf1a3c4038f83e1decd853eeb9c6046"
Oct 30 21:44:18.036521 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.036314    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58" event={"ID":"18b98618-898b-4a48-bb05-51e61ca7fe0a","Type":"ContainerDied","Data":"92ac6e108cd8ebbf85dcfa37a3e6e49c5bf1a3c4038f83e1decd853eeb9c6046"}
Oct 30 21:44:18.157369 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.157317    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-vbwwf" podStartSLOduration=389.277822247 podStartE2EDuration="6m34.157290876s" totalImagesPullingTime="4.879468629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:37:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:17.150871811 +0000 UTC m=+38.812689642" watchObservedRunningTime="2026-10-30 21:44:18.157290876 +0000 UTC m=+39.819108714"
Oct 30 21:44:18.332791 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.331607    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-48xwh"]
Oct 30 21:44:18.349846 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.349816    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:18.395382 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.395305    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-48xwh"]
Oct 30 21:44:18.403223 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.403078    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ltjsw\""
Oct 30 21:44:18.403223 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.403123    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 21:44:18.403223 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.403173    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 21:44:18.468326 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.467832    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37575185-c078-4be7-afa9-f7f860f29d49-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:18.468326 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.467890    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:18.468326 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.467923    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37575185-c078-4be7-afa9-f7f860f29d49-data-volume\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:18.468326 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.467951    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-589gf\" (UniqueName: \"kubernetes.io/projected/37575185-c078-4be7-afa9-f7f860f29d49-kube-api-access-589gf\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:18.468326 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.468011    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37575185-c078-4be7-afa9-f7f860f29d49-crio-socket\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:18.569486 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.569448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:18.569642 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.569500    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37575185-c078-4be7-afa9-f7f860f29d49-data-volume\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:18.569642 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.569527    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-589gf\" (UniqueName: \"kubernetes.io/projected/37575185-c078-4be7-afa9-f7f860f29d49-kube-api-access-589gf\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:18.569642 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.569579    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37575185-c078-4be7-afa9-f7f860f29d49-crio-socket\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:18.569818 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.569675    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37575185-c078-4be7-afa9-f7f860f29d49-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:18.569885 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.569838    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:44:18.569977 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.569963    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:44:18.571067 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.570034    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls podName:37575185-c078-4be7-afa9-f7f860f29d49 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:19.070012439 +0000 UTC m=+40.731830271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls") pod "insights-runtime-extractor-48xwh" (UID: "37575185-c078-4be7-afa9-f7f860f29d49") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:44:18.571067 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.570548    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37575185-c078-4be7-afa9-f7f860f29d49-data-volume\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:18.571067 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.570965    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37575185-c078-4be7-afa9-f7f860f29d49-crio-socket\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:18.571067 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.571028    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/37575185-c078-4be7-afa9-f7f860f29d49-kube-rbac-proxy-cm podName:37575185-c078-4be7-afa9-f7f860f29d49 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:19.071007634 +0000 UTC m=+40.732825463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/37575185-c078-4be7-afa9-f7f860f29d49-kube-rbac-proxy-cm") pod "insights-runtime-extractor-48xwh" (UID: "37575185-c078-4be7-afa9-f7f860f29d49") : configmap "kube-rbac-proxy" not found
Oct 30 21:44:18.644741 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.640978    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-589gf\" (UniqueName: \"kubernetes.io/projected/37575185-c078-4be7-afa9-f7f860f29d49-kube-api-access-589gf\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:18.665921 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.665836    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:18.670188 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.670156    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:18.670303 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.670202    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:18.670303 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.670265    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:18.670374 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.670334    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:44:18.670374 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.670364    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:18.670446 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.670394    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.670375555 +0000 UTC m=+48.332193382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : secret "router-metrics-certs-default" not found
Oct 30 21:44:18.670446 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.670420    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:18.670512 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.670461    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:44:18.670512 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.670507    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls podName:a447a17d-b65e-40a2-b200-635ee45355ba nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.670492289 +0000 UTC m=+48.332310123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls") pod "dns-default-4hw29" (UID: "a447a17d-b65e-40a2-b200-635ee45355ba") : secret "dns-default-metrics-tls" not found
Oct 30 21:44:18.670573 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.670548    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.670540472 +0000 UTC m=+48.332358283 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : configmap references non-existent config key: service-ca.crt
Oct 30 21:44:18.670573 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.670557    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:44:18.670639 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.670591    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert podName:b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.670581514 +0000 UTC m=+48.332399350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pfzwt" (UID: "b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5") : secret "networking-console-plugin-cert" not found
Oct 30 21:44:18.670639 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.670609    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:18.670639 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.670617    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775f87bbf6-82p7v: secret "image-registry-tls" not found
Oct 30 21:44:18.670639 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.670638    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls podName:186ffaf9-fc18-4605-9c8c-c9c31bda5379 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.670631502 +0000 UTC m=+48.332449314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls") pod "image-registry-775f87bbf6-82p7v" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379") : secret "image-registry-tls" not found
Oct 30 21:44:18.771674 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.770940    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:18.771674 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.771022    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:18.771674 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.771055    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:18.771674 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.771289    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:44:18.771674 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.771347    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls podName:40cb9ea7-fe94-41e7-abd3-70a2c6d31fff nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.771329661 +0000 UTC m=+48.433147475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-z67rm" (UID: "40cb9ea7-fe94-41e7-abd3-70a2c6d31fff") : secret "samples-operator-tls" not found
Oct 30 21:44:18.771674 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.771516    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:18.771674 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.771530    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d78449d9-mmjp2: secret "image-registry-tls" not found
Oct 30 21:44:18.771674 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.771566    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls podName:795237f3-0ac3-4842-90f3-0378a80e5c33 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.771553038 +0000 UTC m=+48.433370876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls") pod "image-registry-8d78449d9-mmjp2" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33") : secret "image-registry-tls" not found
Oct 30 21:44:18.771674 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.771624    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:18.771674 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:18.771649    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls podName:b9112244-9e99-4f1d-b2a5-576d56dc0718 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.771640951 +0000 UTC m=+48.433458777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-54ntg" (UID: "b9112244-9e99-4f1d-b2a5-576d56dc0718") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:18.925059 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:18.925033    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:19.049418 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.048735    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d" event={"ID":"6b1746a5-d5b0-4786-908b-09797786de96","Type":"ContainerStarted","Data":"68acd28f1801021ee5bd4f73edaf927ca433cb7fcd12399693fc0eb130f7d379"}
Oct 30 21:44:19.052985 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.052958    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv" event={"ID":"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8","Type":"ContainerStarted","Data":"c993294321f248a49582486bcdfa427e1abd35d96fb0f97425da9d2b507ffb4c"}
Oct 30 21:44:19.055464 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.055440    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tnx6d" event={"ID":"d03f7bd1-7d99-438a-aa20-e614e86c1235","Type":"ContainerStarted","Data":"31c14b9f1592b806abaa0c97d54ff5b6daa389fb04ceb96ccca24865c4c65b69"}
Oct 30 21:44:19.061478 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.061453    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/1.log"
Oct 30 21:44:19.062028 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.061955    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/0.log"
Oct 30 21:44:19.062028 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.061989    2574 generic.go:356] "Generic (PLEG): container finished" podID="18b98618-898b-4a48-bb05-51e61ca7fe0a" containerID="2c4a7ffe669b4633bcf7d93de74dd03f8fc10084061b3cbf465faea71f0467cd" exitCode=255
Oct 30 21:44:19.062128 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.062033    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58" event={"ID":"18b98618-898b-4a48-bb05-51e61ca7fe0a","Type":"ContainerDied","Data":"2c4a7ffe669b4633bcf7d93de74dd03f8fc10084061b3cbf465faea71f0467cd"}
Oct 30 21:44:19.062128 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.062071    2574 scope.go:122] "RemoveContainer" containerID="92ac6e108cd8ebbf85dcfa37a3e6e49c5bf1a3c4038f83e1decd853eeb9c6046"
Oct 30 21:44:19.062426 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.062411    2574 scope.go:122] "RemoveContainer" containerID="2c4a7ffe669b4633bcf7d93de74dd03f8fc10084061b3cbf465faea71f0467cd"
Oct 30 21:44:19.062613 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:19.062594    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8hc58_openshift-console-operator(18b98618-898b-4a48-bb05-51e61ca7fe0a)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58" podUID="18b98618-898b-4a48-bb05-51e61ca7fe0a"
Oct 30 21:44:19.075061 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.075032    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:19.075253 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.075212    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37575185-c078-4be7-afa9-f7f860f29d49-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:19.075360 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:19.075346    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:44:19.075414 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:19.075406    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/37575185-c078-4be7-afa9-f7f860f29d49-kube-rbac-proxy-cm podName:37575185-c078-4be7-afa9-f7f860f29d49 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:20.075388202 +0000 UTC m=+41.737206029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/37575185-c078-4be7-afa9-f7f860f29d49-kube-rbac-proxy-cm") pod "insights-runtime-extractor-48xwh" (UID: "37575185-c078-4be7-afa9-f7f860f29d49") : configmap "kube-rbac-proxy" not found
Oct 30 21:44:19.075548 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:19.075534    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:44:19.075614 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:19.075583    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls podName:37575185-c078-4be7-afa9-f7f860f29d49 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:20.075569868 +0000 UTC m=+41.737387694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls") pod "insights-runtime-extractor-48xwh" (UID: "37575185-c078-4be7-afa9-f7f860f29d49") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:44:19.167535 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.167432    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d" podStartSLOduration=395.017644855 podStartE2EDuration="6m41.167418205s" totalImagesPullingTime="6.14977335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:19.16608114 +0000 UTC m=+40.827898977" watchObservedRunningTime="2026-10-30 21:44:19.167418205 +0000 UTC m=+40.829236065"
Oct 30 21:44:19.281990 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.281940    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tnx6d" podStartSLOduration=2.409660765 podStartE2EDuration="9.281925756s" totalImagesPullingTime="6.872264991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:19.280891545 +0000 UTC m=+40.942709379" watchObservedRunningTime="2026-10-30 21:44:19.281925756 +0000 UTC m=+40.943743590"
Oct 30 21:44:19.478378 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.478302    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:19.520150 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.520086    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv" podStartSLOduration=394.464475835 podStartE2EDuration="6m40.520067031s" totalImagesPullingTime="6.055591196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:37:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:19.401301293 +0000 UTC m=+41.063119124" watchObservedRunningTime="2026-10-30 21:44:19.520067031 +0000 UTC m=+41.181884868"
Oct 30 21:44:19.724431 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.724378    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:19.982378 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:19.982344    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:20.006545 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.006520    2574 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-cgx2d"]
Oct 30 21:44:20.036112 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.036092    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cgx2d"
Oct 30 21:44:20.067163 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.067139    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-cgx2d"]
Oct 30 21:44:20.068262 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.068234    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-ghx6v" event={"ID":"0d921c53-691c-4969-bdd4-f7b87db0e61b","Type":"ContainerStarted","Data":"2182fb3359c7dd8d39d335a80e9f0ac3d42478e08c7c9ccfa73a42edb27a4f6e"}
Oct 30 21:44:20.073220 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.070711    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r54tb" event={"ID":"ec41ebc2-3ff6-4453-8eb4-c420b02516c2","Type":"ContainerStarted","Data":"7dd2041a687c534de66a68c265b013cb1ffa9acc68dfeb935815d79fb7c0cb33"}
Oct 30 21:44:20.073220 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.072444    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/1.log"
Oct 30 21:44:20.073220 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.073023    2574 scope.go:122] "RemoveContainer" containerID="2c4a7ffe669b4633bcf7d93de74dd03f8fc10084061b3cbf465faea71f0467cd"
Oct 30 21:44:20.073220 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:20.073163    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8hc58_openshift-console-operator(18b98618-898b-4a48-bb05-51e61ca7fe0a)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58" podUID="18b98618-898b-4a48-bb05-51e61ca7fe0a"
Oct 30 21:44:20.087294 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.087273    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37575185-c078-4be7-afa9-f7f860f29d49-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:20.087387 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.087309    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:20.087387 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.087338    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n29gb\" (UniqueName: \"kubernetes.io/projected/008b8a95-23ad-416e-ba30-39b63495f28d-kube-api-access-n29gb\") pod \"migrator-66df5d496b-cgx2d\" (UID: \"008b8a95-23ad-416e-ba30-39b63495f28d\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cgx2d"
Oct 30 21:44:20.087473 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:20.087411    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:44:20.087473 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:20.087460    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/37575185-c078-4be7-afa9-f7f860f29d49-kube-rbac-proxy-cm podName:37575185-c078-4be7-afa9-f7f860f29d49 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:22.087447159 +0000 UTC m=+43.749264983 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/37575185-c078-4be7-afa9-f7f860f29d49-kube-rbac-proxy-cm") pod "insights-runtime-extractor-48xwh" (UID: "37575185-c078-4be7-afa9-f7f860f29d49") : configmap "kube-rbac-proxy" not found
Oct 30 21:44:20.087583 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:20.087534    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:44:20.087583 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:20.087576    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls podName:37575185-c078-4be7-afa9-f7f860f29d49 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:22.08756241 +0000 UTC m=+43.749380225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls") pod "insights-runtime-extractor-48xwh" (UID: "37575185-c078-4be7-afa9-f7f860f29d49") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:44:20.087899 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.087880    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 21:44:20.087976 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.087948    2574 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sqd9j\""
Oct 30 21:44:20.087976 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.087957    2574 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 21:44:20.189708 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.189185    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n29gb\" (UniqueName: \"kubernetes.io/projected/008b8a95-23ad-416e-ba30-39b63495f28d-kube-api-access-n29gb\") pod \"migrator-66df5d496b-cgx2d\" (UID: \"008b8a95-23ad-416e-ba30-39b63495f28d\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cgx2d"
Oct 30 21:44:20.238827 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.238701    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:20.249966 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.249943    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n29gb\" (UniqueName: \"kubernetes.io/projected/008b8a95-23ad-416e-ba30-39b63495f28d-kube-api-access-n29gb\") pod \"migrator-66df5d496b-cgx2d\" (UID: \"008b8a95-23ad-416e-ba30-39b63495f28d\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cgx2d"
Oct 30 21:44:20.268618 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.268569    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-ghx6v" podStartSLOduration=369.695496259 podStartE2EDuration="6m17.268553835s" totalImagesPullingTime="7.573057576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:20.268405865 +0000 UTC m=+41.930223700" watchObservedRunningTime="2026-10-30 21:44:20.268553835 +0000 UTC m=+41.930371671"
Oct 30 21:44:20.360611 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.360580    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cgx2d"
Oct 30 21:44:20.509115 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.509053    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:20.780809 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.780732    2574 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-cgx2d"]
Oct 30 21:44:20.784592 ip-10-0-142-154 kubenswrapper[2574]: W1030 21:44:20.784563    2574 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod008b8a95_23ad_416e_ba30_39b63495f28d.slice/crio-4d3f188bedb824656ae84c5fdeeccb6bb73d25ba47c2576415af687a9b5672b5 WatchSource:0}: Error finding container 4d3f188bedb824656ae84c5fdeeccb6bb73d25ba47c2576415af687a9b5672b5: Status 404 returned error can't find the container with id 4d3f188bedb824656ae84c5fdeeccb6bb73d25ba47c2576415af687a9b5672b5
Oct 30 21:44:20.907233 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:20.907199    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:21.082057 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:21.081976    2574 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cgx2d" event={"ID":"008b8a95-23ad-416e-ba30-39b63495f28d","Type":"ContainerStarted","Data":"4d3f188bedb824656ae84c5fdeeccb6bb73d25ba47c2576415af687a9b5672b5"}
Oct 30 21:44:21.082518 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:21.082294    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:44:21.208616 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:21.208572    2574 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r54tb" podStartSLOduration=34.597557208 podStartE2EDuration="41.208557722s" totalImagesPullingTime="6.611000514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:21.207204824 +0000 UTC m=+42.869022661" watchObservedRunningTime="2026-10-30 21:44:21.208557722 +0000 UTC m=+42.870375553"
Oct 30 21:44:21.235813 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:21.235754    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:21.523116 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:21.523090    2574 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:21.523245 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:21.523140    2574 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:21.523416 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:21.523405    2574 scope.go:122] "RemoveContainer" containerID="2c4a7ffe669b4633bcf7d93de74dd03f8fc10084061b3cbf465faea71f0467cd"
Oct 30 21:44:21.523566 ip-10-0-142-154 kubenswrapper[2574]: E1030 21:44:21.523550    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8hc58_openshift-console-operator(18b98618-898b-4a48-bb05-51e61ca7fe0a)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58" podUID="18b98618-898b-4a48-bb05-51e61ca7fe0a"
Oct 30 21:44:21.531839 ip-10-0-142-154 kubenswrapper[2574]: I1030 21:44:21.531812    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:21.862636 ip-10-0-142-154 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 21:44:21.879166 ip-10-0-142-154 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 21:44:21.879353 ip-10-0-142-154 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 21:44:21.879407 ip-10-0-142-154 systemd[1]: kubelet.service: Consumed 2.986s CPU time.
Oct 30 21:44:21.890114 ip-10-0-142-154 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 21:44:21.979957 ip-10-0-142-154 kubenswrapper[4918]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:44:21.979957 ip-10-0-142-154 kubenswrapper[4918]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 21:44:21.979957 ip-10-0-142-154 kubenswrapper[4918]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:44:21.980288 ip-10-0-142-154 kubenswrapper[4918]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:44:21.982198 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982128    4918 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:44:21.982198 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982199    4918 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982203    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982206    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982209    4918 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982212    4918 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982215    4918 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982217    4918 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982221    4918 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982223    4918 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982226    4918 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982229    4918 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982231    4918 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982234    4918 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982237    4918 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982239    4918 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982241    4918 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982244    4918 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982246    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982249    4918 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982252    4918 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:44:21.982265 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982255    4918 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982258    4918 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982260    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982263    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982265    4918 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982268    4918 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982271    4918 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982274    4918 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982277    4918 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982287    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982290    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982294    4918 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982299    4918 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982302    4918 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982306    4918 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982309    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982312    4918 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982314    4918 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982316    4918 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:44:21.982782 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982319    4918 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982321    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982324    4918 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982326    4918 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982329    4918 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982331    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982334    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982336    4918 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982339    4918 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982342    4918 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982344    4918 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982346    4918 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982350    4918 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982354    4918 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982358    4918 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982361    4918 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982364    4918 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982366    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982369    4918 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:44:21.983228 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982371    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982374    4918 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982377    4918 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982379    4918 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982382    4918 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982385    4918 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982387    4918 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982390    4918 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982392    4918 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982395    4918 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982397    4918 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982400    4918 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982402    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982405    4918 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982407    4918 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982409    4918 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982412    4918 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982415    4918 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982418    4918 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982421    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:44:21.983693 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982423    4918 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982425    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982437    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982440    4918 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982443    4918 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982445    4918 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982448    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982450    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982453    4918 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982455    4918 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982458    4918 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982461    4918 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982463    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982466    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982469    4918 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982471    4918 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982473    4918 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982476    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982478    4918 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:44:21.984159 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982481    4918 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982483    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982485    4918 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982488    4918 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982491    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982499    4918 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982502    4918 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.982504    4918 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983325    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983332    4918 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983336    4918 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983339    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983342    4918 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983345    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983347    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983350    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983359    4918 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983363    4918 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983365    4918 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983368    4918 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:44:21.984620 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983370    4918 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983373    4918 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983375    4918 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983377    4918 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983380    4918 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983382    4918 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983385    4918 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983388    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983390    4918 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983393    4918 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983395    4918 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983398    4918 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983400    4918 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983402    4918 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983405    4918 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983407    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983410    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983412    4918 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983414    4918 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:44:21.985122 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983417    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983419    4918 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983422    4918 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983424    4918 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983426    4918 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983429    4918 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983431    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983434    4918 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983437    4918 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983439    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983449    4918 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983453    4918 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983457    4918 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983461    4918 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983464    4918 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983467    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983470    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983473    4918 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983475    4918 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:44:21.985561 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983483    4918 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983486    4918 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983488    4918 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983491    4918 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983495    4918 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983497    4918 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983500    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983502    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983505    4918 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983507    4918 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983510    4918 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983512    4918 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983514    4918 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983517    4918 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983519    4918 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983523    4918 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983526    4918 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983529    4918 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983532    4918 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983534    4918 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:44:21.986070 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983536    4918 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983541    4918 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983544    4918 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983547    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983555    4918 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983558    4918 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983560    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983563    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983565    4918 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983567    4918 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983570    4918 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983572    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983575    4918 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983577    4918 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983580    4918 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983582    4918 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983585    4918 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983587    4918 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983590    4918 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983592    4918 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:44:21.986549 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983594    4918 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983597    4918 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983599    4918 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983602    4918 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983604    4918 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983607    4918 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983611    4918 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983613    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983616    4918 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983618    4918 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983620    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983623    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983625    4918 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983629    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983632    4918 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.983634    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984194    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984201    4918 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984204    4918 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:44:21.987050 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984207    4918 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984210    4918 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984212    4918 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984215    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984217    4918 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984220    4918 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984222    4918 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984225    4918 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984228    4918 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984230    4918 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984233    4918 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984235    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984238    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984241    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984243    4918 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984246    4918 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984248    4918 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984251    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984254    4918 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984256    4918 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:44:21.987491 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984259    4918 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984261    4918 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984264    4918 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984266    4918 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984269    4918 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984273    4918 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984277    4918 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984280    4918 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984282    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984285    4918 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984293    4918 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984296    4918 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984711    4918 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984723    4918 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984730    4918 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984735    4918 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984739    4918 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984744    4918 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984748    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:44:21.987975 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984752    4918 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984756    4918 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984760    4918 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984764    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984769    4918 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984773    4918 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984777    4918 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984781    4918 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984785    4918 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984789    4918 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984794    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984799    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984803    4918 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984807    4918 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984811    4918 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984815    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984820    4918 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984824    4918 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984827    4918 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984831    4918 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:44:21.988445 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984835    4918 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984839    4918 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984844    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984848    4918 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984861    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984866    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984870    4918 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984876    4918 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984882    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984886    4918 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984891    4918 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984895    4918 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984899    4918 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984904    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984908    4918 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984912    4918 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984916    4918 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984920    4918 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984932    4918 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:44:21.988966 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984936    4918 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984940    4918 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984944    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984949    4918 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984953    4918 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984957    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984961    4918 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984965    4918 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984969    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984974    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984978    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984983    4918 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984987    4918 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984991    4918 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.984996    4918 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985000    4918 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985005    4918 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985009    4918 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985023    4918 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:44:21.989410 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985027    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985031    4918 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985035    4918 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985041    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985046    4918 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985050    4918 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985181    4918 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985189    4918 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985199    4918 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985203    4918 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985207    4918 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985211    4918 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985215    4918 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985219    4918 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985222    4918 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985225    4918 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985228    4918 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985231    4918 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985234    4918 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985237    4918 flags.go:64] FLAG: --cgroup-root=""
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985240    4918 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985243    4918 flags.go:64] FLAG: --client-ca-file=""
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985248    4918 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 21:44:21.989902 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985251    4918 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985257    4918 flags.go:64] FLAG: --cluster-domain=""
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985260    4918 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985263    4918 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985266    4918 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985269    4918 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985273    4918 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985275    4918 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985279    4918 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985288    4918 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985291    4918 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985294    4918 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985297    4918 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985300    4918 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985302    4918 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985307    4918 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985309    4918 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985312    4918 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985315    4918 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985318    4918 flags.go:64] FLAG: --enable-server="true"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985321    4918 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985328    4918 flags.go:64] FLAG: --event-burst="100"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985331    4918 flags.go:64] FLAG: --event-qps="50"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985333    4918 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 21:44:21.990474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985336    4918 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985339    4918 flags.go:64] FLAG: --eviction-hard=""
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985343    4918 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985346    4918 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985350    4918 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985353    4918 flags.go:64] FLAG: --eviction-soft=""
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985356    4918 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985361    4918 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985364    4918 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985367    4918 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985369    4918 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985372    4918 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985375    4918 flags.go:64] FLAG: --feature-gates=""
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985379    4918 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985382    4918 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985385    4918 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985388    4918 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985391    4918 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985399    4918 flags.go:64] FLAG: --help="false"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985402    4918 flags.go:64] FLAG: --hostname-override="ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985405    4918 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985408    4918 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985411    4918 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 21:44:21.991135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985415    4918 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985418    4918 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985420    4918 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985423    4918 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985426    4918 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985429    4918 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985432    4918 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985435    4918 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985437    4918 flags.go:64] FLAG: --kube-reserved=""
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985440    4918 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985443    4918 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985446    4918 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985448    4918 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985452    4918 flags.go:64] FLAG: --lock-file=""
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985455    4918 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985458    4918 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985464    4918 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985470    4918 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985472    4918 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985475    4918 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985478    4918 flags.go:64] FLAG: --logging-format="text"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985481    4918 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985484    4918 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985487    4918 flags.go:64] FLAG: --manifest-url=""
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985490    4918 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 21:44:21.991757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985494    4918 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985497    4918 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985501    4918 flags.go:64] FLAG: --max-pods="110"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985509    4918 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985512    4918 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985515    4918 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985518    4918 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985521    4918 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985523    4918 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985526    4918 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985533    4918 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985536    4918 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985539    4918 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985542    4918 flags.go:64] FLAG: --pod-cidr=""
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985544    4918 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985548    4918 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985551    4918 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985553    4918 flags.go:64] FLAG: --port="10250"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985556    4918 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985559    4918 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0c8b9cf9e79a72622"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985566    4918 flags.go:64] FLAG: --qos-reserved=""
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985570    4918 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985573    4918 flags.go:64] FLAG: --register-node="true"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985577    4918 flags.go:64] FLAG: --register-with-taints=""
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985581    4918 flags.go:64] FLAG: --registry-burst="10"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985584    4918 flags.go:64] FLAG: --registry-qps="5"
Oct 30 21:44:21.992351 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985586    4918 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985589    4918 flags.go:64] FLAG: --reserved-memory=""
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985593    4918 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985596    4918 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985599    4918 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985602    4918 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985604    4918 flags.go:64] FLAG: --runonce="false"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985607    4918 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985610    4918 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985613    4918 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985621    4918 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985624    4918 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985628    4918 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985630    4918 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985633    4918 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985636    4918 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985639    4918 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985642    4918 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985645    4918 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985648    4918 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985650    4918 flags.go:64] FLAG: --system-cgroups=""
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985653    4918 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985658    4918 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985661    4918 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985664    4918 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 21:44:21.993059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985671    4918 flags.go:64] FLAG: --tls-min-version=""
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985674    4918 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985694    4918 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985699    4918 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985705    4918 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985708    4918 flags.go:64] FLAG: --v="2"
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985712    4918 flags.go:64] FLAG: --version="false"
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985716    4918 flags.go:64] FLAG: --vmodule=""
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985720    4918 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.985723    4918 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985888    4918 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985892    4918 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985895    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985898    4918 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985901    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985903    4918 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985906    4918 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985909    4918 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985917    4918 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985920    4918 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985922    4918 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:44:21.993788 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985925    4918 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985927    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985930    4918 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985933    4918 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985936    4918 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985939    4918 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985942    4918 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985944    4918 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985947    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985949    4918 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985952    4918 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985954    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985958    4918 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985961    4918 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985964    4918 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985968    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985970    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985973    4918 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:44:21.994562 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985976    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985980    4918 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985984    4918 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985987    4918 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985990    4918 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985993    4918 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985995    4918 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.985998    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986000    4918 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986003    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986005    4918 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986008    4918 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986011    4918 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986014    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986016    4918 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986019    4918 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986021    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986023    4918 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986026    4918 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:44:21.995279 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986028    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986031    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986033    4918 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986036    4918 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986038    4918 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986041    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986043    4918 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986047    4918 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986049    4918 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986051    4918 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986055    4918 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986058    4918 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986060    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986063    4918 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986065    4918 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986068    4918 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986070    4918 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986073    4918 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986075    4918 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986078    4918 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:44:21.996076 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986081    4918 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986083    4918 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986086    4918 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986089    4918 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986091    4918 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986093    4918 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986097    4918 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986100    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986102    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986105    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986107    4918 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986110    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986112    4918 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986115    4918 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986117    4918 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986119    4918 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986122    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986124    4918 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986126    4918 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986130    4918 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:44:21.996851 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986132    4918 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986135    4918 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986138    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986141    4918 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986143    4918 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986146    4918 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986149    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986151    4918 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986154    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986156    4918 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986159    4918 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986161    4918 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986164    4918 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986166    4918 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986168    4918 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986171    4918 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986173    4918 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:44:21.997404 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986176    4918 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:44:21.998035 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.986201    4918 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:44:21.998035 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986239    4918 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:44:21.998035 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986243    4918 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:44:21.998035 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986246    4918 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:44:21.998035 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986249    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:44:21.998035 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986252    4918 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:44:21.998035 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986254    4918 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:44:21.998035 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986257    4918 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:44:21.998035 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986259    4918 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:44:21.998035 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986262    4918 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:44:21.998035 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986264    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:44:21.998035 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986267    4918 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:44:21.998035 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986269    4918 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:44:21.998035 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986273    4918 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:44:21.998035 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986276    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:44:21.998035 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986279    4918 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986282    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986285    4918 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986288    4918 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986290    4918 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986293    4918 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986295    4918 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986298    4918 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986300    4918 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986302    4918 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986305    4918 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986307    4918 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986310    4918 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986312    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986314    4918 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986317    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986320    4918 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986322    4918 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986324    4918 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:44:21.998475 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986327    4918 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986330    4918 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986332    4918 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986335    4918 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986337    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986340    4918 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986344    4918 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986347    4918 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986350    4918 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986353    4918 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986355    4918 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986359    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986361    4918 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986364    4918 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986366    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986370    4918 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986372    4918 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986375    4918 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986377    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:44:21.999016 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986380    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986383    4918 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986385    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986389    4918 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986393    4918 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986396    4918 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986398    4918 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986401    4918 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986403    4918 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986406    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986408    4918 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986411    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986413    4918 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986415    4918 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986418    4918 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986421    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986423    4918 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986425    4918 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986428    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986430    4918 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:44:21.999518 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986433    4918 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986435    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986438    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986440    4918 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986444    4918 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986447    4918 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986449    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986452    4918 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986455    4918 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986457    4918 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986460    4918 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986462    4918 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986465    4918 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986467    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986470    4918 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986472    4918 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986474    4918 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986477    4918 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986479    4918 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986481    4918 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:44:22.000098 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986484    4918 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986487    4918 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986489    4918 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986492    4918 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986494    4918 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986497    4918 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986502    4918 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986513    4918 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986517    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986519    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986522    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986524    4918 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986527    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.986529    4918 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.990260    4918 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.990278    4918 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.990304    4918 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.990310    4918 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990392    4918 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990398    4918 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:44:22.000607 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990402    4918 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990407    4918 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990411    4918 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990416    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990420    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990423    4918 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990427    4918 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990432    4918 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990436    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990441    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990447    4918 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990451    4918 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990455    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990460    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990464    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990468    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990472    4918 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990477    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990482    4918 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:44:22.001107 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990485    4918 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990488    4918 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990491    4918 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990493    4918 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990496    4918 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990498    4918 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990501    4918 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990503    4918 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990507    4918 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990510    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990513    4918 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990515    4918 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990518    4918 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990521    4918 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990525    4918 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990529    4918 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990533    4918 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990538    4918 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990540    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990543    4918 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:44:22.001559 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990545    4918 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990548    4918 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990550    4918 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990553    4918 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990555    4918 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990558    4918 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990560    4918 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990563    4918 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990566    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990568    4918 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990571    4918 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990573    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990575    4918 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990578    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990580    4918 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990583    4918 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990585    4918 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990588    4918 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990590    4918 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:44:22.002097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990593    4918 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990596    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990599    4918 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990601    4918 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990604    4918 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990606    4918 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990609    4918 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990611    4918 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990614    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990616    4918 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990620    4918 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990623    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990626    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990629    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990632    4918 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990634    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990636    4918 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990639    4918 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990641    4918 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:44:22.002532 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990644    4918 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990646    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990649    4918 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990651    4918 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990654    4918 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990656    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990658    4918 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990661    4918 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990663    4918 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990665    4918 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990668    4918 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990670    4918 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990674    4918 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990697    4918 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990700    4918 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990703    4918 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990707    4918 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990709    4918 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990712    4918 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:44:22.002996 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990714    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:44:22.003436 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990717    4918 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:44:22.003436 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990719    4918 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:44:22.003436 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990722    4918 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:44:22.003436 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990724    4918 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:44:22.003436 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990727    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:44:22.003436 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990729    4918 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:44:22.003436 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990731    4918 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:44:22.003436 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.990760    4918 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:44:22.003436 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990914    4918 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:44:22.003436 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990919    4918 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:44:22.003436 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990922    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:44:22.003436 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990924    4918 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:44:22.003436 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990926    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:44:22.003436 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990929    4918 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:44:22.003436 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990931    4918 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990934    4918 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990936    4918 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990939    4918 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990941    4918 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990944    4918 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990946    4918 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990949    4918 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990951    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990954    4918 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990956    4918 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990959    4918 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990961    4918 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990964    4918 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990966    4918 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990969    4918 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990972    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990974    4918 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990977    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990979    4918 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:44:22.003817 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990982    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990984    4918 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990986    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990989    4918 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990991    4918 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990994    4918 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990996    4918 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.990999    4918 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991001    4918 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991004    4918 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991006    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991009    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991011    4918 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991014    4918 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991016    4918 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991018    4918 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991021    4918 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991023    4918 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991025    4918 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991028    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:44:22.004293 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991030    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991033    4918 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991036    4918 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991038    4918 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991040    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991044    4918 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991047    4918 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991050    4918 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991060    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991063    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991065    4918 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991067    4918 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991070    4918 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991072    4918 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991075    4918 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991077    4918 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991080    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991082    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991085    4918 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991087    4918 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:44:22.004779 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991090    4918 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991092    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991095    4918 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991098    4918 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991100    4918 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991102    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991105    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991107    4918 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991109    4918 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991117    4918 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991120    4918 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991122    4918 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991125    4918 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991127    4918 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991130    4918 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991132    4918 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991135    4918 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991137    4918 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991140    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:44:22.005254 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991144    4918 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991147    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991156    4918 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991159    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991162    4918 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991165    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991167    4918 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991170    4918 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991172    4918 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991174    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991177    4918 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991180    4918 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991182    4918 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991185    4918 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991187    4918 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991189    4918 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991192    4918 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991194    4918 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991197    4918 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:44:22.005825 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991199    4918 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:44:22.006287 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991201    4918 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:44:22.006287 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.991224    4918 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:44:22.006287 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991259    4918 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:44:22.006287 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991263    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:44:22.006287 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991266    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:44:22.006287 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991268    4918 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:44:22.006287 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991271    4918 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:44:22.006287 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991273    4918 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:44:22.006287 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991276    4918 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:44:22.006287 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991278    4918 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:44:22.006287 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991280    4918 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:44:22.006287 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991283    4918 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:44:22.006287 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991285    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:44:22.006287 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991287    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:44:22.006287 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991290    4918 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:44:22.006287 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991297    4918 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991300    4918 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991302    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991306    4918 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991310    4918 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991313    4918 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991315    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991318    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991320    4918 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991323    4918 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991325    4918 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991327    4918 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991330    4918 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991332    4918 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991335    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991337    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991342    4918 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991345    4918 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991347    4918 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:44:22.006660 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991350    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991352    4918 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991355    4918 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991357    4918 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991360    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991362    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991365    4918 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991367    4918 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991370    4918 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991372    4918 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991376    4918 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991378    4918 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991381    4918 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991383    4918 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991391    4918 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991394    4918 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991396    4918 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991398    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991402    4918 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:44:22.007206 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991406    4918 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991409    4918 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991411    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991414    4918 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991416    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991419    4918 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991421    4918 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991424    4918 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991426    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991429    4918 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991433    4918 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991435    4918 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991438    4918 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991440    4918 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991443    4918 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991445    4918 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991448    4918 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991450    4918 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991453    4918 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991455    4918 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:44:22.007653 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991458    4918 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991460    4918 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991463    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991467    4918 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991469    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991472    4918 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991474    4918 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991477    4918 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991484    4918 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991487    4918 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991490    4918 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991492    4918 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991495    4918 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991497    4918 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991499    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991502    4918 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991505    4918 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991507    4918 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991510    4918 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:44:22.008151 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991512    4918 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991515    4918 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991517    4918 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991521    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991523    4918 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991525    4918 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991528    4918 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991530    4918 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991533    4918 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991535    4918 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991538    4918 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991540    4918 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991543    4918 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991545    4918 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991548    4918 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:21.991551    4918 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.991600    4918 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.992545    4918 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.992603    4918 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 21:44:22.008635 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.992819    4918 server.go:1014] "Starting client certificate rotation"
Oct 30 21:44:22.009096 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.992957    4918 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:44:22.009096 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.993000    4918 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:38:39 +0000 UTC" deadline="2028-06-09 11:39:12.598185071 +0000 UTC"
Oct 30 21:44:22.009096 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.993063    4918 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14101h54m50.605123334s"
Oct 30 21:44:22.009096 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.993360    4918 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:44:22.009096 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.996329    4918 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:44:22.009096 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.997528    4918 log.go:25] "Validated CRI v1 runtime API"
Oct 30 21:44:22.009096 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.999174    4918 log.go:25] "Validated CRI v1 image API"
Oct 30 21:44:22.009096 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:21.999849    4918 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 21:44:22.009096 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.001619    4918 fs.go:135] Filesystem UUIDs: map[466e2c41-e43e-4db4-ab45-6fa1f1367a8f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f2d0958a-194e-4d8d-9845-412d9e8b04cd:/dev/nvme0n1p3]
Oct 30 21:44:22.009333 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.001639    4918 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/00c2fc719980d06fbe5338968f08435f860b36c6b55a3d672bc1f8f2ddb4d702/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/00c2fc719980d06fbe5338968f08435f860b36c6b55a3d672bc1f8f2ddb4d702/userdata/shm major:0 minor:248 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/032a97f4ff580cb0b89424ca7b9d6de6f73a32b13d2da0e14973265816231e58/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/032a97f4ff580cb0b89424ca7b9d6de6f73a32b13d2da0e14973265816231e58/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0bdfed7799032034feb774cc9987d238deff6e8b39b33865a3765a1bc6514d9b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0bdfed7799032034feb774cc9987d238deff6e8b39b33865a3765a1bc6514d9b/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/108f8f98f88f9573dd71c80539ca3c275c5b0ddc0c6b150a40c7e0d092ffb173/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/108f8f98f88f9573dd71c80539ca3c275c5b0ddc0c6b150a40c7e0d092ffb173/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/17ea496d2bef069555b5a45bce6d506e43f1e5bd63786d1810fe615d8e65c1f8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/17ea496d2bef069555b5a45bce6d506e43f1e5bd63786d1810fe615d8e65c1f8/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1e16d817ad0d9e0bf239b4f985344bd17e9f519b7afc5685c60613d7609868c9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1e16d817ad0d9e0bf239b4f985344bd17e9f519b7afc5685c60613d7609868c9/userdata/shm major:0 minor:290 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/210bf3ffbd69f859eb0a7c0fece8dbfb64f9a1576b63c260f374e9cd4286d3e8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/210bf3ffbd69f859eb0a7c0fece8dbfb64f9a1576b63c260f374e9cd4286d3e8/userdata/shm major:0 minor:252 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3272ae76cd49213018fdf91d4cecc7a6bf47da3a1b787122b86f5c7a4fae7938/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3272ae76cd49213018fdf91d4cecc7a6bf47da3a1b787122b86f5c7a4fae7938/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4d3f188bedb824656ae84c5fdeeccb6bb73d25ba47c2576415af687a9b5672b5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4d3f188bedb824656ae84c5fdeeccb6bb73d25ba47c2576415af687a9b5672b5/userdata/shm major:0 minor:340 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/54618a48223180f91a3942925ae0c744fc44b0ed2b84822fe15e7056016196bc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/54618a48223180f91a3942925ae0c744fc44b0ed2b84822fe15e7056016196bc/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/573e2380204b11176ea87e4994cbe3436664fed46aba7036ddf7ed01404b24cb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/573e2380204b11176ea87e4994cbe3436664fed46aba7036ddf7ed01404b24cb/userdata/shm major:0 minor:79 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/62ec01ac891fc45a2e052298f4b7686ccca67649c33cdde0f76b8a08411363cc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/62ec01ac891fc45a2e052298f4b7686ccca67649c33cdde0f76b8a08411363cc/userdata/shm major:0 minor:211 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/650ca8e18a3eaae136cb3e0e0cd4aed0964cdf2030737442b21c9919c02e9a4b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/650ca8e18a3eaae136cb3e0e0cd4aed0964cdf2030737442b21c9919c02e9a4b/userdata/shm major:0 minor:213 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/74e6709ea0288c88f4d7cf3508517260c3e2cb1c5347f937f09e5969b84bd434/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/74e6709ea0288c88f4d7cf3508517260c3e2cb1c5347f937f09e5969b84bd434/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7b962b1196c00206a6b9bbf0362de72844d5b2f7e0e815c5ca713f5daa682bcb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7b962b1196c00206a6b9bbf0362de72844d5b2f7e0e815c5ca713f5daa682bcb/userdata/shm major:0 minor:287 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/96b35a47e253ba97607c370162084e2df6934f3deaabfc1051448ce70ec5346f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/96b35a47e253ba97607c370162084e2df6934f3deaabfc1051448ce70ec5346f/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a9925d2a0152b4eb2e6974f20c8ef6b56811626fff9439fb873a0fe88968f8ab/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a9925d2a0152b4eb2e6974f20c8ef6b56811626fff9439fb873a0fe88968f8ab/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ab944082c2d29e0c693bd7f6c07e974045fe66eb23f6823933e80e3dc1f2f3b8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ab944082c2d29e0c693bd7f6c07e974045fe66eb23f6823933e80e3dc1f2f3b8/userdata/shm major:0 minor:85 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ad9e9b3612a0b02cf8902f3a225470be4fb1ae7b0d22dfb200d739602c145f3b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ad9e9b3612a0b02cf8902f3a225470be4fb1ae7b0d22dfb200d739602c145f3b/userdata/shm major:0 minor:250 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d58df008cc31f0fc5ada3bd63593725e12bfa186173287452d0e498b920a825c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d58df008cc31f0fc5ada3bd63593725e12bfa186173287452d0e498b920a825c/userdata/shm major:0 minor:251 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/dbceb973a6721ddaedb19d6a3fbb2091c905931770de353f416cf68decc079c6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/dbceb973a6721ddaedb19d6a3fbb2091c905931770de353f416cf68decc079c6/userdata/shm major:0 minor:222 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e390bf6da2c4105107855636df5aee61ee7f4880bc0d35ab40e0ba6b6861a92b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e390bf6da2c4105107855636df5aee61ee7f4880bc0d35ab40e0ba6b6861a92b/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f4cd8abff3569d0c4b364ff41564c305e3e6841d4282effa4ee873483561548e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f4cd8abff3569d0c4b364ff41564c305e3e6841d4282effa4ee873483561548e/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/008b8a95-23ad-416e-ba30-39b63495f28d/volumes/kubernetes.io~projected/kube-api-access-n29gb:{mountpoint:/var/lib/kubelet/pods/008b8a95-23ad-416e-ba30-39b63495f28d/volumes/kubernetes.io~projected/kube-api-access-n29gb major:0 minor:335 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03c4973c-9623-4cb4-a239-efdae2ff0b90/volumes/kubernetes.io~projected/kube-api-access-zccg7:{mountpoint:/var/lib/kubelet/pods/03c4973c-9623-4cb4-a239-efdae2ff0b90/volumes/kubernetes.io~projected/kube-api-access-zccg7 major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8/volumes/kubernetes.io~projected/kube-api-access-2n6jd:{mountpoint:/var/lib/kubelet/pods/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8/volumes/kubernetes.io~projected/kube-api-access-2n6jd major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8/volumes/kubernetes.io~secret/serving-cert major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0d921c53-691c-4969-bdd4-f7b87db0e61b/volumes/kubernetes.io~projected/kube-api-access-zdwl5:{mountpoint:/var/lib/kubelet/pods/0d921c53-691c-4969-bdd4-f7b87db0e61b/volumes/kubernetes.io~projected/kube-api-access-zdwl5 major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0df7f3e5-6d57-46f7-a23b-fd130d949fe2/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/0df7f3e5-6d57-46f7-a23b-fd130d949fe2/volumes/kubernetes.io~secret/agent-certs major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/186ffaf9-fc18-4605-9c8c-c9c31bda5379/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/186ffaf9-fc18-4605-9c8c-c9c31bda5379/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/186ffaf9-fc18-4605-9c8c-c9c31bda5379/volumes/kubernetes.io~projected/kube-api-access-pspz2:{mountpoint:/var/lib/kubelet/pods/186ffaf9-fc18-4605-9c8c-c9c31bda5379/volumes/kubernetes.io~projected/kube-api-access-pspz2 major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/186ffaf9-fc18-4605-9c8c-c9c31bda5379/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/186ffaf9-fc18-4605-9c8c-c9c31bda5379/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/186ffaf9-fc18-4605-9c8c-c9c31bda5379/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/186ffaf9-fc18-4605-9c8c-c9c31bda5379/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18b98618-898b-4a48-bb05-51e61ca7fe0a/volumes/kubernetes.io~projected/kube-api-access-h68gq:{mountpoint:/var/lib/kubelet/pods/18b98618-898b-4a48-bb05-51e61ca7fe0a/volumes/kubernetes.io~projected/kube-api-access-h68gq major:0 minor:228 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/18b98618-898b-4a48-bb05-51e61ca7fe0a/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/18b98618-898b-4a48-bb05-51e61ca7fe0a/volumes/kubernetes.io~secret/serving-cert major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/37575185-c078-4be7-afa9-f7f860f29d49/volumes/kubernetes.io~projected/kube-api-access-589gf:{mountpoint:/var/lib/kubelet/pods/37575185-c078-4be7-afa9-f7f860f29d49/volumes/kubernetes.io~projected/kube-api-access-589gf major:0 minor:304 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff/volumes/kubernetes.io~projected/kube-api-access-mrc2w:{mountpoint:/var/lib/kubelet/pods/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff/volumes/kubernetes.io~projected/kube-api-access-mrc2w major:0 minor:232 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5a9a228b-279e-4895-972f-dbd2de5a9304/volumes/kubernetes.io~projected/kube-api-access-mdnlt:{mountpoint:/var/lib/kubelet/pods/5a9a228b-279e-4895-972f-dbd2de5a9304/volumes/kubernetes.io~projected/kube-api-access-mdnlt major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6af24624-056b-44b8-bef3-8a894bf0078b/volumes/kubernetes.io~projected/kube-api-access-8nrnx:{mountpoint:/var/lib/kubelet/pods/6af24624-056b-44b8-bef3-8a894bf0078b/volumes/kubernetes.io~projected/kube-api-access-8nrnx major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b1746a5-d5b0-4786-908b-09797786de96/volumes/kubernetes.io~projected/kube-api-access-tm82w:{mountpoint:/var/lib/kubelet/pods/6b1746a5-d5b0-4786-908b-09797786de96/volumes/kubernetes.io~projected/kube-api-access-tm82w major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b1746a5-d5b0-4786-908b-09797786de96/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/6b1746a5-d5b0-4786-908b-09797786de96/volumes/kubernetes.io~secret/serving-cert major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d58dca9-093d-416e-b353-9e9b792d6c23/volumes/kubernetes.io~projected/kube-api-access-h9q2b:{mountpoint:/var/lib/kubelet/pods/6d58dca9-093d-416e-b353-9e9b792d6c23/volumes/kubernetes.io~projected/kube-api-access-h9q2b major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/795237f3-0ac3-4842-90f3-0378a80e5c33/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/795237f3-0ac3-4842-90f3-0378a80e5c33/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/795237f3-0ac3-4842-90f3-0378a80e5c33/volumes/kubernetes.io~projected/kube-api-access-fc9l8:{mountpoint:/var/lib/kubelet/pods/795237f3-0ac3-4842-90f3-0378a80e5c33/volumes/kubernetes.io~projected/kube-api-access-fc9l8 major:0 minor:231 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/795237f3-0ac3-4842-90f3-0378a80e5c33/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/795237f3-0ac3-4842-90f3-0378a80e5c33/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/795237f3-0ac3-4842-90f3-0378a80e5c33/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/795237f3-0ac3-4842-90f3-0378a80e5c33/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7e81cfe7-52d2-474c-8261-66ce6cf58945/volumes/kubernetes.io~projected/kube-api-access-f695b:{mountpoint:/var/lib/kubelet/pods/7e81cfe7-52d2-474c-8261-66ce6cf58945/volumes/kubernetes.io~projected/kube-api-access-f695b major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/877a7e09-3007-4c2a-97ef-690e99a27dc5/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/877a7e09-3007-4c2a-97ef-690e99a27dc5/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/877a7e09-3007-4c2a-97ef-690e99a27dc5/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/877a7e09-3007-4c2a-97ef-690e99a27dc5/volumes/kubernetes.io~empty-dir/tmp major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/877a7e09-3007-4c2a-97ef-690e99a27dc5/volumes/kubernetes.io~projected/kube-api-access-s68fv:{mountpoint:/var/lib/kubelet/pods/877a7e09-3007-4c2a-97ef-690e99a27dc5/volumes/kubernetes.io~projected/kube-api-access-s68fv major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/976afac6-c62a-4e90-aaa1-5cc80852e988/volumes/kubernetes.io~projected/kube-api-access-cq9cs:{mountpoint:/var/lib/kubelet/pods/976afac6-c62a-4e90-aaa1-5cc80852e988/volumes/kubernetes.io~projected/kube-api-access-cq9cs major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9b06a5cb-5c28-4146-bbea-bfbe2297136c/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/9b06a5cb-5c28-4146-bbea-bfbe2297136c/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a447a17d-b65e-40a2-b200-635ee45355ba/volumes/kubernetes.io~projected/kube-api-access-k7nrc:{mountpoint:/var/lib/kubelet/pods/a447a17d-b65e-40a2-b200-635ee45355ba/volumes/kubernetes.io~projected/kube-api-access-k7nrc major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4e14574-aa2d-4fc4-ba26-a07f4a669296/volumes/kubernetes.io~projected/kube-api-access-dh2dx:{mountpoint:/var/lib/kubelet/pods/a4e14574-aa2d-4fc4-ba26-a07f4a669296/volumes/kubernetes.io~projected/kube-api-access-dh2dx major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4e14574-aa2d-4fc4-ba26-a07f4a669296/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/a4e14574-aa2d-4fc4-ba26-a07f4a669296/volumes/kubernetes.io~secret/default-certificate major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4e14574-aa2d-4fc4-ba26-a07f4a669296/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/a4e14574-aa2d-4fc4-ba26-a07f4a669296/volumes/kubernetes.io~secret/stats-auth major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aab14d71-ddf4-41c6-80a8-70b258aee1d4/volumes/kubernetes.io~projected/kube-api-access-xblpt:{mountpoint:/var/lib/kubelet/pods/aab14d71-ddf4-41c6-80a8-70b258aee1d4/volumes/kubernetes.io~projected/kube-api-access-xblpt major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/add4a18a-fa1b-45c7-8719-2c88634c6488/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/add4a18a-fa1b-45c7-8719-2c88634c6488/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/add4a18a-fa1b-45c7-8719-2c88634c6488/volumes/kubernetes.io~projected/kube-api-access-nlbpz:{mountpoint:/var/lib/kubelet/pods/add4a18a-fa1b-45c7-8719-2c88634c6488/volumes/kubernetes.io~projected/kube-api-access-nlbpz major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/add4a18a-fa1b-45c7-8719-2c88634c6488/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/add4a18a-fa1b-45c7-8719-2c88634c6488/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9112244-9e99-4f1d-b2a5-576d56dc0718/volumes/kubernetes.io~projected/kube-api-access-d5w4l:{mountpoint:/var/lib/kubelet/pods/b9112244-9e99-4f1d-b2a5-576d56dc0718/volumes/kubernetes.io~projected/kube-api-access-d5w4l major:0 minor:229 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c28402b8-cc54-4896-955c-a0dc2d5e156d/volumes/kubernetes.io~projected/kube-api-access-gns8k:{mountpoint:/var/lib/kubelet/pods/c28402b8-cc54-4896-955c-a0dc2d5e156d/volumes/kubernetes.io~projected/kube-api-access-gns8k major:0 minor:233 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c28402b8-cc54-4896-955c-a0dc2d5e156d/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/c28402b8-cc54-4896-955c-a0dc2d5e156d/volumes/kubernetes.io~secret/serving-cert major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c4ffd66e-ea60-4d77-820e-2a8740fe9dff/volumes/kubernetes.io~projected/kube-api-access-mqzpn:{mountpoint:/var/lib/kubelet/pods/c4ffd66e-ea60-4d77-820e-2a8740fe9dff/volumes/kubernetes.io~projected/kube-api-access-mqzpn major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d03f7bd1-7d99-438a-aa20-e614e86c1235/volumes/kubernetes.io~projected/kube-api-access-pjrrb:{mountpoint:/var/lib/kubelet/pods/d03f7bd1-7d99-438a-aa20-e614e86c1235/volumes/kubernetes.io~projected/kube-api-access-pjrrb major:0 minor:235 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d03f7bd1-7d99-438a-aa20-e614e86c1235/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/d03f7bd1-7d99-438a-aa20-e614e86c1235/volumes/kubernetes.io~secret/cert major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e2357ae3-0e6b-427c-84f5-fda3350920c4/volumes/kubernetes.io~projected/kube-api-access-rnmdv:{mountpoint:/var/lib/kubelet/pods/e2357ae3-0e6b-427c-84f5-fda3350920c4/volumes/kubernetes.io~projected/kube-api-access-rnmdv major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ec41ebc2-3ff6-4453-8eb4-c420b02516c2/volumes/kubernetes.io~projected/kube-api-access-wwq8k:{mountpoint:/var/lib/kubelet/pods/ec41ebc2-3ff6-4453-8eb4-c420b02516c2/volumes/kubernetes.io~projected/kube-api-access-wwq8k major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1c0a201-8b48-44fb-b107-a5f2bb798235/volumes/kubernetes.io~projected/kube-api-access-j5zvx:{mountpoint:/var/lib/kubelet/pods/f1c0a201-8b48-44fb-b107-a5f2bb798235/volumes/kubernetes.io~projected/kube-api-access-j5zvx major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f3017ee4-5edc-43b8-ad16-107517393622/volumes/kubernetes.io~projected/kube-api-access-6bwj9:{mountpoint:/var/lib/kubelet/pods/f3017ee4-5edc-43b8-ad16-107517393622/volumes/kubernetes.io~projected/kube-api-access-6bwj9 major:0 minor:207 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/0be61f90ae99f74cba21d829ceb96669b0039f7a7ff657f8c0a684876ccc8f84/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/5d764bc685771a23fd3b256539a43de4c903e24061ede002cd192fe7c5874f39/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/4c7ef3e51d3326d170c0cf2e96311eb144604af70d470758446cef1be63a0f23/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/88bb2e6c91f2df0c4e1169b0fc370072cfe0ac8976dd186e23796af4daa59ea7/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/a6994c0deebce9585a4081b58e0df4658f92a9d06c9106d15497054e280584e0/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/02411c1db22aca7faed0de1e95e1e52de64b4360f4d947055073fa473a455206/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/9742acfa5f9f62b1e6a28680a82f0640dafb34f46ee0571f4b955636588f396e/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/317e549725c7f561896899ee29e1a71f8ed529ee4320b9934c0e13cd6484ab29/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/451a1d4021fac1ab2cf7184eb0383a5e7ac403b1afe87740841fcfc83a6b6c45/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/dd73cd1912041b359e7c9824806f45afce946513ec15cd8df27dea340242a5fe/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-140:{mountpoint:/var/lib/containers/storage/overlay/d777ee53d7e52a8a97f2e106868e1194e852c03bd990c261b0b46415fdb331b4/merged major:0 minor:140 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/acf2e8a25630598e093e1e7beaecae02dcc788728d7e2f6aace80ed40bfe11ce/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-149:{mountpoint:/var/lib/containers/storage/overlay/c8a99f0fe2fd5a788a7674385a1a6a622223d328482a5d8cda2a4b6aa2a6727e/merged major:0 minor:149 fsType:overlay blockSize:0} overlay_0-155:{mountpoint:/var/lib/containers/storage/overlay/9a8720eb61886c487f8849ef3ad3fecf5acf0d38960c1013efddbc712ef1730d/merged major:0 minor:155 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/a721b16a0ededf560c024b1980074e7c5b5b39f834be454a15127bc6550dc501/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/2bf8741be720bb8f49151add05ddb14e3acb3b4f1b392e175ba524bce59bfce0/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/35a3ebae6c444f2b9be5aa00fb95909e8f1eb1957aa4aef03d2e2a28a8f1c100/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/0bc85469dfcb70ccc9b8ae17e5b6cc5e2aeb3f5664abb74b73437ac95940afe4/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/ca46722d82eba6cdc2ef72dc62b12f4d27a0b9abe6d21aa01d9b0d8b35ffb250/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/0039c8a38c8f002f92a40a6a5830c632e90ab4084604eca372e947085a2cd865/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/093d0348135a1e1eff079e45153392aea2418404dbab18067830e801f52d2d4b/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-239:{mountpoint:/var/lib/containers/storage/overlay/c75a11db95b04479682dc58e3aa5d22e01b51daa4e5ad576f0faa3d108038196/merged major:0 minor:239 fsType:overlay blockSize:0} overlay_0-242:{mountpoint:/var/lib/containers/storage/overlay/eb81e1b43adcaf67e3f420483223a2331f475143ff1d484e61fcdc5873d33415/merged major:0 minor:242 fsType:overlay blockSize:0} overlay_0-244:{mountpoint:/var/lib/containers/storage/overlay/0e749d543e0b8c3cb740a6fde3564f3fe048dc3f31368a2341edf7988f324867/merged major:0 minor:244 fsType:overlay blockSize:0} overlay_0-246:{mountpoint:/var/lib/containers/storage/overlay/3e08365382d801771fa825392d80b6495d743c168426c19e46dde65252a844d7/merged major:0 minor:246 fsType:overlay blockSize:0} overlay_0-255:{mountpoint:/var/lib/containers/storage/overlay/7f4fa6dc1aeefb7d633438d3656487ab9e45289ed14fb6760717dc05af060383/merged major:0 minor:255 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/fda57d669cfdbdaf57dd7e7e57e72d74856e36a6e62dd6a4706ba52a0bb3460c/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/671729c6a8652c0d9a03f60bc3e85b4a5a6388c930c7dabf02b4b370f5815f6c/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/3be1a0047f287ae6cb9a231bceea2ab431a3c7dec3416405740ed60f5baed1d9/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-276:{mountpoint:/var/lib/containers/storage/overlay/db945913c336a2ef8e2df74d9eeaf1909958e3229703330dd070fe10edfb2a09/merged major:0 minor:276 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/9ea6a85a89115fd4e6b357a7bd35cd1e524a6e9117a6f0124feb7c2f2f4b1b4c/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-280:{mountpoint:/var/lib/containers/storage/overlay/ddd47211df9f3d83883ba9e199b0f8886533f6b294346c13b67ab48963da6eb9/merged major:0 minor:280 fsType:overlay blockSize:0} overlay_0-282:{mountpoint:/var/lib/containers/storage/overlay/5295d162556dc221e3008e3b9a2093d2f8c9c624da75ff02a2a2a1a6fa3e70b2/merged major:0 minor:282 fsType:overlay blockSize:0} overlay_0-284:{mountpoint:/var/lib/containers/storage/overlay/e4d4b093932dafc5f4d3a901aa65985f282787c235a7450885f525c458a890d3/merged major:0 minor:284 fsType:overlay blockSize:0} overlay_0-292:{mountpoint:/var/lib/containers/storage/overlay/b7ad31cfdab5b0eaaf367d76c34af2cc45610d0e056cef39e4c6bb0c36ff58a5/merged major:0 minor:292 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/e609c9fe87c59e7e1589be6f73eb12d619f4c830e2bd664ef8fb02450676b597/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-296:{mountpoint:/var/lib/containers/storage/overlay/84176dfd3d05621bfc53c5d411a9e5cc3be37cc93d52c0218ed5e6a6200dbc29/merged major:0 minor:296 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/8bf64c84d6f2e089f27745bf46582183ed04a8ef0e743e98ce3f49bf0902a6db/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-309:{mountpoint:/var/lib/containers/storage/overlay/173c66b0b4b9a1cb0fed0b8ef3b83ff2fccb40f5d89acdba5abb5e13daa8a771/merged major:0 minor:309 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/bc459d523f3d09a4e72a920eb2ee85da7d1913f10dca83f2f3b85a45c814500f/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-313:{mountpoint:/var/lib/containers/storage/overlay/d0d325c56dd19b8a3416cc06a37d266a13ae77bdd5f2820bfb93229bf0242588/merged major:0 minor:313 fsType:overlay blockSize:0} overlay_0-315:{mountpoint:/var/lib/containers/storage/overlay/4724e224cba5c7a2c7693b7ac770335418057ab379cf4a07a37373a897d32b81/merged major:0 minor:315 fsType:overlay blockSize:0} overlay_0-329:{mountpoint:/var/lib/containers/storage/overlay/5871b5d68c61d6456a9f5ed048b246f81ad33ae541ad88d834db4b314b06977f/merged major:0 minor:329 fsType:overlay blockSize:0} overlay_0-342:{mountpoint:/var/lib/containers/storage/overlay/c2f77a2c4f966419771210013e512935eb2b8b1ac3e6ba845c38ed5a46a77708/merged major:0 minor:342 fsType:overlay blockSize:0} overlay_0-344:{mountpoint:/var/lib/containers/storage/overlay/5612c4ef71f24c6249b0051326fa7df7b08529666ee3846703d4476c28e74633/merged major:0 minor:344 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/208cc5dc05ac4b9002a25449eb8d1cbad6deaf4c2045d2e308f55f9963a9e33d/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/663a6f08f05f52b322e6a5f069729c1149ef1dee8c70fda1dcbb48dfc4d3a0ae/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/9b68de50c18518641fd8728c6390284a342238b46ba2c7cde32a1e711f30817e/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/d3da83a881d2102f7000fe1181288e1b55fa6f0f06053de7c3b94424a2791cba/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/b0e9c3809e6e23ebb2d04a25a2df50bef2758d08c536930d6ddb724a98a97781/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/b4c834fd0b7758fd679b8c279e6ae0eaa2cbec09fb97d88c2d9d810cdca2cc04/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/c66f2fd7eab0e7198ec154cff7dcc0ae222e7f35a54e260bd4c379b5a8294395/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/069996de6722ea41ab0d75212efa77011240193677af0609e4ac0e836fa11b47/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/2c9e5262fa236460a064afc42953da321bc5d8c5d330c05641be0a18cdd41ff4/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/80faa1fb1654d716f1bf3a9dede55a148395aa640af11ba8470434e685d9d9fd/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 21:44:22.010342 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.009941    4918 manager.go:217] Machine: {Timestamp:2026-10-30 21:44:22.009465591 +0000 UTC m=+0.058073277 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112098 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28df65027434141408c5c2e328bded SystemUUID:ec28df65-0274-3414-1408-c5c2e328bded BootID:d1b50514-2f43-4b95-91f4-8b1ec9a45ed2 Filesystems:[{Device:overlay_0-313 DeviceMajor:0 DeviceMinor:313 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0df7f3e5-6d57-46f7-a23b-fd130d949fe2/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:64 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/108f8f98f88f9573dd71c80539ca3c275c5b0ddc0c6b150a40c7e0d092ffb173/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/573e2380204b11176ea87e4994cbe3436664fed46aba7036ddf7ed01404b24cb/userdata/shm DeviceMajor:0 DeviceMinor:79 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/add4a18a-fa1b-45c7-8719-2c88634c6488/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/186ffaf9-fc18-4605-9c8c-c9c31bda5379/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:206 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0d921c53-691c-4969-bdd4-f7b87db0e61b/volumes/kubernetes.io~projected/kube-api-access-zdwl5 DeviceMajor:0 DeviceMinor:226 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-296 DeviceMajor:0 DeviceMinor:296 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3272ae76cd49213018fdf91d4cecc7a6bf47da3a1b787122b86f5c7a4fae7938/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-149 DeviceMajor:0 DeviceMinor:149 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/add4a18a-fa1b-45c7-8719-2c88634c6488/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:55 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f3017ee4-5edc-43b8-ad16-107517393622/volumes/kubernetes.io~projected/kube-api-access-6bwj9 DeviceMajor:0 DeviceMinor:207 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-315 DeviceMajor:0 DeviceMinor:315 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/18b98618-898b-4a48-bb05-51e61ca7fe0a/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:218 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/00c2fc719980d06fbe5338968f08435f860b36c6b55a3d672bc1f8f2ddb4d702/userdata/shm DeviceMajor:0 DeviceMinor:248 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e390bf6da2c4105107855636df5aee61ee7f4880bc0d35ab40e0ba6b6861a92b/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6b1746a5-d5b0-4786-908b-09797786de96/volumes/kubernetes.io~projected/kube-api-access-tm82w DeviceMajor:0 DeviceMinor:230 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/032a97f4ff580cb0b89424ca7b9d6de6f73a32b13d2da0e14973265816231e58/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ec41ebc2-3ff6-4453-8eb4-c420b02516c2/volumes/kubernetes.io~projected/kube-api-access-wwq8k DeviceMajor:0 DeviceMinor:289 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-155 DeviceMajor:0 DeviceMinor:155 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1e16d817ad0d9e0bf239b4f985344bd17e9f519b7afc5685c60613d7609868c9/userdata/shm DeviceMajor:0 DeviceMinor:290 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-242 DeviceMajor:0 DeviceMinor:242 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-280 DeviceMajor:0 DeviceMinor:280 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-309 DeviceMajor:0 DeviceMinor:309 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4d3f188bedb824656ae84c5fdeeccb6bb73d25ba47c2576415af687a9b5672b5/userdata/shm DeviceMajor:0 DeviceMinor:340 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-342 DeviceMajor:0 DeviceMinor:342 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a4e14574-aa2d-4fc4-ba26-a07f4a669296/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:201 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a4e14574-aa2d-4fc4-ba26-a07f4a669296/volumes/kubernetes.io~projected/kube-api-access-dh2dx DeviceMajor:0 DeviceMinor:205 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/650ca8e18a3eaae136cb3e0e0cd4aed0964cdf2030737442b21c9919c02e9a4b/userdata/shm DeviceMajor:0 DeviceMinor:213 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6d58dca9-093d-416e-b353-9e9b792d6c23/volumes/kubernetes.io~projected/kube-api-access-h9q2b DeviceMajor:0 DeviceMinor:58 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d03f7bd1-7d99-438a-aa20-e614e86c1235/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:220 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0bdfed7799032034feb774cc9987d238deff6e8b39b33865a3765a1bc6514d9b/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-255 DeviceMajor:0 DeviceMinor:255 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-282 DeviceMajor:0 DeviceMinor:282 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c4ffd66e-ea60-4d77-820e-2a8740fe9dff/volumes/kubernetes.io~projected/kube-api-access-mqzpn DeviceMajor:0 DeviceMinor:60 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/877a7e09-3007-4c2a-97ef-690e99a27dc5/volumes/kubernetes.io~projected/kube-api-access-s68fv DeviceMajor:0 DeviceMinor:67 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a4e14574-aa2d-4fc4-ba26-a07f4a669296/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:203 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8/volumes/kubernetes.io~projected/kube-api-access-2n6jd DeviceMajor:0 DeviceMinor:227 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-239 DeviceMajor:0 DeviceMinor:239 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7b962b1196c00206a6b9bbf0362de72844d5b2f7e0e815c5ca713f5daa682bcb/userdata/shm DeviceMajor:0 DeviceMinor:287 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/186ffaf9-fc18-4605-9c8c-c9c31bda5379/volumes/kubernetes.io~projected/kube-api-access-pspz2 DeviceMajor:0 DeviceMinor:210 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/795237f3-0ac3-4842-90f3-0378a80e5c33/volumes/kubernetes.io~projected/kube-api-access-fc9l8 DeviceMajor:0 DeviceMinor:231 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff/volumes/kubernetes.io~projected/kube-api-access-mrc2w DeviceMajor:0 DeviceMinor:232 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d03f7bd1-7d99-438a-aa20-e614e86c1235/volumes/kubernetes.io~projected/kube-api-access-pjrrb DeviceMajor:0 DeviceMinor:235 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/37575185-c078-4be7-afa9-f7f860f29d49/volumes/kubernetes.io~projected/kube-api-access-589gf DeviceMajor:0 DeviceMinor:304 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a447a17d-b65e-40a2-b200-635ee45355ba/volumes/kubernetes.io~projected/kube-api-access-k7nrc DeviceMajor:0 DeviceMinor:208 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-276 DeviceMajor:0 DeviceMinor:276 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9b06a5cb-5c28-4146-bbea-bfbe2297136c/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:286 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-292 DeviceMajor:0 DeviceMinor:292 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6af24624-056b-44b8-bef3-8a894bf0078b/volumes/kubernetes.io~projected/kube-api-access-8nrnx DeviceMajor:0 DeviceMinor:65 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c28402b8-cc54-4896-955c-a0dc2d5e156d/volumes/kubernetes.io~projected/kube-api-access-gns8k DeviceMajor:0 DeviceMinor:233 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5a9a228b-279e-4895-972f-dbd2de5a9304/volumes/kubernetes.io~projected/kube-api-access-mdnlt DeviceMajor:0 DeviceMinor:56 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/795237f3-0ac3-4842-90f3-0378a80e5c33/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:216 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/dbceb973a6721ddaedb19d6a3fbb2091c905931770de353f416cf68decc079c6/userdata/shm DeviceMajor:0 DeviceMinor:222 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-284 DeviceMajor:0 DeviceMinor:284 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/795237f3-0ac3-4842-90f3-0378a80e5c33/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:215 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/877a7e09-3007-4c2a-97ef-690e99a27dc5/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:62 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f1c0a201-8b48-44fb-b107-a5f2bb798235/volumes/kubernetes.io~projected/kube-api-access-j5zvx DeviceMajor:0 DeviceMinor:59 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6b1746a5-d5b0-4786-908b-09797786de96/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:219 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b9112244-9e99-4f1d-b2a5-576d56dc0718/volumes/kubernetes.io~projected/kube-api-access-d5w4l DeviceMajor:0 DeviceMinor:229 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/976afac6-c62a-4e90-aaa1-5cc80852e988/volumes/kubernetes.io~projected/kube-api-access-cq9cs DeviceMajor:0 DeviceMinor:66 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/aab14d71-ddf4-41c6-80a8-70b258aee1d4/volumes/kubernetes.io~projected/kube-api-access-xblpt DeviceMajor:0 DeviceMinor:45 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/17ea496d2bef069555b5a45bce6d506e43f1e5bd63786d1810fe615d8e65c1f8/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ab944082c2d29e0c693bd7f6c07e974045fe66eb23f6823933e80e3dc1f2f3b8/userdata/shm DeviceMajor:0 DeviceMinor:85 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/795237f3-0ac3-4842-90f3-0378a80e5c33/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:234 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-244 DeviceMajor:0 DeviceMinor:244 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/210bf3ffbd69f859eb0a7c0fece8dbfb64f9a1576b63c260f374e9cd4286d3e8/userdata/shm DeviceMajor:0 DeviceMinor:252 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/03c4973c-9623-4cb4-a239-efdae2ff0b90/volumes/kubernetes.io~projected/kube-api-access-zccg7 DeviceMajor:0 DeviceMinor:57 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/96b35a47e253ba97607c370162084e2df6934f3deaabfc1051448ce70ec5346f/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/74e6709ea0288c88f4d7cf3508517260c3e2cb1c5347f937f09e5969b84bd434/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/62ec01ac891fc45a2e052298f4b7686ccca67649c33cdde0f76b8a08411363cc/userdata/shm DeviceMajor:0 DeviceMinor:211 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ad9e9b3612a0b02cf8902f3a225470be4fb1ae7b0d22dfb200d739602c145f3b/userdata/shm DeviceMajor:0 DeviceMinor:250 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/008b8a95-23ad-416e-ba30-39b63495f28d/volumes/kubernetes.io~projected/kube-api-access-n29gb DeviceMajor:0 DeviceMinor:335 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/18b98618-898b-4a48-bb05-51e61ca7fe0a/volumes/kubernetes.io~projected/kube-api-access-h68gq DeviceMajor:0 DeviceMinor:228 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-344 DeviceMajor:0 DeviceMinor:344 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c28402b8-cc54-4896-955c-a0dc2d5e156d/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:217 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-246 DeviceMajor:0 DeviceMinor:246 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-329 DeviceMajor:0 DeviceMinor:329 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/877a7e09-3007-4c2a-97ef-690e99a27dc5/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:63 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-140 DeviceMajor:0 DeviceMinor:140 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7e81cfe7-52d2-474c-8261-66ce6cf58945/volumes/kubernetes.io~projected/kube-api-access-f695b DeviceMajor:0 DeviceMinor:209 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f4cd8abff3569d0c4b364ff41564c305e3e6841d4282effa4ee873483561548e/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d58df008cc31f0fc5ada3bd63593725e12bfa186173287452d0e498b920a825c/userdata/shm DeviceMajor:0 DeviceMinor:251 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/186ffaf9-fc18-4605-9c8c-c9c31bda5379/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:202 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a9925d2a0152b4eb2e6974f20c8ef6b56811626fff9439fb873a0fe88968f8ab/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/54618a48223180f91a3942925ae0c744fc44b0ed2b84822fe15e7056016196bc/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e2357ae3-0e6b-427c-84f5-fda3350920c4/volumes/kubernetes.io~projected/kube-api-access-rnmdv DeviceMajor:0 DeviceMinor:197 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/186ffaf9-fc18-4605-9c8c-c9c31bda5379/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:204 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:221 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/add4a18a-fa1b-45c7-8719-2c88634c6488/volumes/kubernetes.io~projected/kube-api-access-nlbpz DeviceMajor:0 DeviceMinor:61 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:00c2fc719980d06 MacAddress:72:99:43:18:78:7a Speed:10000 Mtu:8901} {Name:032a97f4ff580cb MacAddress:42:78:3c:54:fc:21 Speed:10000 Mtu:8901} {Name:0bdfed779903203 MacAddress:26:bd:43:61:9c:55 Speed:10000 Mtu:8901} {Name:1e16d817ad0d9e0 MacAddress:22:ea:8d:b9:0e:2b Speed:10000 Mtu:8901} {Name:210bf3ffbd69f85 MacAddress:fa:6a:fe:ac:e2:c6 Speed:10000 Mtu:8901} {Name:4d3f188bedb8246 MacAddress:ba:83:47:d3:d1:da Speed:10000 Mtu:8901} {Name:62ec01ac891fc45 MacAddress:1e:11:27:7b:40:10 Speed:10000 Mtu:8901} {Name:650ca8e18a3eaae MacAddress:da:34:16:3b:c8:a3 Speed:10000 Mtu:8901} {Name:7b962b1196c0020 MacAddress:e6:39:a2:df:73:44 Speed:10000 Mtu:8901} {Name:ad9e9b3612a0b02 MacAddress:2e:23:24:c2:1c:bb Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:4b:bc:ee:48:75 Speed:0 Mtu:9001} {Name:br-int MacAddress:ba:b8:ec:86:e5:b8 Speed:0 Mtu:8901} {Name:d58df008cc31f0f MacAddress:8e:8f:19:7d:f6:2d Speed:10000 Mtu:8901} {Name:dbceb973a6721dd MacAddress:a2:96:7f:54:45:fd Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:4b:bc:ee:48:75 Speed:0 Mtu:9001} {Name:f4cd8abff3569d0 MacAddress:d6:9e:7e:30:40:49 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:0e:e9:c4:c7:0c:8f Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:8e:24:0d:36:d0:3f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 21:44:22.010520 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.010346    4918 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 21:44:22.010520 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.010385    4918 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 21:44:22.010755 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.010735    4918 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 21:44:22.010883 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.010757    4918 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-154.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 21:44:22.012289 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.011208    4918 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 21:44:22.012289 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.011233    4918 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 21:44:22.012289 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.011252    4918 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:44:22.012289 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.011272    4918 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:44:22.012289 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.011298    4918 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 21:44:22.012289 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.011609    4918 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 21:44:22.012289 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.011804    4918 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 21:44:22.012289 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.011847    4918 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 21:44:22.012289 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.011870    4918 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 21:44:22.012289 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.011902    4918 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 21:44:22.012289 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.011916    4918 kubelet.go:405] "Adding apiserver pod source"
Oct 30 21:44:22.012289 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.011928    4918 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 21:44:22.013320 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.013304    4918 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 21:44:22.013356 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.013322    4918 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:44:22.013818 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.013801    4918 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 21:44:22.024882 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.024867    4918 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 21:44:22.024882 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.024880    4918 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:44:22.024989 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.024979    4918 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 21:44:22.025193 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.025182    4918 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 21:44:22.025223 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.025211    4918 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 21:44:22.025310 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.025301    4918 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 21:44:22.025349 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.025315    4918 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 21:44:22.025349 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.025321    4918 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 21:44:22.025349 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.025326    4918 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 21:44:22.025349 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.025332    4918 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 21:44:22.025349 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.025337    4918 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 21:44:22.025349 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.025343    4918 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 21:44:22.025349 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.025352    4918 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 21:44:22.025533 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.025360    4918 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 21:44:22.025533 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.025367    4918 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 21:44:22.025533 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.025380    4918 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 21:44:22.025533 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.025389    4918 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 21:44:22.025533 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.025414    4918 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 21:44:22.025533 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.025422    4918 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 21:44:22.028878 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.028864    4918 server.go:1263] "Started kubelet"
Oct 30 21:44:22.028946 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.028910    4918 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 21:44:22.029402 ip-10-0-142-154 systemd[1]: Started Kubernetes Kubelet.
Oct 30 21:44:22.030220 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.028983    4918 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 21:44:22.030337 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.030245    4918 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 21:44:22.030774 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.030753    4918 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 21:44:22.030985 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.030955    4918 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 21:44:22.034370 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.034343    4918 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 21:44:22.034463 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.034399    4918 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 21:44:22.034641 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.034563    4918 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:38:41 +0000 UTC" deadline="2028-07-20 11:04:52.88788708 +0000 UTC"
Oct 30 21:44:22.034722 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.034625    4918 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15085h20m30.853266419s"
Oct 30 21:44:22.034722 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.034651    4918 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 21:44:22.034722 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:22.034705    4918 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-154.us-west-1.compute.internal\" not found"
Oct 30 21:44:22.034886 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.034727    4918 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 21:44:22.034958 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.034939    4918 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 21:44:22.037270 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.037232    4918 factory.go:55] Registering systemd factory
Oct 30 21:44:22.037270 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.037253    4918 factory.go:223] Registration of the systemd container factory successfully
Oct 30 21:44:22.037887 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.037842    4918 factory.go:153] Registering CRI-O factory
Oct 30 21:44:22.038269 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.038226    4918 factory.go:223] Registration of the crio container factory successfully
Oct 30 21:44:22.038666 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.038595    4918 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 21:44:22.038666 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.038621    4918 factory.go:103] Registering Raw factory
Oct 30 21:44:22.038666 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.038636    4918 manager.go:1199] Started watching for new ooms in manager
Oct 30 21:44:22.039013 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.038976    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0aab5a63-4de8-4a6e-a9e7-f7ba260754c8" volumeName="kubernetes.io/configmap/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-config" seLinuxMountContext=""
Oct 30 21:44:22.039104 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039018    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0df7f3e5-6d57-46f7-a23b-fd130d949fe2" volumeName="kubernetes.io/configmap/0df7f3e5-6d57-46f7-a23b-fd130d949fe2-konnectivity-ca" seLinuxMountContext=""
Oct 30 21:44:22.039104 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039048    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c28402b8-cc54-4896-955c-a0dc2d5e156d" volumeName="kubernetes.io/secret/c28402b8-cc54-4896-955c-a0dc2d5e156d-serving-cert" seLinuxMountContext=""
Oct 30 21:44:22.039104 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039061    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d03f7bd1-7d99-438a-aa20-e614e86c1235" volumeName="kubernetes.io/secret/d03f7bd1-7d99-438a-aa20-e614e86c1235-cert" seLinuxMountContext=""
Oct 30 21:44:22.039104 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039070    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4e14574-aa2d-4fc4-ba26-a07f4a669296" volumeName="kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-default-certificate" seLinuxMountContext=""
Oct 30 21:44:22.039104 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039087    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0df7f3e5-6d57-46f7-a23b-fd130d949fe2" volumeName="kubernetes.io/secret/0df7f3e5-6d57-46f7-a23b-fd130d949fe2-agent-certs" seLinuxMountContext=""
Oct 30 21:44:22.039104 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039098    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a9a228b-279e-4895-972f-dbd2de5a9304" volumeName="kubernetes.io/configmap/5a9a228b-279e-4895-972f-dbd2de5a9304-cni-binary-copy" seLinuxMountContext=""
Oct 30 21:44:22.039419 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039109    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6af24624-056b-44b8-bef3-8a894bf0078b" volumeName="kubernetes.io/projected/6af24624-056b-44b8-bef3-8a894bf0078b-kube-api-access-8nrnx" seLinuxMountContext=""
Oct 30 21:44:22.039419 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039133    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d58dca9-093d-416e-b353-9e9b792d6c23" volumeName="kubernetes.io/projected/6d58dca9-093d-416e-b353-9e9b792d6c23-kube-api-access-h9q2b" seLinuxMountContext=""
Oct 30 21:44:22.039419 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039145    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0aab5a63-4de8-4a6e-a9e7-f7ba260754c8" volumeName="kubernetes.io/projected/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-kube-api-access-2n6jd" seLinuxMountContext=""
Oct 30 21:44:22.039419 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039155    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0aab5a63-4de8-4a6e-a9e7-f7ba260754c8" volumeName="kubernetes.io/secret/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-serving-cert" seLinuxMountContext=""
Oct 30 21:44:22.039419 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039177    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18b98618-898b-4a48-bb05-51e61ca7fe0a" volumeName="kubernetes.io/projected/18b98618-898b-4a48-bb05-51e61ca7fe0a-kube-api-access-h68gq" seLinuxMountContext=""
Oct 30 21:44:22.039419 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039189    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b1746a5-d5b0-4786-908b-09797786de96" volumeName="kubernetes.io/configmap/6b1746a5-d5b0-4786-908b-09797786de96-config" seLinuxMountContext=""
Oct 30 21:44:22.039419 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039202    4918 manager.go:319] Starting recovery of all containers
Oct 30 21:44:22.039419 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039200    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="795237f3-0ac3-4842-90f3-0378a80e5c33" volumeName="kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-kube-api-access-fc9l8" seLinuxMountContext=""
Oct 30 21:44:22.039419 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039343    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4e14574-aa2d-4fc4-ba26-a07f4a669296" volumeName="kubernetes.io/projected/a4e14574-aa2d-4fc4-ba26-a07f4a669296-kube-api-access-dh2dx" seLinuxMountContext=""
Oct 30 21:44:22.039419 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039365    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9112244-9e99-4f1d-b2a5-576d56dc0718" volumeName="kubernetes.io/projected/b9112244-9e99-4f1d-b2a5-576d56dc0718-kube-api-access-d5w4l" seLinuxMountContext=""
Oct 30 21:44:22.039419 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039380    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c4ffd66e-ea60-4d77-820e-2a8740fe9dff" volumeName="kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 21:44:22.039419 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039392    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="186ffaf9-fc18-4605-9c8c-c9c31bda5379" volumeName="kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-bound-sa-token" seLinuxMountContext=""
Oct 30 21:44:22.039419 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039405    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="795237f3-0ac3-4842-90f3-0378a80e5c33" volumeName="kubernetes.io/empty-dir/795237f3-0ac3-4842-90f3-0378a80e5c33-ca-trust-extracted" seLinuxMountContext=""
Oct 30 21:44:22.039419 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039416    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="877a7e09-3007-4c2a-97ef-690e99a27dc5" volumeName="kubernetes.io/projected/877a7e09-3007-4c2a-97ef-690e99a27dc5-kube-api-access-s68fv" seLinuxMountContext=""
Oct 30 21:44:22.039419 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039429    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="add4a18a-fa1b-45c7-8719-2c88634c6488" volumeName="kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-ovnkube-config" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039441    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c28402b8-cc54-4896-955c-a0dc2d5e156d" volumeName="kubernetes.io/configmap/c28402b8-cc54-4896-955c-a0dc2d5e156d-service-ca-bundle" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039452    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c4ffd66e-ea60-4d77-820e-2a8740fe9dff" volumeName="kubernetes.io/projected/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-kube-api-access-mqzpn" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039464    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="186ffaf9-fc18-4605-9c8c-c9c31bda5379" volumeName="kubernetes.io/empty-dir/186ffaf9-fc18-4605-9c8c-c9c31bda5379-ca-trust-extracted" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039498    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="795237f3-0ac3-4842-90f3-0378a80e5c33" volumeName="kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-installation-pull-secrets" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039509    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a447a17d-b65e-40a2-b200-635ee45355ba" volumeName="kubernetes.io/configmap/a447a17d-b65e-40a2-b200-635ee45355ba-config-volume" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039521    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4e14574-aa2d-4fc4-ba26-a07f4a669296" volumeName="kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-stats-auth" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039534    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18b98618-898b-4a48-bb05-51e61ca7fe0a" volumeName="kubernetes.io/configmap/18b98618-898b-4a48-bb05-51e61ca7fe0a-config" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039551    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a9a228b-279e-4895-972f-dbd2de5a9304" volumeName="kubernetes.io/configmap/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-daemon-config" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039564    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="795237f3-0ac3-4842-90f3-0378a80e5c33" volumeName="kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-trusted-ca" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039576    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d03f7bd1-7d99-438a-aa20-e614e86c1235" volumeName="kubernetes.io/projected/d03f7bd1-7d99-438a-aa20-e614e86c1235-kube-api-access-pjrrb" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039589    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="008b8a95-23ad-416e-ba30-39b63495f28d" volumeName="kubernetes.io/projected/008b8a95-23ad-416e-ba30-39b63495f28d-kube-api-access-n29gb" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039601    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03c4973c-9623-4cb4-a239-efdae2ff0b90" volumeName="kubernetes.io/projected/03c4973c-9623-4cb4-a239-efdae2ff0b90-kube-api-access-zccg7" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039613    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18b98618-898b-4a48-bb05-51e61ca7fe0a" volumeName="kubernetes.io/secret/18b98618-898b-4a48-bb05-51e61ca7fe0a-serving-cert" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039624    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a447a17d-b65e-40a2-b200-635ee45355ba" volumeName="kubernetes.io/empty-dir/a447a17d-b65e-40a2-b200-635ee45355ba-tmp-dir" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039636    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aab14d71-ddf4-41c6-80a8-70b258aee1d4" volumeName="kubernetes.io/projected/aab14d71-ddf4-41c6-80a8-70b258aee1d4-kube-api-access-xblpt" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039649    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="add4a18a-fa1b-45c7-8719-2c88634c6488" volumeName="kubernetes.io/projected/add4a18a-fa1b-45c7-8719-2c88634c6488-kube-api-access-nlbpz" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039660    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e2357ae3-0e6b-427c-84f5-fda3350920c4" volumeName="kubernetes.io/projected/e2357ae3-0e6b-427c-84f5-fda3350920c4-kube-api-access-rnmdv" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039673    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="186ffaf9-fc18-4605-9c8c-c9c31bda5379" volumeName="kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-certificates" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039709    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="795237f3-0ac3-4842-90f3-0378a80e5c33" volumeName="kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-certificates" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039728    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="add4a18a-fa1b-45c7-8719-2c88634c6488" volumeName="kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039742    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="add4a18a-fa1b-45c7-8719-2c88634c6488" volumeName="kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-env-overrides" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039753    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c28402b8-cc54-4896-955c-a0dc2d5e156d" volumeName="kubernetes.io/empty-dir/c28402b8-cc54-4896-955c-a0dc2d5e156d-snapshots" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039764    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="186ffaf9-fc18-4605-9c8c-c9c31bda5379" volumeName="kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-installation-pull-secrets" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039779    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6af24624-056b-44b8-bef3-8a894bf0078b" volumeName="kubernetes.io/configmap/6af24624-056b-44b8-bef3-8a894bf0078b-iptables-alerter-script" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039790    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="795237f3-0ac3-4842-90f3-0378a80e5c33" volumeName="kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039801    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="877a7e09-3007-4c2a-97ef-690e99a27dc5" volumeName="kubernetes.io/empty-dir/877a7e09-3007-4c2a-97ef-690e99a27dc5-tmp" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039813    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9112244-9e99-4f1d-b2a5-576d56dc0718" volumeName="kubernetes.io/configmap/b9112244-9e99-4f1d-b2a5-576d56dc0718-telemetry-config" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039824    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c4ffd66e-ea60-4d77-820e-2a8740fe9dff" volumeName="kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039836    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="186ffaf9-fc18-4605-9c8c-c9c31bda5379" volumeName="kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-trusted-ca" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039854    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="186ffaf9-fc18-4605-9c8c-c9c31bda5379" volumeName="kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-kube-api-access-pspz2" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039865    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b06a5cb-5c28-4146-bbea-bfbe2297136c" volumeName="kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039890    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="add4a18a-fa1b-45c7-8719-2c88634c6488" volumeName="kubernetes.io/secret/add4a18a-fa1b-45c7-8719-2c88634c6488-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039902    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c4ffd66e-ea60-4d77-820e-2a8740fe9dff" volumeName="kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cni-binary-copy" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039917    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ec41ebc2-3ff6-4453-8eb4-c420b02516c2" volumeName="kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039928    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f3017ee4-5edc-43b8-ad16-107517393622" volumeName="kubernetes.io/projected/f3017ee4-5edc-43b8-ad16-107517393622-kube-api-access-6bwj9" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039949    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="18b98618-898b-4a48-bb05-51e61ca7fe0a" volumeName="kubernetes.io/configmap/18b98618-898b-4a48-bb05-51e61ca7fe0a-trusted-ca" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039960    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="795237f3-0ac3-4842-90f3-0378a80e5c33" volumeName="kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-bound-sa-token" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039973    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c28402b8-cc54-4896-955c-a0dc2d5e156d" volumeName="kubernetes.io/projected/c28402b8-cc54-4896-955c-a0dc2d5e156d-kube-api-access-gns8k" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039984    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1c0a201-8b48-44fb-b107-a5f2bb798235" volumeName="kubernetes.io/projected/f1c0a201-8b48-44fb-b107-a5f2bb798235-kube-api-access-j5zvx" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.039998    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="186ffaf9-fc18-4605-9c8c-c9c31bda5379" volumeName="kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040011    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="40cb9ea7-fe94-41e7-abd3-70a2c6d31fff" volumeName="kubernetes.io/configmap/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-config" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040023    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b1746a5-d5b0-4786-908b-09797786de96" volumeName="kubernetes.io/projected/6b1746a5-d5b0-4786-908b-09797786de96-kube-api-access-tm82w" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040034    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="877a7e09-3007-4c2a-97ef-690e99a27dc5" volumeName="kubernetes.io/empty-dir/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-tuned" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040044    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0d921c53-691c-4969-bdd4-f7b87db0e61b" volumeName="kubernetes.io/projected/0d921c53-691c-4969-bdd4-f7b87db0e61b-kube-api-access-zdwl5" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040056    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="37575185-c078-4be7-afa9-f7f860f29d49" volumeName="kubernetes.io/projected/37575185-c078-4be7-afa9-f7f860f29d49-kube-api-access-589gf" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040066    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d58dca9-093d-416e-b353-9e9b792d6c23" volumeName="kubernetes.io/empty-dir/6d58dca9-093d-416e-b353-9e9b792d6c23-tmp-dir" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040077    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03c4973c-9623-4cb4-a239-efdae2ff0b90" volumeName="kubernetes.io/configmap/03c4973c-9623-4cb4-a239-efdae2ff0b90-serviceca" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040091    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="40cb9ea7-fe94-41e7-abd3-70a2c6d31fff" volumeName="kubernetes.io/projected/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-kube-api-access-mrc2w" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040102    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a9a228b-279e-4895-972f-dbd2de5a9304" volumeName="kubernetes.io/projected/5a9a228b-279e-4895-972f-dbd2de5a9304-kube-api-access-mdnlt" seLinuxMountContext=""
Oct 30 21:44:22.040095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040130    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b1746a5-d5b0-4786-908b-09797786de96" volumeName="kubernetes.io/secret/6b1746a5-d5b0-4786-908b-09797786de96-serving-cert" seLinuxMountContext=""
Oct 30 21:44:22.042382 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040141    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7e81cfe7-52d2-474c-8261-66ce6cf58945" volumeName="kubernetes.io/projected/7e81cfe7-52d2-474c-8261-66ce6cf58945-kube-api-access-f695b" seLinuxMountContext=""
Oct 30 21:44:22.042382 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040152    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="976afac6-c62a-4e90-aaa1-5cc80852e988" volumeName="kubernetes.io/projected/976afac6-c62a-4e90-aaa1-5cc80852e988-kube-api-access-cq9cs" seLinuxMountContext=""
Oct 30 21:44:22.042382 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040163    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c28402b8-cc54-4896-955c-a0dc2d5e156d" volumeName="kubernetes.io/configmap/c28402b8-cc54-4896-955c-a0dc2d5e156d-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 21:44:22.042382 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040176    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c28402b8-cc54-4896-955c-a0dc2d5e156d" volumeName="kubernetes.io/empty-dir/c28402b8-cc54-4896-955c-a0dc2d5e156d-tmp" seLinuxMountContext=""
Oct 30 21:44:22.042382 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040187    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="37575185-c078-4be7-afa9-f7f860f29d49" volumeName="kubernetes.io/empty-dir/37575185-c078-4be7-afa9-f7f860f29d49-data-volume" seLinuxMountContext=""
Oct 30 21:44:22.042382 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040198    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a447a17d-b65e-40a2-b200-635ee45355ba" volumeName="kubernetes.io/projected/a447a17d-b65e-40a2-b200-635ee45355ba-kube-api-access-k7nrc" seLinuxMountContext=""
Oct 30 21:44:22.042382 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040212    4918 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5" volumeName="kubernetes.io/configmap/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-nginx-conf" seLinuxMountContext=""
Oct 30 21:44:22.042382 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040224    4918 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 21:44:22.042382 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.040231    4918 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 21:44:22.042382 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.041420    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/1.log"
Oct 30 21:44:22.042964 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.042945    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/1.log"
Oct 30 21:44:22.063052 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.063010    4918 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 21:44:22.064587 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.064564    4918 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 21:44:22.064587 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.064589    4918 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 21:44:22.064746 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.064607    4918 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 21:44:22.064746 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:22.064637    4918 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 21:44:22.072696 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.072650    4918 generic.go:356] "Generic (PLEG): container finished" podID="c4ffd66e-ea60-4d77-820e-2a8740fe9dff" containerID="8d3e8c5003c64e6dfe50b3dd2c0db3007546f0fbaebc640cfbf0d64bfc8ad52c" exitCode=0
Oct 30 21:44:22.072782 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.072699    4918 generic.go:356] "Generic (PLEG): container finished" podID="c4ffd66e-ea60-4d77-820e-2a8740fe9dff" containerID="734de77c9c45de536aad7d8c905028480c5ef41f9935037cb2f9f0647ea8396d" exitCode=0
Oct 30 21:44:22.072782 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.072708    4918 generic.go:356] "Generic (PLEG): container finished" podID="c4ffd66e-ea60-4d77-820e-2a8740fe9dff" containerID="f6b25e889c83c56cc2aeb064230739756aa4ddf3cc857e88db2e55a334ee681c" exitCode=0
Oct 30 21:44:22.072782 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.072718    4918 generic.go:356] "Generic (PLEG): container finished" podID="c4ffd66e-ea60-4d77-820e-2a8740fe9dff" containerID="92b81534cec45c9e7745581b6c23179ab4b6e72a86ceb197af39a5376b0a8b2f" exitCode=0
Oct 30 21:44:22.072782 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.072725    4918 generic.go:356] "Generic (PLEG): container finished" podID="c4ffd66e-ea60-4d77-820e-2a8740fe9dff" containerID="729399371d922e95a5442922315ad7c46a0d32be7a69e56d9890543f77990b36" exitCode=0
Oct 30 21:44:22.072782 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.072732    4918 generic.go:356] "Generic (PLEG): container finished" podID="c4ffd66e-ea60-4d77-820e-2a8740fe9dff" containerID="8c834e5344095910a1fd124536b7d9a1e3931ce9515a1f892ecbeb537b1de09a" exitCode=0
Oct 30 21:44:22.088381 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.088360    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/1.log"
Oct 30 21:44:22.088495 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.088395    4918 generic.go:356] "Generic (PLEG): container finished" podID="18b98618-898b-4a48-bb05-51e61ca7fe0a" containerID="2c4a7ffe669b4633bcf7d93de74dd03f8fc10084061b3cbf465faea71f0467cd" exitCode=255
Oct 30 21:44:22.098627 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.098606    4918 generic.go:356] "Generic (PLEG): container finished" podID="0e4bbb2b70f21f2ae358c77963ab899a" containerID="4f1501ded0a82f1993bf67c8c4b1ee604ea3c38a7e8e119b39b2b30676d0b898" exitCode=0
Oct 30 21:44:22.126484 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.126429    4918 manager.go:324] Recovery completed
Oct 30 21:44:22.134816 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:22.134792    4918 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-142-154.us-west-1.compute.internal\" not found"
Oct 30 21:44:22.144100 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.144086    4918 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:44:22.145327 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.145307    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:44:22.145403 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.145339    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:44:22.145403 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.145349    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:44:22.147619 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.147601    4918 cpu_manager.go:226] "Starting" policy="none"
Oct 30 21:44:22.147619 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.147617    4918 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:44:22.147724 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.147617    4918 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 21:44:22.147724 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.147699    4918 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 21:44:22.147836 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.147823    4918 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 21:44:22.147880 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.147838    4918 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 21:44:22.147880 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.147855    4918 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 21:44:22.147880 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.147860    4918 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 21:44:22.147880 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.147866    4918 policy_none.go:50] "Start"
Oct 30 21:44:22.147880 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.147876    4918 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 21:44:22.148022 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.147885    4918 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 21:44:22.148022 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.148002    4918 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 21:44:22.148022 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.148009    4918 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 21:44:22.148022 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.148014    4918 policy_none.go:44] "Start"
Oct 30 21:44:22.148435 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.148422    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:44:22.148486 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.148450    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:44:22.148486 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.148463    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:44:22.152335 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.152308    4918 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 21:44:22.155061 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.155048    4918 manager.go:341] "Starting Device Plugin manager"
Oct 30 21:44:22.155143 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:22.155071    4918 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 21:44:22.155143 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.155079    4918 server.go:87] "Starting device plugin registration server"
Oct 30 21:44:22.155317 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.155305    4918 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 21:44:22.155369 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.155317    4918 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 21:44:22.155416 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.155403    4918 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 21:44:22.155545 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.155507    4918 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 21:44:22.155618 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.155554    4918 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 21:44:22.155618 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.155562    4918 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 21:44:22.155727 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.155607    4918 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:44:22.155543578Z","UUID":"6d5ef563-ad66-4f8f-b779-f1b3f045912e","Handler":null,"Name":"","Endpoint":""}
Oct 30 21:44:22.156874 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:22.156855    4918 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 21:44:22.156963 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:22.156899    4918 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-154.us-west-1.compute.internal\" not found"
Oct 30 21:44:22.156963 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.156920    4918 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 21:44:22.156963 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.156949    4918 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 21:44:22.165571 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.165487    4918 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal"]
Oct 30 21:44:22.165642 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.165622    4918 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:44:22.166532 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.166512    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:44:22.166613 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.166545    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:44:22.166613 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.166558    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:44:22.167084 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.167067    4918 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:44:22.167169 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.167102    4918 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:44:22.168070 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.168048    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:44:22.168156 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.168082    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:44:22.168156 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.168097    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:44:22.168156 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.168114    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:44:22.168156 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.168137    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:44:22.168156 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.168152    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:44:22.168346 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:22.168301    4918 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-154.us-west-1.compute.internal\" not found" node="ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.168408 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.168345    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal" event={"ID":"7338dfe0a44a7307924a221163b5ea2d","Type":"ContainerStarted","Data":"e329ee3c4d0796cb3f62f421327a96b64f3259c5a59a2735ccfd865a86c0fa10"}
Oct 30 21:44:22.168408 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.168383    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal" event={"ID":"7338dfe0a44a7307924a221163b5ea2d","Type":"ContainerStarted","Data":"3272ae76cd49213018fdf91d4cecc7a6bf47da3a1b787122b86f5c7a4fae7938"}
Oct 30 21:44:22.168479 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.168451    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal" event={"ID":"0e4bbb2b70f21f2ae358c77963ab899a","Type":"ContainerStarted","Data":"c1081ed5de167db35e34f4c917ec88c614c15cfb2dec0c11c28552691adbe679"}
Oct 30 21:44:22.168479 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.168472    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal" event={"ID":"0e4bbb2b70f21f2ae358c77963ab899a","Type":"ContainerDied","Data":"4f1501ded0a82f1993bf67c8c4b1ee604ea3c38a7e8e119b39b2b30676d0b898"}
Oct 30 21:44:22.168545 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.168490    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal" event={"ID":"0e4bbb2b70f21f2ae358c77963ab899a","Type":"ContainerStarted","Data":"a9925d2a0152b4eb2e6974f20c8ef6b56811626fff9439fb873a0fe88968f8ab"}
Oct 30 21:44:22.168575 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.168475    4918 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:44:22.169292 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.169273    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:44:22.169356 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.169302    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:44:22.169356 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.169316    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:44:22.169469 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:22.169456    4918 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-154.us-west-1.compute.internal\" not found" node="ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.225346 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.225326    4918 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:44:22.225346 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.225351    4918 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:44:22.225470 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.225427    4918 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 21:44:22.226044 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.226031    4918 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:44:22.235236 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.235220    4918 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.256388 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.256372    4918 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:44:22.257215 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.257191    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:44:22.257293 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.257221    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:44:22.257293 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.257236    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:44:22.257293 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.257292    4918 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.275574 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.275555    4918 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:44:22.297278 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.297258    4918 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:44:22.297343 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:22.297300    4918 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.297343 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.297310    4918 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.326234 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.326213    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e4bbb2b70f21f2ae358c77963ab899a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"0e4bbb2b70f21f2ae358c77963ab899a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.326327 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.326239    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e4bbb2b70f21f2ae358c77963ab899a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"0e4bbb2b70f21f2ae358c77963ab899a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.326327 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.326258    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7338dfe0a44a7307924a221163b5ea2d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"7338dfe0a44a7307924a221163b5ea2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.374636 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.374617    4918 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.374730 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.374670    4918 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.375120 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.375100    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeNotReady"
Oct 30 21:44:22.375198 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.375134    4918 setters.go:546] "Node became not ready" node="ip-10-0-142-154.us-west-1.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-10-30T21:44:22Z","lastTransitionTime":"2026-10-30T21:44:22Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"}
Oct 30 21:44:22.388015 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.387974    4918 nodeinfomanager.go:471] existing CSINode "ip-10-0-142-154.us-west-1.compute.internal" is owned by different node (oldNodeID="c348f11d-5cc1-4761-8f5d-f7f3382f692c", newNodeID=""), cleaning up...
Oct 30 21:44:22.403316 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.403300    4918 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:44:22.403365 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:22.403334    4918 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.426368 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.426344    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e4bbb2b70f21f2ae358c77963ab899a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"0e4bbb2b70f21f2ae358c77963ab899a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.426460 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.426372    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e4bbb2b70f21f2ae358c77963ab899a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"0e4bbb2b70f21f2ae358c77963ab899a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.426460 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.426388    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7338dfe0a44a7307924a221163b5ea2d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"7338dfe0a44a7307924a221163b5ea2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.426460 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.426431    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7338dfe0a44a7307924a221163b5ea2d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"7338dfe0a44a7307924a221163b5ea2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.426597 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.426452    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0e4bbb2b70f21f2ae358c77963ab899a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"0e4bbb2b70f21f2ae358c77963ab899a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:22.426597 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:22.426459    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e4bbb2b70f21f2ae358c77963ab899a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal\" (UID: \"0e4bbb2b70f21f2ae358c77963ab899a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:23.012435 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.012374    4918 apiserver.go:52] "Watching apiserver"
Oct 30 21:44:23.116109 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.116084    4918 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 21:44:23.117123 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.117079    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-r54tb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal","kube-system/kas-connection-checker-685895c7c9-sdtr4","kube-system/kas-connection-checker-685895c7c9-t9r98","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv","kube-system/kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal","openshift-ingress-canary/ingress-canary-tnx6d","openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm","openshift-network-operator/iptables-alerter-z8qm8","openshift-kube-storage-version-migrator/migrator-66df5d496b-cgx2d","openshift-multus/network-metrics-daemon-jdg72","kube-system/global-pull-secret-syncer-8c64w","openshift-multus/multus-additional-cni-plugins-pjtvc","openshift-insights/insights-runtime-extractor-48xwh","openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg","openshift-image-registry/image-registry-775f87bbf6-82p7v","openshift-console-operator/console-operator-7cd56b8dbc-8hc58","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7zlst","openshift-image-registry/node-ca-j6x9n","kube-system/kas-connection-checker-685895c7c9-chqp7","kube-system/konnectivity-agent-kfvjg","openshift-ovn-kubernetes/ovnkube-node-mnpfz","openshift-dns/dns-default-4hw29","openshift-ingress/router-default-6d865d79dc-z4f64","openshift-network-diagnostics/network-check-source-6f78d59f99-ghx6v","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th","openshift-image-registry/image-registry-8d78449d9-mmjp2","openshift-cluster-node-tuning-operator/tuned-ccgs8","openshift-insights/insights-operator-7c4986d449-vbwwf","openshift-multus/multus-zldds","openshift-network-console/networking-console-plugin-86c478bb88-pfzwt","openshift-dns/node-resolver-zhhh4"]
Oct 30 21:44:23.119072 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.119051    4918 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:23.121344 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.121314    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:23.123177 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.123152    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.123376 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.123350    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:23.125202 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.125172    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:23.126579 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.126557    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:23.130543 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.130522    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:23.132944 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.132918    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.134260 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.134241    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:23.134901 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.134876    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:23.137434 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.137413    4918 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 21:44:23.173927 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.173906    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 21:44:23.174022 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.173906    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 21:44:23.174022 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.173983    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 21:44:23.176039 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.176023    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 21:44:23.176810 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.176795    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.176903 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.176891    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.182356 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.182341    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.182447 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.182431    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 21:44:23.182653 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.182637    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 21:44:23.182731 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.182648    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 21:44:23.182731 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.182668    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.182731 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.182724    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.182853 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.182842    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 21:44:23.182918 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.182895    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 21:44:23.183014 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.182974    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 21:44:23.183072 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.183053    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.183161 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.183116    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.183161 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.183124    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.183161 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.183126    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.183161 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.183139    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 21:44:23.183161 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.183160    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.183343 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.183266    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.183343 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.183291    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.183343 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.183324    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.183493 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.183362    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.183493 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.183363    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.183493 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.183367    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.183493 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.183470    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 21:44:23.183890 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.183777    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 21:44:23.183962 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.183945    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 21:44:23.184072 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.184061    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 21:44:23.184241 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.184228    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 21:44:23.184306 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.184292    4918 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:44:23.184361 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.184333    4918 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-154.us-west-1.compute.internal"
Oct 30 21:44:23.190832 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.190817    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-4f9tw\""
Oct 30 21:44:23.190910 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.190861    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 21:44:23.191000 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.190987    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5pc99\""
Oct 30 21:44:23.192084 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.192071    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.192272 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.192243    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 21:44:23.192272 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.192245    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 21:44:23.192469 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.192252    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 21:44:23.192469 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.192412    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 21:44:23.192594 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.192500    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.192713 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.192692    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.192713 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.192711    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.192881 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.192792    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 21:44:23.192881 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.192821    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-fqpcl\""
Oct 30 21:44:23.192881 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.192831    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.192881 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.192851    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.193229 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.193217    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9vv2h\""
Oct 30 21:44:23.220751 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.220729    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.224701 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.224664    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 21:44:23.224776 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.224728    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.224776 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.224744    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.226219 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.226195    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 21:44:23.226290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.226226    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 21:44:23.229949 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.229912    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:23.230055 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.229959    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a447a17d-b65e-40a2-b200-635ee45355ba-tmp-dir\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:23.230055 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.229988    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:23.230055 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230022    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0df7f3e5-6d57-46f7-a23b-fd130d949fe2-konnectivity-ca\") pod \"konnectivity-agent-kfvjg\" (UID: \"0df7f3e5-6d57-46f7-a23b-fd130d949fe2\") " pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:44:23.230206 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230056    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.230206 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230091    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdwl5\" (UniqueName: \"kubernetes.io/projected/0d921c53-691c-4969-bdd4-f7b87db0e61b-kube-api-access-zdwl5\") pod \"network-check-source-6f78d59f99-ghx6v\" (UID: \"0d921c53-691c-4969-bdd4-f7b87db0e61b\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-ghx6v"
Oct 30 21:44:23.230206 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230123    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n29gb\" (UniqueName: \"kubernetes.io/projected/008b8a95-23ad-416e-ba30-39b63495f28d-kube-api-access-n29gb\") pod \"migrator-66df5d496b-cgx2d\" (UID: \"008b8a95-23ad-416e-ba30-39b63495f28d\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cgx2d"
Oct 30 21:44:23.230206 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230149    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-default-certificate\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:23.230206 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230180    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03c4973c-9623-4cb4-a239-efdae2ff0b90-serviceca\") pod \"node-ca-j6x9n\" (UID: \"03c4973c-9623-4cb4-a239-efdae2ff0b90\") " pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:44:23.230481 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230210    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-trusted-ca\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.230481 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230242    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.230481 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230276    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n6jd\" (UniqueName: \"kubernetes.io/projected/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-kube-api-access-2n6jd\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-skmhv\" (UID: \"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:23.230481 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230301    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-etc-kubernetes\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.230481 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230331    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-tuned\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.230481 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230364    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.230481 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230397    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pspz2\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-kube-api-access-pspz2\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.230481 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230423    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h68gq\" (UniqueName: \"kubernetes.io/projected/18b98618-898b-4a48-bb05-51e61ca7fe0a-kube-api-access-h68gq\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:23.230481 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230465    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:23.230883 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230506    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdnlt\" (UniqueName: \"kubernetes.io/projected/5a9a228b-279e-4895-972f-dbd2de5a9304-kube-api-access-mdnlt\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.230883 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230546    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cnibin\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.230883 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230586    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysctl-d\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.230883 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230635    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-registration-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.230883 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230671    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-bound-sa-token\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.230883 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230730    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b06a5cb-5c28-4146-bbea-bfbe2297136c-kubelet-config\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:23.230883 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230772    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:23.230883 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230822    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5zvx\" (UniqueName: \"kubernetes.io/projected/f1c0a201-8b48-44fb-b107-a5f2bb798235-kube-api-access-j5zvx\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:23.230883 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230861    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-sys-fs\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.231252 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230910    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq9cs\" (UniqueName: \"kubernetes.io/projected/976afac6-c62a-4e90-aaa1-5cc80852e988-kube-api-access-cq9cs\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.231252 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230948    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-installation-pull-secrets\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.231252 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.230984    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:23.231252 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231014    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b1746a5-d5b0-4786-908b-09797786de96-config\") pod \"service-ca-operator-544d749c8c-tp26d\" (UID: \"6b1746a5-d5b0-4786-908b-09797786de96\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:23.231252 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231038    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.231252 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231073    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:23.231252 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231104    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.231252 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231135    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-etc-selinux\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.231252 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231163    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-cni-netd\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.231252 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231192    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:23.231252 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231221    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-daemon-config\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.231252 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231245    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-systemd-units\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.231769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231274    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.231769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231302    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-cni-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.231769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231332    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b1746a5-d5b0-4786-908b-09797786de96-serving-cert\") pod \"service-ca-operator-544d749c8c-tp26d\" (UID: \"6b1746a5-d5b0-4786-908b-09797786de96\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:23.231769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231364    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6af24624-056b-44b8-bef3-8a894bf0078b-iptables-alerter-script\") pod \"iptables-alerter-z8qm8\" (UID: \"6af24624-056b-44b8-bef3-8a894bf0078b\") " pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:44:23.231769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231388    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/877a7e09-3007-4c2a-97ef-690e99a27dc5-tmp\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.231769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231419    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnmdv\" (UniqueName: \"kubernetes.io/projected/e2357ae3-0e6b-427c-84f5-fda3350920c4-kube-api-access-rnmdv\") pod \"kas-connection-checker-685895c7c9-sdtr4\" (UID: \"e2357ae3-0e6b-427c-84f5-fda3350920c4\") " pod="kube-system/kas-connection-checker-685895c7c9-sdtr4"
Oct 30 21:44:23.231769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231462    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh2dx\" (UniqueName: \"kubernetes.io/projected/a4e14574-aa2d-4fc4-ba26-a07f4a669296-kube-api-access-dh2dx\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:23.231769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231493    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c28402b8-cc54-4896-955c-a0dc2d5e156d-tmp\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:23.231769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231519    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c28402b8-cc54-4896-955c-a0dc2d5e156d-service-ca-bundle\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:23.231769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231550    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xblpt\" (UniqueName: \"kubernetes.io/projected/aab14d71-ddf4-41c6-80a8-70b258aee1d4-kube-api-access-xblpt\") pod \"kas-connection-checker-685895c7c9-t9r98\" (UID: \"aab14d71-ddf4-41c6-80a8-70b258aee1d4\") " pod="kube-system/kas-connection-checker-685895c7c9-t9r98"
Oct 30 21:44:23.231769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231579    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlbpz\" (UniqueName: \"kubernetes.io/projected/add4a18a-fa1b-45c7-8719-2c88634c6488-kube-api-access-nlbpz\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.231769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231612    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrc2w\" (UniqueName: \"kubernetes.io/projected/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-kube-api-access-mrc2w\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:23.231769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231644    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b9112244-9e99-4f1d-b2a5-576d56dc0718-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:23.231769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231671    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-run-netns\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.231769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231722    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-image-registry-private-configuration\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.231769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231754    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-cni-multus\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231786    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18b98618-898b-4a48-bb05-51e61ca7fe0a-trusted-ca\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231817    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-ovnkube-script-lib\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231843    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231873    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysctl-conf\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231906    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-systemd\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231940    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37575185-c078-4be7-afa9-f7f860f29d49-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231965    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-var-lib-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.231994    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-cni-bin\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232025    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwq8k\" (UniqueName: \"kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k\") pod \"network-check-target-r54tb\" (UID: \"ec41ebc2-3ff6-4453-8eb4-c420b02516c2\") " pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232056    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-lib-modules\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232087    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a447a17d-b65e-40a2-b200-635ee45355ba-config-volume\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232114    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7nrc\" (UniqueName: \"kubernetes.io/projected/a447a17d-b65e-40a2-b200-635ee45355ba-kube-api-access-k7nrc\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232168    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18b98618-898b-4a48-bb05-51e61ca7fe0a-serving-cert\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232212    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-certificates\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232245    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-skmhv\" (UID: \"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232271    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-system-cni-dir\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232306    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-node-log\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232337    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-bound-sa-token\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232366    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-host\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232396    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232423    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-cni-bin\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.232461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232455    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nrnx\" (UniqueName: \"kubernetes.io/projected/6af24624-056b-44b8-bef3-8a894bf0078b-kube-api-access-8nrnx\") pod \"iptables-alerter-z8qm8\" (UID: \"6af24624-056b-44b8-bef3-8a894bf0078b\") " pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232484    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d58dca9-093d-416e-b353-9e9b792d6c23-hosts-file\") pod \"node-resolver-zhhh4\" (UID: \"6d58dca9-093d-416e-b353-9e9b792d6c23\") " pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232516    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-modprobe-d\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232542    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37575185-c078-4be7-afa9-f7f860f29d49-crio-socket\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232574    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gns8k\" (UniqueName: \"kubernetes.io/projected/c28402b8-cc54-4896-955c-a0dc2d5e156d-kube-api-access-gns8k\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232604    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-log-socket\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232633    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-netns\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232663    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-conf-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232705    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232738    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqzpn\" (UniqueName: \"kubernetes.io/projected/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-kube-api-access-mqzpn\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232779    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-env-overrides\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.232836    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-hostroot\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233355    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b1746a5-d5b0-4786-908b-09797786de96-serving-cert\") pod \"service-ca-operator-544d749c8c-tp26d\" (UID: \"6b1746a5-d5b0-4786-908b-09797786de96\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233386    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-kubernetes\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233433    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c28402b8-cc54-4896-955c-a0dc2d5e156d-snapshots\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233462    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03c4973c-9623-4cb4-a239-efdae2ff0b90-host\") pod \"node-ca-j6x9n\" (UID: \"03c4973c-9623-4cb4-a239-efdae2ff0b90\") " pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233497    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/add4a18a-fa1b-45c7-8719-2c88634c6488-ovn-node-metrics-cert\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233534    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-image-registry-private-configuration\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233570    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9q2b\" (UniqueName: \"kubernetes.io/projected/6d58dca9-093d-416e-b353-9e9b792d6c23-kube-api-access-h9q2b\") pod \"node-resolver-zhhh4\" (UID: \"6d58dca9-093d-416e-b353-9e9b792d6c23\") " pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233604    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-stats-auth\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233633    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/186ffaf9-fc18-4605-9c8c-c9c31bda5379-ca-trust-extracted\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233664    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-cnibin\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233717    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-kubelet\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233732    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/877a7e09-3007-4c2a-97ef-690e99a27dc5-tmp\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233747    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-multus-certs\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.233793 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233789    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5w4l\" (UniqueName: \"kubernetes.io/projected/b9112244-9e99-4f1d-b2a5-576d56dc0718-kube-api-access-d5w4l\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233830    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zccg7\" (UniqueName: \"kubernetes.io/projected/03c4973c-9623-4cb4-a239-efdae2ff0b90-kube-api-access-zccg7\") pod \"node-ca-j6x9n\" (UID: \"03c4973c-9623-4cb4-a239-efdae2ff0b90\") " pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233865    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233903    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-sys\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233933    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/795237f3-0ac3-4842-90f3-0378a80e5c33-ca-trust-extracted\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233966    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-socket-dir-parent\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.233999    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjrrb\" (UniqueName: \"kubernetes.io/projected/d03f7bd1-7d99-438a-aa20-e614e86c1235-kube-api-access-pjrrb\") pod \"ingress-canary-tnx6d\" (UID: \"d03f7bd1-7d99-438a-aa20-e614e86c1235\") " pod="openshift-ingress-canary/ingress-canary-tnx6d"
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.234031    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c28402b8-cc54-4896-955c-a0dc2d5e156d-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.234145    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.234255    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-installation-pull-secrets\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.234313    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a447a17d-b65e-40a2-b200-635ee45355ba-tmp-dir\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.234324    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.234814    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c28402b8-cc54-4896-955c-a0dc2d5e156d-snapshots\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.234886    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235019    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c28402b8-cc54-4896-955c-a0dc2d5e156d-tmp\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235075    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-skmhv\" (UID: \"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235198    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-slash\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235203    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:23.235246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235226    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c28402b8-cc54-4896-955c-a0dc2d5e156d-service-ca-bundle\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:23.236032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235539    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b1746a5-d5b0-4786-908b-09797786de96-config\") pod \"service-ca-operator-544d749c8c-tp26d\" (UID: \"6b1746a5-d5b0-4786-908b-09797786de96\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:23.236032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235596    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03c4973c-9623-4cb4-a239-efdae2ff0b90-serviceca\") pod \"node-ca-j6x9n\" (UID: \"03c4973c-9623-4cb4-a239-efdae2ff0b90\") " pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:44:23.236032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235596    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:23.236032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235650    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/186ffaf9-fc18-4605-9c8c-c9c31bda5379-ca-trust-extracted\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.236032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235698    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 21:44:23.236032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235761    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/795237f3-0ac3-4842-90f3-0378a80e5c33-ca-trust-extracted\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.236032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235833    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-ovn\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.236032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235854    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18b98618-898b-4a48-bb05-51e61ca7fe0a-serving-cert\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:23.236032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235717    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-certificates\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.236032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235861    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-k8s-cni-cncf-io\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.236032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235936    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-run\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.236032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235979    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-589gf\" (UniqueName: \"kubernetes.io/projected/37575185-c078-4be7-afa9-f7f860f29d49-kube-api-access-589gf\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:23.236032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.235990    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-image-registry-private-configuration\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.236032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.236011    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-skmhv\" (UID: \"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:23.236721 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.236132    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm82w\" (UniqueName: \"kubernetes.io/projected/6b1746a5-d5b0-4786-908b-09797786de96-kube-api-access-tm82w\") pod \"service-ca-operator-544d749c8c-tp26d\" (UID: \"6b1746a5-d5b0-4786-908b-09797786de96\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:23.236721 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.236424    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-image-registry-private-configuration\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.236721 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.236572    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 21:44:23.236721 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.236591    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18b98618-898b-4a48-bb05-51e61ca7fe0a-trusted-ca\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:23.236721 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.236665    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-default-certificate\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:23.236721 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.236702    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.237081 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.236794    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-tuned\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.237081 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237049    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d03f7bd1-7d99-438a-aa20-e614e86c1235-cert\") pod \"ingress-canary-tnx6d\" (UID: \"d03f7bd1-7d99-438a-aa20-e614e86c1235\") " pod="openshift-ingress-canary/ingress-canary-tnx6d"
Oct 30 21:44:23.237395 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237090    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-socket-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.237395 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237120    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-systemd\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.237395 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237149    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-etc-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.237395 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237182    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwj9\" (UniqueName: \"kubernetes.io/projected/f3017ee4-5edc-43b8-ad16-107517393622-kube-api-access-6bwj9\") pod \"volume-data-source-validator-58c9f5f46d-7zlst\" (UID: \"f3017ee4-5edc-43b8-ad16-107517393622\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7zlst"
Oct 30 21:44:23.237395 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237280    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-stats-auth\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:23.237395 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237356    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-kubelet\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.237395 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237360    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b9112244-9e99-4f1d-b2a5-576d56dc0718-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:23.237395 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237391    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-trusted-ca\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.237809 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237404    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-skmhv\" (UID: \"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:23.237809 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237420    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-installation-pull-secrets\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.237809 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237596    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cni-binary-copy\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.237809 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237753    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-installation-pull-secrets\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.237809 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237780    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-trusted-ca\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.238035 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237855    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0df7f3e5-6d57-46f7-a23b-fd130d949fe2-agent-certs\") pod \"konnectivity-agent-kfvjg\" (UID: \"0df7f3e5-6d57-46f7-a23b-fd130d949fe2\") " pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:44:23.238035 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237907    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:23.238035 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237922    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cni-binary-copy\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.238035 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.237995    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18b98618-898b-4a48-bb05-51e61ca7fe0a-config\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:23.238035 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238030    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37575185-c078-4be7-afa9-f7f860f29d49-data-volume\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:23.238198 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238131    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:23.238198 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238152    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f695b\" (UniqueName: \"kubernetes.io/projected/7e81cfe7-52d2-474c-8261-66ce6cf58945-kube-api-access-f695b\") pod \"kas-connection-checker-685895c7c9-chqp7\" (UID: \"7e81cfe7-52d2-474c-8261-66ce6cf58945\") " pod="kube-system/kas-connection-checker-685895c7c9-chqp7"
Oct 30 21:44:23.238198 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238153    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18b98618-898b-4a48-bb05-51e61ca7fe0a-config\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:23.238377 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238264    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37575185-c078-4be7-afa9-f7f860f29d49-data-volume\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:23.238377 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238293    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d58dca9-093d-416e-b353-9e9b792d6c23-tmp-dir\") pod \"node-resolver-zhhh4\" (UID: \"6d58dca9-093d-416e-b353-9e9b792d6c23\") " pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:44:23.238377 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238356    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d58dca9-093d-416e-b353-9e9b792d6c23-tmp-dir\") pod \"node-resolver-zhhh4\" (UID: \"6d58dca9-093d-416e-b353-9e9b792d6c23\") " pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:44:23.238510 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238394    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6af24624-056b-44b8-bef3-8a894bf0078b-host-slash\") pod \"iptables-alerter-z8qm8\" (UID: \"6af24624-056b-44b8-bef3-8a894bf0078b\") " pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:44:23.238510 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238442    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s68fv\" (UniqueName: \"kubernetes.io/projected/877a7e09-3007-4c2a-97ef-690e99a27dc5-kube-api-access-s68fv\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.238510 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238488    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c28402b8-cc54-4896-955c-a0dc2d5e156d-serving-cert\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:23.238624 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238553    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-run-ovn-kubernetes\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.238624 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238584    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-ovnkube-config\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.238624 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238604    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc9l8\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-kube-api-access-fc9l8\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.238813 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238651    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-system-cni-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.238813 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238650    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c28402b8-cc54-4896-955c-a0dc2d5e156d-serving-cert\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:23.238813 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238707    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-device-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.238813 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238744    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-certificates\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.238813 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238771    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a9a228b-279e-4895-972f-dbd2de5a9304-cni-binary-copy\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.238813 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238799    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b06a5cb-5c28-4146-bbea-bfbe2297136c-dbus\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:23.239081 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238859    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysconfig\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.239081 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238893    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-var-lib-kubelet\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.239081 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.238896    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-certificates\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.239081 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.239024    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a9a228b-279e-4895-972f-dbd2de5a9304-cni-binary-copy\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.244813 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.244791    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c28402b8-cc54-4896-955c-a0dc2d5e156d-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:23.247047 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.247024    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-trusted-ca\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.270827 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.270765    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.270827 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.270823    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 21:44:23.271160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.270858    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 21:44:23.271160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.270874    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 21:44:23.271160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.270878    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.271160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.270822    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.271160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.270926    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.271160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.270933    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 21:44:23.271160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.271044    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.271160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.271058    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 21:44:23.271160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.271068    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 21:44:23.271160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.271088    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.271160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.271115    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.271160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.271124    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.271160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.271132    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:44:23.271160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.271138    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.271160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.271149    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.271160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.271150    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 21:44:23.271670 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.271271    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 21:44:23.271670 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.271340    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 21:44:23.274222 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.274203    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-daemon-config\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.274222 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.274215    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-env-overrides\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.274422 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.274325    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6af24624-056b-44b8-bef3-8a894bf0078b-iptables-alerter-script\") pod \"iptables-alerter-z8qm8\" (UID: \"6af24624-056b-44b8-bef3-8a894bf0078b\") " pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:44:23.274773 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.274751    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 21:44:23.274849 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.274789    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6hfjp\""
Oct 30 21:44:23.274849 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.274826    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 21:44:23.274973 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.274877    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 21:44:23.274973 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.274936    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:44:23.274973 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.274938    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 21:44:23.274973 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.274952    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 21:44:23.275124 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.274983    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-6ptf6\""
Oct 30 21:44:23.275124 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.275024    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 21:44:23.275124 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.275068    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hkrw6\""
Oct 30 21:44:23.275251 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.275140    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sqd9j\""
Oct 30 21:44:23.275251 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.275167    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j2rr9\""
Oct 30 21:44:23.275251 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.275172    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-22kpt\""
Oct 30 21:44:23.275251 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.275213    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-gmj65\""
Oct 30 21:44:23.275251 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.275227    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:44:23.275251 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.275213    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-vzpnp\""
Oct 30 21:44:23.275413 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.275307    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s7wrh\""
Oct 30 21:44:23.275413 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.275360    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h7hc5\""
Oct 30 21:44:23.275413 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.275403    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ltjsw\""
Oct 30 21:44:23.275494 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.275428    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qjn2k\""
Oct 30 21:44:23.275494 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.275481    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-ph4bx\""
Oct 30 21:44:23.275551 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.275524    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vv25x\""
Oct 30 21:44:23.276448 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.276433    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/add4a18a-fa1b-45c7-8719-2c88634c6488-ovn-node-metrics-cert\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.276448 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.276440    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0df7f3e5-6d57-46f7-a23b-fd130d949fe2-konnectivity-ca\") pod \"konnectivity-agent-kfvjg\" (UID: \"0df7f3e5-6d57-46f7-a23b-fd130d949fe2\") " pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:44:23.277653 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.277639    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a447a17d-b65e-40a2-b200-635ee45355ba-config-volume\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:23.277713 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.277641    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d03f7bd1-7d99-438a-aa20-e614e86c1235-cert\") pod \"ingress-canary-tnx6d\" (UID: \"d03f7bd1-7d99-438a-aa20-e614e86c1235\") " pod="openshift-ingress-canary/ingress-canary-tnx6d"
Oct 30 21:44:23.277713 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.277661    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-ovnkube-script-lib\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.277780 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.277752    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9b06a5cb-5c28-4146-bbea-bfbe2297136c-original-pull-secret\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:23.278823 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.278806    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0df7f3e5-6d57-46f7-a23b-fd130d949fe2-agent-certs\") pod \"konnectivity-agent-kfvjg\" (UID: \"0df7f3e5-6d57-46f7-a23b-fd130d949fe2\") " pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:44:23.278873 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.278848    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/add4a18a-fa1b-45c7-8719-2c88634c6488-ovnkube-config\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.292084 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.292059    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-bound-sa-token\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.292261 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.292234    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nrnx\" (UniqueName: \"kubernetes.io/projected/6af24624-056b-44b8-bef3-8a894bf0078b-kube-api-access-8nrnx\") pod \"iptables-alerter-z8qm8\" (UID: \"6af24624-056b-44b8-bef3-8a894bf0078b\") " pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:44:23.292472 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.292446    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq9cs\" (UniqueName: \"kubernetes.io/projected/976afac6-c62a-4e90-aaa1-5cc80852e988-kube-api-access-cq9cs\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.292545 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.292505    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnmdv\" (UniqueName: \"kubernetes.io/projected/e2357ae3-0e6b-427c-84f5-fda3350920c4-kube-api-access-rnmdv\") pod \"kas-connection-checker-685895c7c9-sdtr4\" (UID: \"e2357ae3-0e6b-427c-84f5-fda3350920c4\") " pod="kube-system/kas-connection-checker-685895c7c9-sdtr4"
Oct 30 21:44:23.292797 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.292777    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7nrc\" (UniqueName: \"kubernetes.io/projected/a447a17d-b65e-40a2-b200-635ee45355ba-kube-api-access-k7nrc\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:23.292833 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.292786    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdnlt\" (UniqueName: \"kubernetes.io/projected/5a9a228b-279e-4895-972f-dbd2de5a9304-kube-api-access-mdnlt\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.292871 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.292838    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5zvx\" (UniqueName: \"kubernetes.io/projected/f1c0a201-8b48-44fb-b107-a5f2bb798235-kube-api-access-j5zvx\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:23.294624 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.294604    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9q2b\" (UniqueName: \"kubernetes.io/projected/6d58dca9-093d-416e-b353-9e9b792d6c23-kube-api-access-h9q2b\") pod \"node-resolver-zhhh4\" (UID: \"6d58dca9-093d-416e-b353-9e9b792d6c23\") " pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:44:23.294707 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.294612    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zccg7\" (UniqueName: \"kubernetes.io/projected/03c4973c-9623-4cb4-a239-efdae2ff0b90-kube-api-access-zccg7\") pod \"node-ca-j6x9n\" (UID: \"03c4973c-9623-4cb4-a239-efdae2ff0b90\") " pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:44:23.294753 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.294723    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gns8k\" (UniqueName: \"kubernetes.io/projected/c28402b8-cc54-4896-955c-a0dc2d5e156d-kube-api-access-gns8k\") pod \"insights-operator-7c4986d449-vbwwf\" (UID: \"c28402b8-cc54-4896-955c-a0dc2d5e156d\") " pod="openshift-insights/insights-operator-7c4986d449-vbwwf"
Oct 30 21:44:23.295887 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.295867    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-bound-sa-token\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.295971 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.295890    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:23.297318 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.297300    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh2dx\" (UniqueName: \"kubernetes.io/projected/a4e14574-aa2d-4fc4-ba26-a07f4a669296-kube-api-access-dh2dx\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:23.299173 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.299154    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n6jd\" (UniqueName: \"kubernetes.io/projected/0aab5a63-4de8-4a6e-a9e7-f7ba260754c8-kube-api-access-2n6jd\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-skmhv\" (UID: \"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv"
Oct 30 21:44:23.299605 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.299583    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n29gb\" (UniqueName: \"kubernetes.io/projected/008b8a95-23ad-416e-ba30-39b63495f28d-kube-api-access-n29gb\") pod \"migrator-66df5d496b-cgx2d\" (UID: \"008b8a95-23ad-416e-ba30-39b63495f28d\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cgx2d"
Oct 30 21:44:23.299981 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.299963    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bwj9\" (UniqueName: \"kubernetes.io/projected/f3017ee4-5edc-43b8-ad16-107517393622-kube-api-access-6bwj9\") pod \"volume-data-source-validator-58c9f5f46d-7zlst\" (UID: \"f3017ee4-5edc-43b8-ad16-107517393622\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-7zlst"
Oct 30 21:44:23.300074 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.300055    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm82w\" (UniqueName: \"kubernetes.io/projected/6b1746a5-d5b0-4786-908b-09797786de96-kube-api-access-tm82w\") pod \"service-ca-operator-544d749c8c-tp26d\" (UID: \"6b1746a5-d5b0-4786-908b-09797786de96\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d"
Oct 30 21:44:23.300127 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.300108    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-589gf\" (UniqueName: \"kubernetes.io/projected/37575185-c078-4be7-afa9-f7f860f29d49-kube-api-access-589gf\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:23.300204 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.300185    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pspz2\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-kube-api-access-pspz2\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.300236 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.300213    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrc2w\" (UniqueName: \"kubernetes.io/projected/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-kube-api-access-mrc2w\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:23.300307 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.300279    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5w4l\" (UniqueName: \"kubernetes.io/projected/b9112244-9e99-4f1d-b2a5-576d56dc0718-kube-api-access-d5w4l\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:23.300552 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.300536    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwq8k\" (UniqueName: \"kubernetes.io/projected/ec41ebc2-3ff6-4453-8eb4-c420b02516c2-kube-api-access-wwq8k\") pod \"network-check-target-r54tb\" (UID: \"ec41ebc2-3ff6-4453-8eb4-c420b02516c2\") " pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:44:23.301178 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.301163    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f695b\" (UniqueName: \"kubernetes.io/projected/7e81cfe7-52d2-474c-8261-66ce6cf58945-kube-api-access-f695b\") pod \"kas-connection-checker-685895c7c9-chqp7\" (UID: \"7e81cfe7-52d2-474c-8261-66ce6cf58945\") " pod="kube-system/kas-connection-checker-685895c7c9-chqp7"
Oct 30 21:44:23.302488 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.302471    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h68gq\" (UniqueName: \"kubernetes.io/projected/18b98618-898b-4a48-bb05-51e61ca7fe0a-kube-api-access-h68gq\") pod \"console-operator-7cd56b8dbc-8hc58\" (UID: \"18b98618-898b-4a48-bb05-51e61ca7fe0a\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:23.303521 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.303504    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc9l8\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-kube-api-access-fc9l8\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.304349 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.304330    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xblpt\" (UniqueName: \"kubernetes.io/projected/aab14d71-ddf4-41c6-80a8-70b258aee1d4-kube-api-access-xblpt\") pod \"kas-connection-checker-685895c7c9-t9r98\" (UID: \"aab14d71-ddf4-41c6-80a8-70b258aee1d4\") " pod="kube-system/kas-connection-checker-685895c7c9-t9r98"
Oct 30 21:44:23.304664 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.304645    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s68fv\" (UniqueName: \"kubernetes.io/projected/877a7e09-3007-4c2a-97ef-690e99a27dc5-kube-api-access-s68fv\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.304838 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.304823    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdwl5\" (UniqueName: \"kubernetes.io/projected/0d921c53-691c-4969-bdd4-f7b87db0e61b-kube-api-access-zdwl5\") pod \"network-check-source-6f78d59f99-ghx6v\" (UID: \"0d921c53-691c-4969-bdd4-f7b87db0e61b\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-ghx6v"
Oct 30 21:44:23.304925 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.304905    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjrrb\" (UniqueName: \"kubernetes.io/projected/d03f7bd1-7d99-438a-aa20-e614e86c1235-kube-api-access-pjrrb\") pod \"ingress-canary-tnx6d\" (UID: \"d03f7bd1-7d99-438a-aa20-e614e86c1235\") " pod="openshift-ingress-canary/ingress-canary-tnx6d"
Oct 30 21:44:23.305014 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.305000    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqzpn\" (UniqueName: \"kubernetes.io/projected/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-kube-api-access-mqzpn\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.305060 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.305047    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlbpz\" (UniqueName: \"kubernetes.io/projected/add4a18a-fa1b-45c7-8719-2c88634c6488-kube-api-access-nlbpz\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.339922 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.339903    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-cnibin\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.339979 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.339926    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-kubelet\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.339979 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.339940    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-multus-certs\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.339979 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.339955    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.339979 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.339968    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-sys\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.340153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.339984    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-socket-dir-parent\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.340153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340009    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-slash\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.340153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340008    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-multus-certs\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.340153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340042    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.340153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340050    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-cnibin\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.340153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340008    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-kubelet\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.340153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340059    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-sys\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.340153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340055    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-ovn\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.340153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340087    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-ovn\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.340153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340086    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-socket-dir-parent\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.340153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340063    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-slash\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.340153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340101    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-k8s-cni-cncf-io\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.340153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340134    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-k8s-cni-cncf-io\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.340153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340139    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-run\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340165    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-socket-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340179    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-systemd\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340193    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-etc-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340208    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-kubelet\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340225    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340226    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-run-systemd\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340235    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-socket-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340240    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340268    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-kubelet\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340272    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6af24624-056b-44b8-bef3-8a894bf0078b-host-slash\") pod \"iptables-alerter-z8qm8\" (UID: \"6af24624-056b-44b8-bef3-8a894bf0078b\") " pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340300    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-run-ovn-kubernetes\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340308    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6af24624-056b-44b8-bef3-8a894bf0078b-host-slash\") pod \"iptables-alerter-z8qm8\" (UID: \"6af24624-056b-44b8-bef3-8a894bf0078b\") " pod="openshift-network-operator/iptables-alerter-z8qm8"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340321    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-run-ovn-kubernetes\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.340325    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:23.840305987 +0000 UTC m=+1.888913679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : configmap references non-existent config key: service-ca.crt
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.340325    4918 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340343    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-etc-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340349    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-system-cni-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.340369    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert podName:b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:23.840361959 +0000 UTC m=+1.888969680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pfzwt" (UID: "b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5") : secret "networking-console-plugin-cert" not found
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340378    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-run\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340380    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-device-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340389    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-system-cni-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340404    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b06a5cb-5c28-4146-bbea-bfbe2297136c-dbus\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340419    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysconfig\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340435    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-var-lib-kubelet\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340449    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340464    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-device-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340472    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340479    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9b06a5cb-5c28-4146-bbea-bfbe2297136c-dbus\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340506    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysconfig\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340514    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-var-lib-kubelet\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.340530    4918 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340534    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.340545    4918 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340554    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-etc-kubernetes\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.340580    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls podName:a447a17d-b65e-40a2-b200-635ee45355ba nodeName:}" failed. No retries permitted until 2026-10-30 21:44:23.840563218 +0000 UTC m=+1.889170894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls") pod "dns-default-4hw29" (UID: "a447a17d-b65e-40a2-b200-635ee45355ba") : secret "dns-default-metrics-tls" not found
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340579    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-etc-kubernetes\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.340607    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:23.840601373 +0000 UTC m=+1.889209046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : secret "router-metrics-certs-default" not found
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.340613    4918 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340619    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.340628    4918 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775f87bbf6-82p7v: secret "image-registry-tls" not found
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340646    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340663    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cnibin\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340646    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.340640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340676    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysctl-d\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.340711    4918 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.340719    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls podName:186ffaf9-fc18-4605-9c8c-c9c31bda5379 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:23.84070539 +0000 UTC m=+1.889313082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls") pod "image-registry-775f87bbf6-82p7v" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379") : secret "image-registry-tls" not found
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340735    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-cnibin\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.340763    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs podName:f1c0a201-8b48-44fb-b107-a5f2bb798235 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:23.840750003 +0000 UTC m=+1.889357681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs") pod "network-metrics-daemon-jdg72" (UID: "f1c0a201-8b48-44fb-b107-a5f2bb798235") : secret "metrics-daemon-secret" not found
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340784    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-registration-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340796    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysctl-d\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340806    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-registration-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340814    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b06a5cb-5c28-4146-bbea-bfbe2297136c-kubelet-config\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340830    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-sys-fs\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340868    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-sys-fs\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340871    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9b06a5cb-5c28-4146-bbea-bfbe2297136c-kubelet-config\") pod \"global-pull-secret-syncer-8c64w\" (UID: \"9b06a5cb-5c28-4146-bbea-bfbe2297136c\") " pod="kube-system/global-pull-secret-syncer-8c64w"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340896    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340925    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340949    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-etc-selinux\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340973    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-cni-netd\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340979    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.340986    4918 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340998    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/976afac6-c62a-4e90-aaa1-5cc80852e988-etc-selinux\") pod \"aws-ebs-csi-driver-node-mc5th\" (UID: \"976afac6-c62a-4e90-aaa1-5cc80852e988\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mc5th"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341006    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-cni-netd\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.341011    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls podName:b9112244-9e99-4f1d-b2a5-576d56dc0718 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:23.841003586 +0000 UTC m=+1.889611259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-54ntg" (UID: "b9112244-9e99-4f1d-b2a5-576d56dc0718") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.340997    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341032    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-systemd-units\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341046    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.341060    4918 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341070    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-systemd-units\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341061    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-cni-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341092    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-cni-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.341100    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls podName:40cb9ea7-fe94-41e7-abd3-70a2c6d31fff nodeName:}" failed. No retries permitted until 2026-10-30 21:44:23.841088603 +0000 UTC m=+1.889696305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-z67rm" (UID: "40cb9ea7-fe94-41e7-abd3-70a2c6d31fff") : secret "samples-operator-tls" not found
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.341127    4918 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.341136    4918 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d78449d9-mmjp2: secret "image-registry-tls" not found
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341138    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-run-netns\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.341167    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls podName:795237f3-0ac3-4842-90f3-0378a80e5c33 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:23.841158285 +0000 UTC m=+1.889765985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls") pod "image-registry-8d78449d9-mmjp2" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33") : secret "image-registry-tls" not found
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341164    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-cni-multus\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341189    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-run-netns\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341194    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysctl-conf\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341213    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-cni-multus\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341217    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-systemd\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341242    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-systemd\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341242    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37575185-c078-4be7-afa9-f7f860f29d49-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341265    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-sysctl-conf\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341267    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-var-lib-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341292    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-cni-bin\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341320    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-lib-modules\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341337    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-var-lib-openvswitch\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341347    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-system-cni-dir\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341371    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-node-log\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341376    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-host-cni-bin\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341393    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-host\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341401    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-system-cni-dir\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341409    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-node-log\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341418    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341430    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-host\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341438    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-lib-modules\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341444    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-cni-bin\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.341474    4918 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341474    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d58dca9-093d-416e-b353-9e9b792d6c23-hosts-file\") pod \"node-resolver-zhhh4\" (UID: \"6d58dca9-093d-416e-b353-9e9b792d6c23\") " pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341476    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-var-lib-cni-bin\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.341497    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls podName:37575185-c078-4be7-afa9-f7f860f29d49 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:23.84148952 +0000 UTC m=+1.890097192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls") pod "insights-runtime-extractor-48xwh" (UID: "37575185-c078-4be7-afa9-f7f860f29d49") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341504    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d58dca9-093d-416e-b353-9e9b792d6c23-hosts-file\") pod \"node-resolver-zhhh4\" (UID: \"6d58dca9-093d-416e-b353-9e9b792d6c23\") " pod="openshift-dns/node-resolver-zhhh4"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341509    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-modprobe-d\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341525    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37575185-c078-4be7-afa9-f7f860f29d49-crio-socket\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341539    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-log-socket\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341553    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-netns\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341568    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-conf-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341581    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341591    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37575185-c078-4be7-afa9-f7f860f29d49-crio-socket\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341599    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-hostroot\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341599    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/add4a18a-fa1b-45c7-8719-2c88634c6488-log-socket\") pod \"ovnkube-node-mnpfz\" (UID: \"add4a18a-fa1b-45c7-8719-2c88634c6488\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341623    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-kubernetes\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341628    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-multus-conf-dir\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341615    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-host-run-netns\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341649    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c4ffd66e-ea60-4d77-820e-2a8740fe9dff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pjtvc\" (UID: \"c4ffd66e-ea60-4d77-820e-2a8740fe9dff\") " pod="openshift-multus/multus-additional-cni-plugins-pjtvc"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341656    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03c4973c-9623-4cb4-a239-efdae2ff0b90-host\") pod \"node-ca-j6x9n\" (UID: \"03c4973c-9623-4cb4-a239-efdae2ff0b90\") " pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341669    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-modprobe-d\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341670    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/877a7e09-3007-4c2a-97ef-690e99a27dc5-etc-kubernetes\") pod \"tuned-ccgs8\" (UID: \"877a7e09-3007-4c2a-97ef-690e99a27dc5\") " pod="openshift-cluster-node-tuning-operator/tuned-ccgs8"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341735    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03c4973c-9623-4cb4-a239-efdae2ff0b90-host\") pod \"node-ca-j6x9n\" (UID: \"03c4973c-9623-4cb4-a239-efdae2ff0b90\") " pod="openshift-image-registry/node-ca-j6x9n"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341740    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a9a228b-279e-4895-972f-dbd2de5a9304-hostroot\") pod \"multus-zldds\" (UID: \"5a9a228b-279e-4895-972f-dbd2de5a9304\") " pod="openshift-multus/multus-zldds"
Oct 30 21:44:23.342290 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.341775    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37575185-c078-4be7-afa9-f7f860f29d49-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:23.420214 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.420192    4918 scope.go:122] "RemoveContainer" containerID="2c4a7ffe669b4633bcf7d93de74dd03f8fc10084061b3cbf465faea71f0467cd"
Oct 30 21:44:23.436617 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.436598    4918 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:44:23.835016 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.834951    4918 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:23.845427 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.845406    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:23.845513 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.845434    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:23.845513 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.845460    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:23.845513 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.845481    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:23.845513 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.845505    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:23.845704 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.845528    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:23.845704 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.845556    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:23.845704 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.845575    4918 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:44:23.845704 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.845614    4918 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:23.845704 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.845636    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls podName:a447a17d-b65e-40a2-b200-635ee45355ba nodeName:}" failed. No retries permitted until 2026-10-30 21:44:24.84562096 +0000 UTC m=+2.894228632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls") pod "dns-default-4hw29" (UID: "a447a17d-b65e-40a2-b200-635ee45355ba") : secret "dns-default-metrics-tls" not found
Oct 30 21:44:23.845704 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.845638    4918 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:44:23.845704 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.845577    4918 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 21:44:23.845704 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.845662    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:23.845704 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.845576    4918 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:44:23.846073 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.846057    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs podName:f1c0a201-8b48-44fb-b107-a5f2bb798235 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:24.84570425 +0000 UTC m=+2.894311924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs") pod "network-metrics-daemon-jdg72" (UID: "f1c0a201-8b48-44fb-b107-a5f2bb798235") : secret "metrics-daemon-secret" not found
Oct 30 21:44:23.846125 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.846099    4918 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:44:23.846170 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.845580    4918 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:23.846170 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.846153    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls podName:b9112244-9e99-4f1d-b2a5-576d56dc0718 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:24.846129189 +0000 UTC m=+2.894736876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-54ntg" (UID: "b9112244-9e99-4f1d-b2a5-576d56dc0718") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:23.846170 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.846165    4918 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775f87bbf6-82p7v: secret "image-registry-tls" not found
Oct 30 21:44:23.846306 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.846177    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls podName:37575185-c078-4be7-afa9-f7f860f29d49 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:24.846164806 +0000 UTC m=+2.894772480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls") pod "insights-runtime-extractor-48xwh" (UID: "37575185-c078-4be7-afa9-f7f860f29d49") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:44:23.846306 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.846151    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:23.846306 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.846210    4918 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:23.846306 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.846221    4918 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d78449d9-mmjp2: secret "image-registry-tls" not found
Oct 30 21:44:23.846306 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.846237    4918 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:44:23.846306 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:23.846249    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:23.846306 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.846266    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:24.846242413 +0000 UTC m=+2.894850102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : secret "router-metrics-certs-default" not found
Oct 30 21:44:23.846306 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.846302    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls podName:795237f3-0ac3-4842-90f3-0378a80e5c33 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:24.846288963 +0000 UTC m=+2.894896639 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls") pod "image-registry-8d78449d9-mmjp2" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33") : secret "image-registry-tls" not found
Oct 30 21:44:23.846659 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.846395    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls podName:186ffaf9-fc18-4605-9c8c-c9c31bda5379 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:24.846362435 +0000 UTC m=+2.894970122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls") pod "image-registry-775f87bbf6-82p7v" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379") : secret "image-registry-tls" not found
Oct 30 21:44:23.846659 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.846421    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls podName:40cb9ea7-fe94-41e7-abd3-70a2c6d31fff nodeName:}" failed. No retries permitted until 2026-10-30 21:44:24.846406508 +0000 UTC m=+2.895014180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-z67rm" (UID: "40cb9ea7-fe94-41e7-abd3-70a2c6d31fff") : secret "samples-operator-tls" not found
Oct 30 21:44:23.846659 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.846445    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert podName:b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:24.846435797 +0000 UTC m=+2.895043476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pfzwt" (UID: "b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5") : secret "networking-console-plugin-cert" not found
Oct 30 21:44:23.846659 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:23.846461    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:24.846451719 +0000 UTC m=+2.895059428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : configmap references non-existent config key: service-ca.crt
Oct 30 21:44:24.122878 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.122818    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 21:44:24.123264 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.123242    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/1.log"
Oct 30 21:44:24.123304 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.123271    4918 generic.go:356] "Generic (PLEG): container finished" podID="18b98618-898b-4a48-bb05-51e61ca7fe0a" containerID="8dd2c4ae77ec434f6f3832bd38d08e7de9ded45f4635a5df320a22c01a56c9d6" exitCode=255
Oct 30 21:44:24.123357 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.123335    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58" event={"ID":"18b98618-898b-4a48-bb05-51e61ca7fe0a","Type":"ContainerDied","Data":"8dd2c4ae77ec434f6f3832bd38d08e7de9ded45f4635a5df320a22c01a56c9d6"}
Oct 30 21:44:24.123390 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.123383    4918 scope.go:122] "RemoveContainer" containerID="2c4a7ffe669b4633bcf7d93de74dd03f8fc10084061b3cbf465faea71f0467cd"
Oct 30 21:44:24.123541 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.123527    4918 scope.go:122] "RemoveContainer" containerID="8dd2c4ae77ec434f6f3832bd38d08e7de9ded45f4635a5df320a22c01a56c9d6"
Oct 30 21:44:24.123738 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.123718    4918 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8hc58_openshift-console-operator(18b98618-898b-4a48-bb05-51e61ca7fe0a)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58" podUID="18b98618-898b-4a48-bb05-51e61ca7fe0a"
Oct 30 21:44:24.134005 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.133981    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:24.856126 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.856096    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:24.856126 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.856131    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:24.856380 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.856152    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:24.856380 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.856185    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:24.856380 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.856221    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:24.856380 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.856238    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:24.856380 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856237    4918 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:24.856380 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.856267    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:24.856380 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856272    4918 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:44:24.856380 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.856289    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:24.856380 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856302    4918 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:44:24.856380 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856319    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls podName:b9112244-9e99-4f1d-b2a5-576d56dc0718 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.856297571 +0000 UTC m=+4.904905272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-54ntg" (UID: "b9112244-9e99-4f1d-b2a5-576d56dc0718") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:24.856380 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856340    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls podName:37575185-c078-4be7-afa9-f7f860f29d49 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.856328782 +0000 UTC m=+4.904936457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls") pod "insights-runtime-extractor-48xwh" (UID: "37575185-c078-4be7-afa9-f7f860f29d49") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:44:24.856380 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856341    4918 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:44:24.856380 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856353    4918 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:44:24.856380 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.856362    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:24.856380 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856378    4918 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:44:24.856380 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856391    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.856372519 +0000 UTC m=+4.904980213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : configmap references non-existent config key: service-ca.crt
Oct 30 21:44:24.856904 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856393    4918 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:24.856904 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856411    4918 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d78449d9-mmjp2: secret "image-registry-tls" not found
Oct 30 21:44:24.856904 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856414    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls podName:a447a17d-b65e-40a2-b200-635ee45355ba nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.856406611 +0000 UTC m=+4.905014284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls") pod "dns-default-4hw29" (UID: "a447a17d-b65e-40a2-b200-635ee45355ba") : secret "dns-default-metrics-tls" not found
Oct 30 21:44:24.856904 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856423    4918 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:24.856904 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856428    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls podName:40cb9ea7-fe94-41e7-abd3-70a2c6d31fff nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.856421875 +0000 UTC m=+4.905029548 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-z67rm" (UID: "40cb9ea7-fe94-41e7-abd3-70a2c6d31fff") : secret "samples-operator-tls" not found
Oct 30 21:44:24.856904 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856433    4918 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775f87bbf6-82p7v: secret "image-registry-tls" not found
Oct 30 21:44:24.856904 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856444    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert podName:b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.856436142 +0000 UTC m=+4.905043817 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pfzwt" (UID: "b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5") : secret "networking-console-plugin-cert" not found
Oct 30 21:44:24.856904 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856460    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls podName:186ffaf9-fc18-4605-9c8c-c9c31bda5379 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.856454203 +0000 UTC m=+4.905061875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls") pod "image-registry-775f87bbf6-82p7v" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379") : secret "image-registry-tls" not found
Oct 30 21:44:24.856904 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856477    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.856472377 +0000 UTC m=+4.905080053 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : secret "router-metrics-certs-default" not found
Oct 30 21:44:24.856904 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856492    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls podName:795237f3-0ac3-4842-90f3-0378a80e5c33 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.856486798 +0000 UTC m=+4.905094471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls") pod "image-registry-8d78449d9-mmjp2" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33") : secret "image-registry-tls" not found
Oct 30 21:44:24.856904 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:24.856526    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:24.856904 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856603    4918 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 21:44:24.856904 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:24.856629    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs podName:f1c0a201-8b48-44fb-b107-a5f2bb798235 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:26.856623615 +0000 UTC m=+4.905231301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs") pod "network-metrics-daemon-jdg72" (UID: "f1c0a201-8b48-44fb-b107-a5f2bb798235") : secret "metrics-daemon-secret" not found
Oct 30 21:44:25.132540 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:25.132465    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-cgx2d" event={"ID":"008b8a95-23ad-416e-ba30-39b63495f28d","Type":"ContainerStarted","Data":"6764046cc17740ba0b06a955943b98e321b4cd9ffaaac14e6c813b28f3f8da01"}
Oct 30 21:44:25.134031 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:25.134012    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 21:44:25.134318 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:25.134302    4918 scope.go:122] "RemoveContainer" containerID="8dd2c4ae77ec434f6f3832bd38d08e7de9ded45f4635a5df320a22c01a56c9d6"
Oct 30 21:44:25.134476 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:25.134458    4918 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8hc58_openshift-console-operator(18b98618-898b-4a48-bb05-51e61ca7fe0a)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58" podUID="18b98618-898b-4a48-bb05-51e61ca7fe0a"
Oct 30 21:44:25.889499 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:25.889467    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:26.025121 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:26.025093    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:26.136410 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:26.136382    4918 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:44:26.793046 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:26.792544    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:26.874103 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:26.874069    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:26.874103 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:26.874105    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:26.874305 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:26.874133    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:26.874305 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:26.874160    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:26.874305 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:26.874185    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:26.874305 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:26.874215    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:26.874305 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874214    4918 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:44:26.874305 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874245    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:30.874226004 +0000 UTC m=+8.922833703 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : configmap references non-existent config key: service-ca.crt
Oct 30 21:44:26.874305 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874264    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert podName:b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:30.874256058 +0000 UTC m=+8.922863731 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pfzwt" (UID: "b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5") : secret "networking-console-plugin-cert" not found
Oct 30 21:44:26.874305 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874282    4918 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:26.874305 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874290    4918 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:44:26.874305 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:26.874295    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874301    4918 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775f87bbf6-82p7v: secret "image-registry-tls" not found
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874327    4918 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874350    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:30.874332608 +0000 UTC m=+8.922940302 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : secret "router-metrics-certs-default" not found
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874353    4918 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874308    4918 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874371    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls podName:186ffaf9-fc18-4605-9c8c-c9c31bda5379 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:30.874358396 +0000 UTC m=+8.922966069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls") pod "image-registry-775f87bbf6-82p7v" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379") : secret "image-registry-tls" not found
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:26.874325    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874388    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls podName:b9112244-9e99-4f1d-b2a5-576d56dc0718 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:30.874378411 +0000 UTC m=+8.922986116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-54ntg" (UID: "b9112244-9e99-4f1d-b2a5-576d56dc0718") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874389    4918 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874418    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs podName:f1c0a201-8b48-44fb-b107-a5f2bb798235 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:30.874408145 +0000 UTC m=+8.923015821 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs") pod "network-metrics-daemon-jdg72" (UID: "f1c0a201-8b48-44fb-b107-a5f2bb798235") : secret "metrics-daemon-secret" not found
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874433    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls podName:a447a17d-b65e-40a2-b200-635ee45355ba nodeName:}" failed. No retries permitted until 2026-10-30 21:44:30.874428213 +0000 UTC m=+8.923035887 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls") pod "dns-default-4hw29" (UID: "a447a17d-b65e-40a2-b200-635ee45355ba") : secret "dns-default-metrics-tls" not found
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874457    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls podName:40cb9ea7-fe94-41e7-abd3-70a2c6d31fff nodeName:}" failed. No retries permitted until 2026-10-30 21:44:30.8744486 +0000 UTC m=+8.923056304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-z67rm" (UID: "40cb9ea7-fe94-41e7-abd3-70a2c6d31fff") : secret "samples-operator-tls" not found
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:26.874476    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:26.874514    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874583    4918 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874597    4918 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d78449d9-mmjp2: secret "image-registry-tls" not found
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874604    4918 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874646    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls podName:795237f3-0ac3-4842-90f3-0378a80e5c33 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:30.874631357 +0000 UTC m=+8.923239034 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls") pod "image-registry-8d78449d9-mmjp2" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33") : secret "image-registry-tls" not found
Oct 30 21:44:26.874787 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:26.874668    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls podName:37575185-c078-4be7-afa9-f7f860f29d49 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:30.874658242 +0000 UTC m=+8.923265958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls") pod "insights-runtime-extractor-48xwh" (UID: "37575185-c078-4be7-afa9-f7f860f29d49") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:44:26.992600 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:26.992582    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zhhh4_6d58dca9-093d-416e-b353-9e9b792d6c23/dns-node-resolver/0.log"
Oct 30 21:44:27.248934 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:27.248906    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:27.750943 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:27.750910    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:27.992382 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:27.992354    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j6x9n_03c4973c-9623-4cb4-a239-efdae2ff0b90/node-ca/0.log"
Oct 30 21:44:28.088339 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:28.088260    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:28.471032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:28.470994    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:28.593296 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:28.593250    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tnx6d_d03f7bd1-7d99-438a-aa20-e614e86c1235/serve-healthcheck-canary/0.log"
Oct 30 21:44:28.616275 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:28.616250    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:44:28.716717 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:28.716669    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:28.795193 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:28.795129    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-cgx2d_008b8a95-23ad-416e-ba30-39b63495f28d/migrator/0.log"
Oct 30 21:44:28.981427 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:28.981402    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:29.195223 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:29.195194    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-skmhv_0aab5a63-4de8-4a6e-a9e7-f7ba260754c8/kube-storage-version-migrator-operator/0.log"
Oct 30 21:44:29.239256 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:29.239224    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:29.488995 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:29.488916    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:30.715646 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.715608    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:30.911513 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.911479    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:30.911738 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.911525    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:30.911738 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.911560    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:30.911738 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.911585    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:30.911738 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.911610    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:30.911738 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.911641    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:30.911738 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.911716    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:30.911738 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.911741    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:30.912080 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:30.911742    4918 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:30.912080 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.911771    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:30.912080 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:30.911785    4918 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:44:30.912080 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:30.911826    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls podName:b9112244-9e99-4f1d-b2a5-576d56dc0718 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:38.911803318 +0000 UTC m=+16.960411060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-54ntg" (UID: "b9112244-9e99-4f1d-b2a5-576d56dc0718") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:44:30.912080 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:30.911869    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls podName:40cb9ea7-fe94-41e7-abd3-70a2c6d31fff nodeName:}" failed. No retries permitted until 2026-10-30 21:44:38.911847548 +0000 UTC m=+16.960455238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-z67rm" (UID: "40cb9ea7-fe94-41e7-abd3-70a2c6d31fff") : secret "samples-operator-tls" not found
Oct 30 21:44:30.912080 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.911799    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:30.912080 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:30.911893    4918 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:44:30.912080 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:30.911930    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle podName:a4e14574-aa2d-4fc4-ba26-a07f4a669296 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:38.911914625 +0000 UTC m=+16.960522384 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle") pod "router-default-6d865d79dc-z4f64" (UID: "a4e14574-aa2d-4fc4-ba26-a07f4a669296") : configmap references non-existent config key: service-ca.crt
Oct 30 21:44:30.912080 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:30.911970    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert podName:b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:38.911950967 +0000 UTC m=+16.960558689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pfzwt" (UID: "b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5") : secret "networking-console-plugin-cert" not found
Oct 30 21:44:30.912406 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.912130    4918 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 21:44:30.914920 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.914886    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37575185-c078-4be7-afa9-f7f860f29d49-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48xwh\" (UID: \"37575185-c078-4be7-afa9-f7f860f29d49\") " pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:30.915396 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.915364    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c0a201-8b48-44fb-b107-a5f2bb798235-metrics-certs\") pod \"network-metrics-daemon-jdg72\" (UID: \"f1c0a201-8b48-44fb-b107-a5f2bb798235\") " pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:30.915511 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.915469    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a447a17d-b65e-40a2-b200-635ee45355ba-metrics-tls\") pod \"dns-default-4hw29\" (UID: \"a447a17d-b65e-40a2-b200-635ee45355ba\") " pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:30.915575 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.915552    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls\") pod \"image-registry-775f87bbf6-82p7v\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") " pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:30.915666 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.915634    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4e14574-aa2d-4fc4-ba26-a07f4a669296-metrics-certs\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:30.915968 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.915948    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls\") pod \"image-registry-8d78449d9-mmjp2\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") " pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:30.925605 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.925583    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:30.931628 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.931607    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jdg72"
Oct 30 21:44:30.934318 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.934298    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:30.935456 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.935377    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-48xwh"
Oct 30 21:44:30.935511 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:30.935452    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:31.072728 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:31.072697    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:31.232769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:31.232744    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:31.233080 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:31.233068    4918 scope.go:122] "RemoveContainer" containerID="8dd2c4ae77ec434f6f3832bd38d08e7de9ded45f4635a5df320a22c01a56c9d6"
Oct 30 21:44:31.233250 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:44:31.233234    4918 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-8hc58_openshift-console-operator(18b98618-898b-4a48-bb05-51e61ca7fe0a)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58" podUID="18b98618-898b-4a48-bb05-51e61ca7fe0a"
Oct 30 21:44:31.383104 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:31.383029    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:31.414583 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:31.414557    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jdg72"]
Oct 30 21:44:31.418894 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:31.418862    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c0a201_8b48_44fb_b107_a5f2bb798235.slice/crio-273652481bd0abc686c44dcac163e15af4729c16d675af39ae8185c5d8229bb5 WatchSource:0}: Error finding container 273652481bd0abc686c44dcac163e15af4729c16d675af39ae8185c5d8229bb5: Status 404 returned error can't find the container with id 273652481bd0abc686c44dcac163e15af4729c16d675af39ae8185c5d8229bb5
Oct 30 21:44:31.428097 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:31.428070    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda447a17d_b65e_40a2_b200_635ee45355ba.slice/crio-361b965821386291e74906de430d0702f04e198da76189dbbfeb613cd83c467c WatchSource:0}: Error finding container 361b965821386291e74906de430d0702f04e198da76189dbbfeb613cd83c467c: Status 404 returned error can't find the container with id 361b965821386291e74906de430d0702f04e198da76189dbbfeb613cd83c467c
Oct 30 21:44:31.428505 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:31.428482    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37575185_c078_4be7_afa9_f7f860f29d49.slice/crio-3ba767b93b0032c29fea11e0a8744fe98ed5b35174acdabb0fe42db347f12ca1 WatchSource:0}: Error finding container 3ba767b93b0032c29fea11e0a8744fe98ed5b35174acdabb0fe42db347f12ca1: Status 404 returned error can't find the container with id 3ba767b93b0032c29fea11e0a8744fe98ed5b35174acdabb0fe42db347f12ca1
Oct 30 21:44:31.434938 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:31.434916    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4hw29"]
Oct 30 21:44:31.464057 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:31.463991    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-48xwh"]
Oct 30 21:44:31.474025 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:31.474009    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-775f87bbf6-82p7v"]
Oct 30 21:44:31.475972 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:31.475944    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795237f3_0ac3_4842_90f3_0378a80e5c33.slice/crio-2ab492f8da5d43ae040f37350938433faaec32e029c847e7ebcdd51275a75ed6 WatchSource:0}: Error finding container 2ab492f8da5d43ae040f37350938433faaec32e029c847e7ebcdd51275a75ed6: Status 404 returned error can't find the container with id 2ab492f8da5d43ae040f37350938433faaec32e029c847e7ebcdd51275a75ed6
Oct 30 21:44:31.484620 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:31.484563    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8d78449d9-mmjp2"]
Oct 30 21:44:31.683744 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:31.683712    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:32.156883 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:32.156845    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-48xwh" event={"ID":"37575185-c078-4be7-afa9-f7f860f29d49","Type":"ContainerStarted","Data":"b64e8c7373aa51bfdd9512a1492560fbd8e52f2d997029b23bd45731dcb3cc44"}
Oct 30 21:44:32.157321 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:32.156914    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-48xwh" event={"ID":"37575185-c078-4be7-afa9-f7f860f29d49","Type":"ContainerStarted","Data":"3ba767b93b0032c29fea11e0a8744fe98ed5b35174acdabb0fe42db347f12ca1"}
Oct 30 21:44:32.158724 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:32.158668    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-775f87bbf6-82p7v" event={"ID":"186ffaf9-fc18-4605-9c8c-c9c31bda5379","Type":"ContainerStarted","Data":"a2369ce0fc7d21c9484557c4221c4d62658114cbb098c1c3aa9d3f90667ba489"}
Oct 30 21:44:32.158898 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:32.158744    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-775f87bbf6-82p7v" event={"ID":"186ffaf9-fc18-4605-9c8c-c9c31bda5379","Type":"ContainerStarted","Data":"6a5cbee5e7255cebf4f766aefb9e3dd8587ba972e1fb12419278238de86b720e"}
Oct 30 21:44:32.160024 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:32.159981    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jdg72" event={"ID":"f1c0a201-8b48-44fb-b107-a5f2bb798235","Type":"ContainerStarted","Data":"273652481bd0abc686c44dcac163e15af4729c16d675af39ae8185c5d8229bb5"}
Oct 30 21:44:32.161064 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:32.161037    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4hw29" event={"ID":"a447a17d-b65e-40a2-b200-635ee45355ba","Type":"ContainerStarted","Data":"361b965821386291e74906de430d0702f04e198da76189dbbfeb613cd83c467c"}
Oct 30 21:44:32.162466 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:32.162439    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8d78449d9-mmjp2" event={"ID":"795237f3-0ac3-4842-90f3-0378a80e5c33","Type":"ContainerStarted","Data":"015da11fc63ffc6a65a79c0512e7946d0f545feacbabf802361876263b98abf5"}
Oct 30 21:44:32.162466 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:32.162480    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8d78449d9-mmjp2" event={"ID":"795237f3-0ac3-4842-90f3-0378a80e5c33","Type":"ContainerStarted","Data":"2ab492f8da5d43ae040f37350938433faaec32e029c847e7ebcdd51275a75ed6"}
Oct 30 21:44:32.684386 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:32.684349    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:32.831376 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:32.829595    4918 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-142-154.us-west-1.compute.internal" event="NodeReady"
Oct 30 21:44:32.944047 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:32.944005    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:33.168666 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:33.168626    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-48xwh" event={"ID":"37575185-c078-4be7-afa9-f7f860f29d49","Type":"ContainerStarted","Data":"b8d6623bed93dbc6e157f854c484d9bd22c77a8c2f5d886d2ff6a58a4869730a"}
Oct 30 21:44:33.171125 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:33.170623    4918 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:44:33.171125 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:33.170648    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jdg72" event={"ID":"f1c0a201-8b48-44fb-b107-a5f2bb798235","Type":"ContainerStarted","Data":"5d8a7b216e6635d10ab9479721032426ec5f5b41e93c8b4d6d1c7eb4f124270a"}
Oct 30 21:44:33.171125 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:33.170718    4918 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:44:33.171125 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:33.170725    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jdg72" event={"ID":"f1c0a201-8b48-44fb-b107-a5f2bb798235","Type":"ContainerStarted","Data":"2d13f9ba3d07951cae13a843ab3fa6574d5c04b5bc2f705d1115e06d1825949a"}
Oct 30 21:44:33.194447 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:33.194419    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:33.446804 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:33.446771    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:33.710552 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:33.710521    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:33.835125 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:33.835093    4918 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:33.835505 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:33.835489    4918 scope.go:122] "RemoveContainer" containerID="8dd2c4ae77ec434f6f3832bd38d08e7de9ded45f4635a5df320a22c01a56c9d6"
Oct 30 21:44:33.962560 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:33.962484    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:34.176892 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:34.176866    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 21:44:34.177364 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:34.176993    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58" event={"ID":"18b98618-898b-4a48-bb05-51e61ca7fe0a","Type":"ContainerStarted","Data":"4bdb42d6cda5e48f0cff7ad5993c9c12ff75a75e39d621f38151de758116396a"}
Oct 30 21:44:34.177429 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:34.177384    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:34.178547 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:34.178518    4918 patch_prober.go:29] interesting pod/console-operator-7cd56b8dbc-8hc58 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.21:8443/readyz\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body=
Oct 30 21:44:34.178665 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:34.178571    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58" podUID="18b98618-898b-4a48-bb05-51e61ca7fe0a" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.21:8443/readyz\": dial tcp 10.132.0.21:8443: connect: connection refused"
Oct 30 21:44:34.179195 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:34.179173    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4hw29" event={"ID":"a447a17d-b65e-40a2-b200-635ee45355ba","Type":"ContainerStarted","Data":"3034fc0f138a83c88eae667a968058a1e9ce4103a7522d8052cfc1f2b6b5d86e"}
Oct 30 21:44:34.179280 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:34.179228    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4hw29" event={"ID":"a447a17d-b65e-40a2-b200-635ee45355ba","Type":"ContainerStarted","Data":"19c5e9633d53ccd11ca5ef2123a26b6ba9d4294d8fec89a1f9860b9bf13fe01e"}
Oct 30 21:44:34.212755 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:34.212697    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:34.679214 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:34.679182    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:34.933974 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:34.933885    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:35.185978 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:35.185896    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-48xwh" event={"ID":"37575185-c078-4be7-afa9-f7f860f29d49","Type":"ContainerStarted","Data":"f82c4a91fa4e6661a4de73d194abc608958366248cfb42dac6374e75a7fb810c"}
Oct 30 21:44:35.186859 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:35.186835    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:35.189534 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:35.189506    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:35.191955 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:35.191936    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-8hc58"
Oct 30 21:44:35.424411 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:35.424381    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:44:35.436581 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:35.436518    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:35.699341 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:35.699271    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:35.960405 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:35.960317    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:36.539728 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:36.539671    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:36.789926 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:36.789844    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:37.038892 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:37.038855    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:37.287350 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:37.287310    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:37.541581 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:37.541504    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:37.831400 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:37.831321    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:37.926755 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:37.926720    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:38.075321 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:38.075292    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:38.983673 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:38.983640    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:38.983673 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:38.983675    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:38.984068 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:38.983734    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:38.984068 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:38.983758    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:38.984485 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:38.984404    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4e14574-aa2d-4fc4-ba26-a07f4a669296-service-ca-bundle\") pod \"router-default-6d865d79dc-z4f64\" (UID: \"a4e14574-aa2d-4fc4-ba26-a07f4a669296\") " pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:38.986207 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:38.986180    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b9112244-9e99-4f1d-b2a5-576d56dc0718-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-54ntg\" (UID: \"b9112244-9e99-4f1d-b2a5-576d56dc0718\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:38.986312 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:38.986265    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pfzwt\" (UID: \"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:38.986312 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:38.986265    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/40cb9ea7-fe94-41e7-abd3-70a2c6d31fff-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-z67rm\" (UID: \"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:39.022353 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:39.022331    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"
Oct 30 21:44:39.024357 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:39.024337    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:39.026697 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:39.026652    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"
Oct 30 21:44:39.027753 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:39.027734    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"
Oct 30 21:44:39.287040 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:39.286965    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:39.408435 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:39.408402    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg"]
Oct 30 21:44:39.449913 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:39.449878    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9112244_9e99_4f1d_b2a5_576d56dc0718.slice/crio-965564af4a3fc44221fed49f50fd9462cf05bbdbac258e8d1b860f3d9b1896bc WatchSource:0}: Error finding container 965564af4a3fc44221fed49f50fd9462cf05bbdbac258e8d1b860f3d9b1896bc: Status 404 returned error can't find the container with id 965564af4a3fc44221fed49f50fd9462cf05bbdbac258e8d1b860f3d9b1896bc
Oct 30 21:44:39.459519 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:39.459498    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm"]
Oct 30 21:44:39.500135 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:39.500110    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e14574_aa2d_4fc4_ba26_a07f4a669296.slice/crio-c1422cd26a92ef6092cc9e018c2371a976e8780480e0f9bbb83dd247d564e72a WatchSource:0}: Error finding container c1422cd26a92ef6092cc9e018c2371a976e8780480e0f9bbb83dd247d564e72a: Status 404 returned error can't find the container with id c1422cd26a92ef6092cc9e018c2371a976e8780480e0f9bbb83dd247d564e72a
Oct 30 21:44:39.509256 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:39.509228    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d865d79dc-z4f64"]
Oct 30 21:44:39.510327 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:39.510306    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-pfzwt"]
Oct 30 21:44:39.511435 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:39.511408    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f18ad4_9c8f_4d3f_9d1b_cc517dd015d5.slice/crio-bd9da8e279d629adf2fa2428e9263238ba0271b6ee2b519afbfcd3e73a26cfb0 WatchSource:0}: Error finding container bd9da8e279d629adf2fa2428e9263238ba0271b6ee2b519afbfcd3e73a26cfb0: Status 404 returned error can't find the container with id bd9da8e279d629adf2fa2428e9263238ba0271b6ee2b519afbfcd3e73a26cfb0
Oct 30 21:44:39.542135 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:39.542114    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:40.205187 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:40.205149    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt" event={"ID":"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5","Type":"ContainerStarted","Data":"bd9da8e279d629adf2fa2428e9263238ba0271b6ee2b519afbfcd3e73a26cfb0"}
Oct 30 21:44:40.206436 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:40.206407    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm" event={"ID":"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff","Type":"ContainerStarted","Data":"f416a6c4c95ea174e01574f727443fc3418f62897b21df440b6b60e0e887c25f"}
Oct 30 21:44:40.207819 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:40.207788    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d865d79dc-z4f64" event={"ID":"a4e14574-aa2d-4fc4-ba26-a07f4a669296","Type":"ContainerStarted","Data":"9d1719007ce55c186fd011cc1125bcb9df5c85a7485619b223660cdd27f5eeca"}
Oct 30 21:44:40.207927 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:40.207832    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d865d79dc-z4f64" event={"ID":"a4e14574-aa2d-4fc4-ba26-a07f4a669296","Type":"ContainerStarted","Data":"c1422cd26a92ef6092cc9e018c2371a976e8780480e0f9bbb83dd247d564e72a"}
Oct 30 21:44:40.208875 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:40.208858    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg" event={"ID":"b9112244-9e99-4f1d-b2a5-576d56dc0718","Type":"ContainerStarted","Data":"965564af4a3fc44221fed49f50fd9462cf05bbdbac258e8d1b860f3d9b1896bc"}
Oct 30 21:44:41.024796 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:41.024765    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:41.028136 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:41.028114    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:41.215854 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:41.215811    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-pfzwt" event={"ID":"b4f18ad4-9c8f-4d3f-9d1b-cc517dd015d5","Type":"ContainerStarted","Data":"87b0f329866085d8793f081ffdd28deef238b4b7caec7fe9aad7f2b3e2629bbf"}
Oct 30 21:44:41.216340 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:41.215987    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:41.217475 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:41.217452    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6d865d79dc-z4f64"
Oct 30 21:44:41.326167 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:41.326086    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-775f87bbf6-82p7v"]
Oct 30 21:44:41.511428 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:41.511394    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:41.863890 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:41.863793    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:42.136714 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:42.136614    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:42.224423 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:42.224391    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm" event={"ID":"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff","Type":"ContainerStarted","Data":"37a3fa25aebdb76e6920cc099850e37713b0a70fade187d8390220e3745107cc"}
Oct 30 21:44:42.224822 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:42.224442    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-z67rm" event={"ID":"40cb9ea7-fe94-41e7-abd3-70a2c6d31fff","Type":"ContainerStarted","Data":"ee2175b53d0c04a70600d6c9e79eeeb9f5eca35d9562d3d7ca1843b70007e8df"}
Oct 30 21:44:42.401341 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:42.401304    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:43.043505 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:43.043425    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kfvjg"
Oct 30 21:44:43.233903 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:43.233833    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-54ntg" event={"ID":"b9112244-9e99-4f1d-b2a5-576d56dc0718","Type":"ContainerStarted","Data":"ad3cb6062caa16a81b7c73c19cd48c5cdbdb2d4ccc85c0452d472860c306d341"}
Oct 30 21:44:44.100032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:44.099186    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:44.346348 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:44.346273    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:44.600089 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:44.600054    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:45.161649 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:45.161620    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:45.192141 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:45.192118    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4hw29"
Oct 30 21:44:45.466814 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:45.466783    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:45.636738 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:45.636708    4918 patch_prober.go:29] interesting pod/image-registry-8d78449d9-mmjp2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 21:44:45.636899 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:45.636757    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8d78449d9-mmjp2" podUID="795237f3-0ac3-4842-90f3-0378a80e5c33" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:44:45.755898 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:45.755821    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:46.004962 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:46.004934    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnpfz"
Oct 30 21:44:46.007890 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:46.007832    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:46.259728 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:46.259589    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:46.716944 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:46.716910    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:46.966919 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:46.966881    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:47.931032 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:47.931002    4918 patch_prober.go:29] interesting pod/image-registry-8d78449d9-mmjp2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 21:44:47.931406 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:47.931058    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8d78449d9-mmjp2" podUID="795237f3-0ac3-4842-90f3-0378a80e5c33" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:44:48.659498 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:48.659446    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:49.447654 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:49.447609    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:49.756480 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:49.756405    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:50.006877 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:50.006802    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:51.331851 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:51.331819    4918 patch_prober.go:29] interesting pod/image-registry-775f87bbf6-82p7v container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 30 21:44:51.332283 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:51.331873    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-775f87bbf6-82p7v" podUID="186ffaf9-fc18-4605-9c8c-c9c31bda5379" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:44:52.860073 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:52.860037    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:53.123709 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:53.123617    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:55.023099 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:55.023061    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:55.277495 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:55.277413    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:55.654935 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:55.654900    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:55.911404 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:55.911334    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:56.170052 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.169962    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:56.340126 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.340100    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5x747"]
Oct 30 21:44:56.365998 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.365969    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.417919 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.417891    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 21:44:56.418039 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.417902    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 21:44:56.418039 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.417973    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7g595\""
Oct 30 21:44:56.420263 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.420213    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:56.511466 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.511443    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 21:44:56.511564 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.511473    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 21:44:56.521962 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.521929    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-node-exporter-tls\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.522102 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.521969    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.522102 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.521991    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-sys\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.522102 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.522077    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-root\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.522239 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.522132    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-node-exporter-textfile\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.522239 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.522156    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-node-exporter-wtmp\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.522239 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.522204    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-node-exporter-accelerators-collector-config\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.522585 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.522239    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-metrics-client-ca\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.522585 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.522308    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsf5d\" (UniqueName: \"kubernetes.io/projected/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-kube-api-access-hsf5d\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.623231 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.623208    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-node-exporter-wtmp\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.623347 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.623242    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-node-exporter-accelerators-collector-config\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.623347 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.623288    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-metrics-client-ca\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.623347 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.623326    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsf5d\" (UniqueName: \"kubernetes.io/projected/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-kube-api-access-hsf5d\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.623500 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.623352    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-node-exporter-tls\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.623500 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.623364    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-node-exporter-wtmp\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.623500 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.623375    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.623500 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.623416    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-sys\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.623500 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.623451    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-root\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.623500 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.623472    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-node-exporter-textfile\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.623811 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.623529    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-sys\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.623866 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.623843    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-node-exporter-textfile\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.623940 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.623917    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-root\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.623978 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.623953    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-node-exporter-accelerators-collector-config\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.624015 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.623958    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-metrics-client-ca\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.625814 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.625795    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-node-exporter-tls\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.625890 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.625862    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.683182 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.683108    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:56.686607 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.686585    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsf5d\" (UniqueName: \"kubernetes.io/projected/cf9cafd6-7ee5-44f0-84e6-a0e82c108b58-kube-api-access-hsf5d\") pod \"node-exporter-5x747\" (UID: \"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58\") " pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.716479 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.716454    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5x747"
Oct 30 21:44:56.749657 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:44:56.749634    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9cafd6_7ee5_44f0_84e6_a0e82c108b58.slice/crio-c87023cf0d4ddce38758aa5de7a03e795226b562da907bb5c080f60b0d4ab994 WatchSource:0}: Error finding container c87023cf0d4ddce38758aa5de7a03e795226b562da907bb5c080f60b0d4ab994: Status 404 returned error can't find the container with id c87023cf0d4ddce38758aa5de7a03e795226b562da907bb5c080f60b0d4ab994
Oct 30 21:44:56.933370 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:56.933282    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:57.199027 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:57.198952    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:57.284445 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:57.284418    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5x747" event={"ID":"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58","Type":"ContainerStarted","Data":"c87023cf0d4ddce38758aa5de7a03e795226b562da907bb5c080f60b0d4ab994"}
Oct 30 21:44:57.805027 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:57.804984    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:57.933415 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:57.933385    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:44:58.059549 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:58.059468    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:58.383733 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:58.383630    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:58.619833 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:58.619807    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r54tb"
Oct 30 21:44:58.747453 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:58.747364    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:59.038836 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:59.038761    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:59.295321 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:59.295245    4918 generic.go:356] "Generic (PLEG): container finished" podID="cf9cafd6-7ee5-44f0-84e6-a0e82c108b58" containerID="5788e6758a375ba75e60b6add484cdc4caedd8dbb076aec58292fe8ee8ddfc97" exitCode=0
Oct 30 21:44:59.295321 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:44:59.295299    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5x747" event={"ID":"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58","Type":"ContainerDied","Data":"5788e6758a375ba75e60b6add484cdc4caedd8dbb076aec58292fe8ee8ddfc97"}
Oct 30 21:45:00.302225 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:00.302134    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5x747" event={"ID":"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58","Type":"ContainerStarted","Data":"29e4470a3cfe1663f855daac31cf80770a5b1ff3048014ce7a4251d9488c360f"}
Oct 30 21:45:00.302225 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:00.302215    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5x747" event={"ID":"cf9cafd6-7ee5-44f0-84e6-a0e82c108b58","Type":"ContainerStarted","Data":"ce856779c1c3428ed1e6b554c6e5854f2076c7c23928ee59504f784da710571d"}
Oct 30 21:45:00.472750 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:00.472585    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5x747" podStartSLOduration=2.629514125 podStartE2EDuration="4.472566205s" totalImagesPullingTime="1.762981486s" totalInitContainerRuntime="80.070594ms" isStatefulPod=true podCreationTimestamp="2026-10-30 21:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:00.47210275 +0000 UTC m=+38.520710444" watchObservedRunningTime="2026-10-30 21:45:00.472566205 +0000 UTC m=+38.521173901"
Oct 30 21:45:00.498039 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:00.498009    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:00.811506 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:00.811463    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:01.076231 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:01.076142    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:01.330563 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:01.330492    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:45:01.336565 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:01.336533    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:02.157901 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:45:02.157865    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:45:03.422442 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:03.422410    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8d78449d9-mmjp2"]
Oct 30 21:45:03.686526 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:03.686437    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:03.934558 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:03.934528    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:04.183353 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:04.183323    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:04.462009 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:04.461925    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:04.712242 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:04.712166    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:05.764376 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:05.764336    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:06.355746 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.355705    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-775f87bbf6-82p7v" podUID="186ffaf9-fc18-4605-9c8c-c9c31bda5379" containerName="registry" containerID="cri-o://a2369ce0fc7d21c9484557c4221c4d62658114cbb098c1c3aa9d3f90667ba489" gracePeriod=30
Oct 30 21:45:06.609699 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.609616    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:45:06.712451 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.712421    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls\") pod \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") "
Oct 30 21:45:06.712649 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.712470    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-certificates\") pod \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") "
Oct 30 21:45:06.712649 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.712492    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-bound-sa-token\") pod \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") "
Oct 30 21:45:06.712649 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.712513    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-installation-pull-secrets\") pod \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") "
Oct 30 21:45:06.712649 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.712558    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-kube-api-access-pspz2\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-kube-api-access-pspz2\") pod \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") "
Oct 30 21:45:06.712649 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.712584    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-trusted-ca\") pod \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") "
Oct 30 21:45:06.712649 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.712635    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/186ffaf9-fc18-4605-9c8c-c9c31bda5379-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/186ffaf9-fc18-4605-9c8c-c9c31bda5379-ca-trust-extracted\") pod \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") "
Oct 30 21:45:06.712999 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.712665    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-image-registry-private-configuration\") pod \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\" (UID: \"186ffaf9-fc18-4605-9c8c-c9c31bda5379\") "
Oct 30 21:45:06.712999 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.712882    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-certificates" pod "186ffaf9-fc18-4605-9c8c-c9c31bda5379" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:06.713522 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.713466    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-trusted-ca" pod "186ffaf9-fc18-4605-9c8c-c9c31bda5379" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:06.715348 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.715293    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-bound-sa-token" pod "186ffaf9-fc18-4605-9c8c-c9c31bda5379" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:06.715511 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.715477    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls" pod "186ffaf9-fc18-4605-9c8c-c9c31bda5379" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:06.715647 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.715622    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-image-registry-private-configuration" pod "186ffaf9-fc18-4605-9c8c-c9c31bda5379" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:06.715739 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.715719    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-kube-api-access-pspz2" pod "186ffaf9-fc18-4605-9c8c-c9c31bda5379" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379"). InnerVolumeSpecName "kube-api-access-pspz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:06.715779 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.715726    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-installation-pull-secrets" pod "186ffaf9-fc18-4605-9c8c-c9c31bda5379" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:06.721788 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.721759    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/186ffaf9-fc18-4605-9c8c-c9c31bda5379-ca-trust-extracted" pod "186ffaf9-fc18-4605-9c8c-c9c31bda5379" (UID: "186ffaf9-fc18-4605-9c8c-c9c31bda5379"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:06.813897 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.813864    4918 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:06.813897 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.813894    4918 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-registry-certificates\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:06.813897 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.813905    4918 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-bound-sa-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:06.814336 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.813914    4918 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-installation-pull-secrets\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:06.814336 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.813923    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pspz2\" (UniqueName: \"kubernetes.io/projected/186ffaf9-fc18-4605-9c8c-c9c31bda5379-kube-api-access-pspz2\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:06.814336 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.813932    4918 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/186ffaf9-fc18-4605-9c8c-c9c31bda5379-trusted-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:06.814336 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.813941    4918 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/186ffaf9-fc18-4605-9c8c-c9c31bda5379-ca-trust-extracted\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:06.814336 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:06.813950    4918 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/186ffaf9-fc18-4605-9c8c-c9c31bda5379-image-registry-private-configuration\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:07.331333 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:07.331291    4918 generic.go:356] "Generic (PLEG): container finished" podID="186ffaf9-fc18-4605-9c8c-c9c31bda5379" containerID="a2369ce0fc7d21c9484557c4221c4d62658114cbb098c1c3aa9d3f90667ba489" exitCode=0
Oct 30 21:45:07.331509 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:07.331359    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775f87bbf6-82p7v"
Oct 30 21:45:07.331509 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:07.331370    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-775f87bbf6-82p7v" event={"ID":"186ffaf9-fc18-4605-9c8c-c9c31bda5379","Type":"ContainerDied","Data":"a2369ce0fc7d21c9484557c4221c4d62658114cbb098c1c3aa9d3f90667ba489"}
Oct 30 21:45:07.331509 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:07.331445    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-775f87bbf6-82p7v" event={"ID":"186ffaf9-fc18-4605-9c8c-c9c31bda5379","Type":"ContainerDied","Data":"6a5cbee5e7255cebf4f766aefb9e3dd8587ba972e1fb12419278238de86b720e"}
Oct 30 21:45:07.331509 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:07.331473    4918 scope.go:122] "RemoveContainer" containerID="a2369ce0fc7d21c9484557c4221c4d62658114cbb098c1c3aa9d3f90667ba489"
Oct 30 21:45:07.340274 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:07.340256    4918 scope.go:122] "RemoveContainer" containerID="a2369ce0fc7d21c9484557c4221c4d62658114cbb098c1c3aa9d3f90667ba489"
Oct 30 21:45:07.340530 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:45:07.340508    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2369ce0fc7d21c9484557c4221c4d62658114cbb098c1c3aa9d3f90667ba489\": container with ID starting with a2369ce0fc7d21c9484557c4221c4d62658114cbb098c1c3aa9d3f90667ba489 not found: ID does not exist" containerID="a2369ce0fc7d21c9484557c4221c4d62658114cbb098c1c3aa9d3f90667ba489"
Oct 30 21:45:07.340576 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:07.340539    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2369ce0fc7d21c9484557c4221c4d62658114cbb098c1c3aa9d3f90667ba489"} err="failed to get container status \"a2369ce0fc7d21c9484557c4221c4d62658114cbb098c1c3aa9d3f90667ba489\": rpc error: code = NotFound desc = could not find container \"a2369ce0fc7d21c9484557c4221c4d62658114cbb098c1c3aa9d3f90667ba489\": container with ID starting with a2369ce0fc7d21c9484557c4221c4d62658114cbb098c1c3aa9d3f90667ba489 not found: ID does not exist"
Oct 30 21:45:07.545712 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:07.545669    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-775f87bbf6-82p7v"]
Oct 30 21:45:07.594846 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:07.594771    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-775f87bbf6-82p7v"]
Oct 30 21:45:07.826384 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:07.826348    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:08.070655 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:08.070611    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="186ffaf9-fc18-4605-9c8c-c9c31bda5379" path="/var/lib/kubelet/pods/186ffaf9-fc18-4605-9c8c-c9c31bda5379/volumes"
Oct 30 21:45:08.079215 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:08.079187    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:08.465018 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:08.464987    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:08.730107 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:08.730022    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:11.354368 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:11.354336    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:11.603760 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:11.603719    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:12.362045 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:12.362010    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:12.655316 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:12.655283    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:12.918423 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:12.918300    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:17.705080 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:17.705045    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:17.970338 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:17.970259    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:22.822320 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:22.822273    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:23.083510 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:23.083429    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:25.476369 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:25.476321    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:25.726563 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:25.726465    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:28.057914 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.057882    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:28.385230 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.385155    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:28.442632 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.442591    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8d78449d9-mmjp2" podUID="795237f3-0ac3-4842-90f3-0378a80e5c33" containerName="registry" containerID="cri-o://015da11fc63ffc6a65a79c0512e7946d0f545feacbabf802361876263b98abf5" gracePeriod=30
Oct 30 21:45:28.693908 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.693877    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:45:28.766242 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.766211    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-trusted-ca\") pod \"795237f3-0ac3-4842-90f3-0378a80e5c33\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") "
Oct 30 21:45:28.766414 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.766260    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-image-registry-private-configuration\") pod \"795237f3-0ac3-4842-90f3-0378a80e5c33\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") "
Oct 30 21:45:28.766414 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.766282    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-installation-pull-secrets\") pod \"795237f3-0ac3-4842-90f3-0378a80e5c33\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") "
Oct 30 21:45:28.766414 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.766318    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-certificates\") pod \"795237f3-0ac3-4842-90f3-0378a80e5c33\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") "
Oct 30 21:45:28.766414 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.766338    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls\") pod \"795237f3-0ac3-4842-90f3-0378a80e5c33\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") "
Oct 30 21:45:28.766414 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.766363    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-kube-api-access-fc9l8\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-kube-api-access-fc9l8\") pod \"795237f3-0ac3-4842-90f3-0378a80e5c33\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") "
Oct 30 21:45:28.766414 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.766384    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-bound-sa-token\") pod \"795237f3-0ac3-4842-90f3-0378a80e5c33\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") "
Oct 30 21:45:28.766749 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.766481    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/795237f3-0ac3-4842-90f3-0378a80e5c33-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/795237f3-0ac3-4842-90f3-0378a80e5c33-ca-trust-extracted\") pod \"795237f3-0ac3-4842-90f3-0378a80e5c33\" (UID: \"795237f3-0ac3-4842-90f3-0378a80e5c33\") "
Oct 30 21:45:28.766749 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.766737    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-trusted-ca" pod "795237f3-0ac3-4842-90f3-0378a80e5c33" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:28.766907 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.766856    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-certificates" pod "795237f3-0ac3-4842-90f3-0378a80e5c33" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:28.768807 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.768761    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls" pod "795237f3-0ac3-4842-90f3-0378a80e5c33" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:28.769076 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.769049    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-installation-pull-secrets" pod "795237f3-0ac3-4842-90f3-0378a80e5c33" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:28.769259 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.769232    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-image-registry-private-configuration" pod "795237f3-0ac3-4842-90f3-0378a80e5c33" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:28.769344 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.769269    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-bound-sa-token" pod "795237f3-0ac3-4842-90f3-0378a80e5c33" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:28.769382 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.769358    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-kube-api-access-fc9l8" pod "795237f3-0ac3-4842-90f3-0378a80e5c33" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33"). InnerVolumeSpecName "kube-api-access-fc9l8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:28.776209 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.776183    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/795237f3-0ac3-4842-90f3-0378a80e5c33-ca-trust-extracted" pod "795237f3-0ac3-4842-90f3-0378a80e5c33" (UID: "795237f3-0ac3-4842-90f3-0378a80e5c33"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:28.867979 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.867837    4918 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-image-registry-private-configuration\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:28.867979 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.867871    4918 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/795237f3-0ac3-4842-90f3-0378a80e5c33-installation-pull-secrets\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:28.867979 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.867887    4918 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-certificates\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:28.867979 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.867901    4918 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-registry-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:28.867979 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.867915    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc9l8\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-kube-api-access-fc9l8\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:28.867979 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.867929    4918 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/795237f3-0ac3-4842-90f3-0378a80e5c33-bound-sa-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:28.867979 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.867942    4918 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/795237f3-0ac3-4842-90f3-0378a80e5c33-ca-trust-extracted\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:28.867979 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:28.867955    4918 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/795237f3-0ac3-4842-90f3-0378a80e5c33-trusted-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:29.099313 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:29.099242    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:29.400519 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:29.400486    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:29.425818 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:29.425790    4918 generic.go:356] "Generic (PLEG): container finished" podID="795237f3-0ac3-4842-90f3-0378a80e5c33" containerID="015da11fc63ffc6a65a79c0512e7946d0f545feacbabf802361876263b98abf5" exitCode=0
Oct 30 21:45:29.425937 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:29.425859    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8d78449d9-mmjp2"
Oct 30 21:45:29.425937 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:29.425876    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8d78449d9-mmjp2" event={"ID":"795237f3-0ac3-4842-90f3-0378a80e5c33","Type":"ContainerDied","Data":"015da11fc63ffc6a65a79c0512e7946d0f545feacbabf802361876263b98abf5"}
Oct 30 21:45:29.425937 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:29.425927    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8d78449d9-mmjp2" event={"ID":"795237f3-0ac3-4842-90f3-0378a80e5c33","Type":"ContainerDied","Data":"2ab492f8da5d43ae040f37350938433faaec32e029c847e7ebcdd51275a75ed6"}
Oct 30 21:45:29.426078 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:29.425952    4918 scope.go:122] "RemoveContainer" containerID="015da11fc63ffc6a65a79c0512e7946d0f545feacbabf802361876263b98abf5"
Oct 30 21:45:29.427445 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:29.427417    4918 generic.go:356] "Generic (PLEG): container finished" podID="6b1746a5-d5b0-4786-908b-09797786de96" containerID="68acd28f1801021ee5bd4f73edaf927ca433cb7fcd12399693fc0eb130f7d379" exitCode=0
Oct 30 21:45:29.427552 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:29.427455    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d" event={"ID":"6b1746a5-d5b0-4786-908b-09797786de96","Type":"ContainerDied","Data":"68acd28f1801021ee5bd4f73edaf927ca433cb7fcd12399693fc0eb130f7d379"}
Oct 30 21:45:29.427758 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:29.427744    4918 scope.go:122] "RemoveContainer" containerID="68acd28f1801021ee5bd4f73edaf927ca433cb7fcd12399693fc0eb130f7d379"
Oct 30 21:45:29.434898 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:29.434883    4918 scope.go:122] "RemoveContainer" containerID="015da11fc63ffc6a65a79c0512e7946d0f545feacbabf802361876263b98abf5"
Oct 30 21:45:29.435196 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:45:29.435179    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"015da11fc63ffc6a65a79c0512e7946d0f545feacbabf802361876263b98abf5\": container with ID starting with 015da11fc63ffc6a65a79c0512e7946d0f545feacbabf802361876263b98abf5 not found: ID does not exist" containerID="015da11fc63ffc6a65a79c0512e7946d0f545feacbabf802361876263b98abf5"
Oct 30 21:45:29.435249 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:29.435204    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"015da11fc63ffc6a65a79c0512e7946d0f545feacbabf802361876263b98abf5"} err="failed to get container status \"015da11fc63ffc6a65a79c0512e7946d0f545feacbabf802361876263b98abf5\": rpc error: code = NotFound desc = could not find container \"015da11fc63ffc6a65a79c0512e7946d0f545feacbabf802361876263b98abf5\": container with ID starting with 015da11fc63ffc6a65a79c0512e7946d0f545feacbabf802361876263b98abf5 not found: ID does not exist"
Oct 30 21:45:29.654732 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:29.654638    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:29.752421 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:29.752390    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8d78449d9-mmjp2"]
Oct 30 21:45:29.801482 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:29.801454    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8d78449d9-mmjp2"]
Oct 30 21:45:30.069770 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:30.069669    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="795237f3-0ac3-4842-90f3-0378a80e5c33" path="/var/lib/kubelet/pods/795237f3-0ac3-4842-90f3-0378a80e5c33/volumes"
Oct 30 21:45:30.432634 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:30.432599    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-tp26d" event={"ID":"6b1746a5-d5b0-4786-908b-09797786de96","Type":"ContainerStarted","Data":"eaa7977deca799fcdc02c6e6dadbdf19ca772927367cb9cac9dc741de7f6f461"}
Oct 30 21:45:32.157595 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:45:32.157499    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:45:32.441270 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:32.441207    4918 generic.go:356] "Generic (PLEG): container finished" podID="c28402b8-cc54-4896-955c-a0dc2d5e156d" containerID="910441c9dd50604ace290ea9959fd5a07f38bec5a1819f57e3c7687f81bf2405" exitCode=0
Oct 30 21:45:32.441394 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:32.441278    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-vbwwf" event={"ID":"c28402b8-cc54-4896-955c-a0dc2d5e156d","Type":"ContainerDied","Data":"910441c9dd50604ace290ea9959fd5a07f38bec5a1819f57e3c7687f81bf2405"}
Oct 30 21:45:32.441580 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:32.441566    4918 scope.go:122] "RemoveContainer" containerID="910441c9dd50604ace290ea9959fd5a07f38bec5a1819f57e3c7687f81bf2405"
Oct 30 21:45:33.446239 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:33.446204    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-vbwwf" event={"ID":"c28402b8-cc54-4896-955c-a0dc2d5e156d","Type":"ContainerStarted","Data":"80e74b6507d3575e3f1841e2e2128891a0b18a6fcddc7e090e5506203b59f869"}
Oct 30 21:45:34.451451 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:34.451415    4918 generic.go:356] "Generic (PLEG): container finished" podID="0aab5a63-4de8-4a6e-a9e7-f7ba260754c8" containerID="c993294321f248a49582486bcdfa427e1abd35d96fb0f97425da9d2b507ffb4c" exitCode=0
Oct 30 21:45:34.451888 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:34.451477    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv" event={"ID":"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8","Type":"ContainerDied","Data":"c993294321f248a49582486bcdfa427e1abd35d96fb0f97425da9d2b507ffb4c"}
Oct 30 21:45:34.451888 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:34.451773    4918 scope.go:122] "RemoveContainer" containerID="c993294321f248a49582486bcdfa427e1abd35d96fb0f97425da9d2b507ffb4c"
Oct 30 21:45:35.457237 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:35.457205    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-skmhv" event={"ID":"0aab5a63-4de8-4a6e-a9e7-f7ba260754c8","Type":"ContainerStarted","Data":"bbb3014b1bb6fabfc2cb7f03ed5fa4614465f690d0cc74c79a40e78815ab2121"}
Oct 30 21:45:37.830240 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:37.830202    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:38.133639 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:38.133530    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:48.235198 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:48.235161    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:48.540774 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:45:48.540672    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:02.156418 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:46:02.156379    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:46:12.705480 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:46:12.705432    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:32.156087 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:46:32.155996    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:46:41.900440 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:46:41.900404    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:02.160596 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:47:02.160558    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:47:13.076783 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:47:13.076746    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:32.157884 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:47:32.157840    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:48:02.156932 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:48:02.156850    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:48:05.019315 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:48:05.019274    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:13.411704 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:48:13.411647    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:32.157914 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:48:32.157878    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:48:42.033882 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:48:42.033841    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:43.383669 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:48:43.383628    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:51.913583 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:48:51.913537    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:52.220786 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:48:52.220659    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:54.843458 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:48:54.843407    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:55.128894 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:48:55.128810    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:02.156837 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:49:02.156798    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:49:07.840542 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:49:07.840498    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:08.169866 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:49:08.169804    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:13.765471 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:49:13.765425    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:22.066912 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:49:22.066880    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 21:49:22.067720 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:49:22.067675    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 21:49:32.157433 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:49:32.157355    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:49:41.082186 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:49:41.082122    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:02.156824 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:50:02.156788    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:50:08.523053 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:08.523006    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:09.180880 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:09.180842    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:10.219284 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:10.219239    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:14.134974 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:14.134931    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:30.227792 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:30.227746    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:30.487426 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:30.487345    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:31.679149 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.679117    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"]
Oct 30 21:50:31.679508 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.679409    4918 cpu_manager.go:414] "containerMap: removing container" podUID="186ffaf9-fc18-4605-9c8c-c9c31bda5379" containerName="registry"
Oct 30 21:50:31.679508 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.679420    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="186ffaf9-fc18-4605-9c8c-c9c31bda5379" containerName="registry"
Oct 30 21:50:31.679508 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.679427    4918 cpu_manager.go:414] "containerMap: removing container" podUID="795237f3-0ac3-4842-90f3-0378a80e5c33" containerName="registry"
Oct 30 21:50:31.679508 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.679433    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="795237f3-0ac3-4842-90f3-0378a80e5c33" containerName="registry"
Oct 30 21:50:31.679508 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.679489    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="186ffaf9-fc18-4605-9c8c-c9c31bda5379" containerName="registry"
Oct 30 21:50:31.679508 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.679495    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="795237f3-0ac3-4842-90f3-0378a80e5c33" containerName="registry"
Oct 30 21:50:31.682271 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.682255    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.737178 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.737149    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 21:50:31.737380 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.737351    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 21:50:31.737380 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.737366    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 21:50:31.737531 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.737393    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 21:50:31.778788 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.778760    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.778936 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.778799    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.778936 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.778822    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.778936 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.778888    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.779081 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.778937    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg6dv\" (UniqueName: \"kubernetes.io/projected/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-kube-api-access-kg6dv\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.779081 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.778990    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.779081 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.779037    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.784858 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.784835    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:31.786396 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.786376    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mjfxd\""
Oct 30 21:50:31.787527 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.787510    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"]
Oct 30 21:50:31.879775 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.879744    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.879932 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.879783    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.879932 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.879806    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.879932 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.879904    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.880079 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.879949    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg6dv\" (UniqueName: \"kubernetes.io/projected/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-kube-api-access-kg6dv\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.880079 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.879998    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.880079 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.880022    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.880443 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.880414    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.882429 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.882403    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.882519 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.882484    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.882812 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.882795    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.882905 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.882887    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.940764 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.940713    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.940963 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.940945    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg6dv\" (UniqueName: \"kubernetes.io/projected/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-kube-api-access-kg6dv\") pod \"istiod-openshift-gateway-7876bfcb74-mvctg\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:31.993732 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:31.993714    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:32.094864 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:32.094829    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:32.156535 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:50:32.156504    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:50:32.416557 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:32.416524    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"]
Oct 30 21:50:32.420152 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:50:32.420128    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d1ad74_3bf0_4943_a1a2_261bd5167d2b.slice/crio-cc52c2ca2fa31a429e802d2d7087a0a47da9e17ecf91100e443530d022b8bb05 WatchSource:0}: Error finding container cc52c2ca2fa31a429e802d2d7087a0a47da9e17ecf91100e443530d022b8bb05: Status 404 returned error can't find the container with id cc52c2ca2fa31a429e802d2d7087a0a47da9e17ecf91100e443530d022b8bb05
Oct 30 21:50:32.422030 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:32.422013    4918 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:50:32.517915 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:32.517887    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg" event={"ID":"73d1ad74-3bf0-4943-a1a2-261bd5167d2b","Type":"ContainerStarted","Data":"cc52c2ca2fa31a429e802d2d7087a0a47da9e17ecf91100e443530d022b8bb05"}
Oct 30 21:50:33.137103 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:33.137068    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:36.188772 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:36.188744    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:50:36.189063 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:36.188806    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:50:36.535981 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:36.535893    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg" event={"ID":"73d1ad74-3bf0-4943-a1a2-261bd5167d2b","Type":"ContainerStarted","Data":"0056ed07d40bcf5acae2e2cd1371a52f00b617ac945a44628addf2ccc764c0df"}
Oct 30 21:50:36.536160 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:36.535997    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:36.754078 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:36.754030    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg" podStartSLOduration=1.988266898 podStartE2EDuration="5.754018122s" totalImagesPullingTime="3.765751224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:50:36.704551727 +0000 UTC m=+374.753159416" watchObservedRunningTime="2026-10-30 21:50:36.754018122 +0000 UTC m=+374.802625816"
Oct 30 21:50:37.532936 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:37.532895    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:37.541768 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:37.541742    4918 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-mvctg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:50:37.541897 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:37.541799    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg" podUID="73d1ad74-3bf0-4943-a1a2-261bd5167d2b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:50:37.795531 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:37.795451    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:39.156950 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:39.156905    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:39.399198 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:39.399151    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:39.669645 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:39.669610    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:40.541702 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:40.541647    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:50:43.096187 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:43.096147    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:57.349575 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:57.349528    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:58.463259 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:50:58.463221    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:02.157728 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:51:02.157628    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:51:14.468107 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:14.468067    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:26.179982 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:26.179934    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:26.468125 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:26.468043    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:27.159964 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.159929    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:27.382346 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.382314    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"]
Oct 30 21:51:27.389039 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.389015    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.431963 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.431889    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"]
Oct 30 21:51:27.441551 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.441530    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 30 21:51:27.441654 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.441562    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 30 21:51:27.462417 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.462398    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/31594750-1642-4836-9dce-e99992cad2c3-metrics-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.462494 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.462437    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31594750-1642-4836-9dce-e99992cad2c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.462494 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.462462    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgflk\" (UniqueName: \"kubernetes.io/projected/31594750-1642-4836-9dce-e99992cad2c3-kube-api-access-jgflk\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.462494 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.462486    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31594750-1642-4836-9dce-e99992cad2c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.462801 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.462614    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31594750-1642-4836-9dce-e99992cad2c3-manifests\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.462801 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.462641    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31594750-1642-4836-9dce-e99992cad2c3-tmp\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.470178 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.470158    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 21:51:27.470342 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.470323    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-ftnxp\""
Oct 30 21:51:27.470412 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.470354    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 21:51:27.470412 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.470355    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 30 21:51:27.530906 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.530876    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:27.563046 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.563014    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31594750-1642-4836-9dce-e99992cad2c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.563190 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.563054    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgflk\" (UniqueName: \"kubernetes.io/projected/31594750-1642-4836-9dce-e99992cad2c3-kube-api-access-jgflk\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.563190 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.563074    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31594750-1642-4836-9dce-e99992cad2c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.563190 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.563094    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31594750-1642-4836-9dce-e99992cad2c3-manifests\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.563190 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.563113    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31594750-1642-4836-9dce-e99992cad2c3-tmp\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.563190 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.563142    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/31594750-1642-4836-9dce-e99992cad2c3-metrics-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.563577 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.563552    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/31594750-1642-4836-9dce-e99992cad2c3-manifests\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.565593 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.565569    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/31594750-1642-4836-9dce-e99992cad2c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.565708 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.565652    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31594750-1642-4836-9dce-e99992cad2c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.565953 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.565929    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31594750-1642-4836-9dce-e99992cad2c3-tmp\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.566100 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.566082    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/31594750-1642-4836-9dce-e99992cad2c3-metrics-cert\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.626246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.626216    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgflk\" (UniqueName: \"kubernetes.io/projected/31594750-1642-4836-9dce-e99992cad2c3-kube-api-access-jgflk\") pod \"opendatahub-operator-controller-manager-68c9746c4b-h9887\" (UID: \"31594750-1642-4836-9dce-e99992cad2c3\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.702992 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.702930    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:27.869712 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:27.869661    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:28.128196 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:28.128116    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:28.199738 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:28.199641    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"]
Oct 30 21:51:28.202720 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:51:28.202673    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31594750_1642_4836_9dce_e99992cad2c3.slice/crio-cbb2b5e4c6ac77286aa73aa0187738d171cc647e1b2972629b68a5f79fb7e33a WatchSource:0}: Error finding container cbb2b5e4c6ac77286aa73aa0187738d171cc647e1b2972629b68a5f79fb7e33a: Status 404 returned error can't find the container with id cbb2b5e4c6ac77286aa73aa0187738d171cc647e1b2972629b68a5f79fb7e33a
Oct 30 21:51:28.719805 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:28.719767    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887" event={"ID":"31594750-1642-4836-9dce-e99992cad2c3","Type":"ContainerStarted","Data":"cbb2b5e4c6ac77286aa73aa0187738d171cc647e1b2972629b68a5f79fb7e33a"}
Oct 30 21:51:29.707373 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:29.707337    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:30.040192 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:30.040111    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:30.783018 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:30.782982    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:31.733112 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:31.733078    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887" event={"ID":"31594750-1642-4836-9dce-e99992cad2c3","Type":"ContainerStarted","Data":"2329e2d7312f81477dba0a526ecbdb65f749def11526662869ba97698a199ca1"}
Oct 30 21:51:32.155368 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:51:32.155336    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:51:32.738750 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:32.738719    4918 generic.go:356] "Generic (PLEG): container finished" podID="31594750-1642-4836-9dce-e99992cad2c3" containerID="2329e2d7312f81477dba0a526ecbdb65f749def11526662869ba97698a199ca1" exitCode=0
Oct 30 21:51:32.739130 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:32.738805    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887" event={"ID":"31594750-1642-4836-9dce-e99992cad2c3","Type":"ContainerDied","Data":"2329e2d7312f81477dba0a526ecbdb65f749def11526662869ba97698a199ca1"}
Oct 30 21:51:33.296983 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:33.296945    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:33.557982 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:33.557957    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:33.744934 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:33.744890    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887" event={"ID":"31594750-1642-4836-9dce-e99992cad2c3","Type":"ContainerStarted","Data":"0aff8cc55b4246e9b1e47b0250e7d68ce6cd5f86d2a38057888f8df6333ec351"}
Oct 30 21:51:33.745327 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:33.745011    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:33.908753 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:33.908707    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887" podStartSLOduration=2.384628266 podStartE2EDuration="6.90867152s" totalImagesPullingTime="4.09984169s" totalInitContainerRuntime="424.201564ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:51:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:51:33.890153104 +0000 UTC m=+431.938760800" watchObservedRunningTime="2026-10-30 21:51:33.90867152 +0000 UTC m=+431.957279207"
Oct 30 21:51:33.941238 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:33.941211    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:34.252431 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:34.252352    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:34.505955 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:34.505868    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:35.794052 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:35.794015    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:36.045167 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:36.045090    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:38.154053 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:38.154015    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:38.646422 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:38.646383    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:41.078534 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:41.078498    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:41.377666 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:41.377575    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:44.750991 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:44.750961    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-68c9746c4b-h9887"
Oct 30 21:51:45.579999 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:45.579951    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:47.403198 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:47.403168    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:48.669529 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:48.669494    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:48.923492 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:48.923418    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:51.241906 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:51.241873    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:51.895861 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:51.895822    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:52.456910 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:52.456876    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:54.275911 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:54.275869    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:55.996650 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:55.996606    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:56.376369 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:56.376223    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:57.776450 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:57.776412    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:58.094338 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:58.094246    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:58.881027 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:58.880995    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:59.534762 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:51:59.534728    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:01.866141 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:01.866107    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:02.145846 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:02.145809    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:02.157623 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:52:02.157588    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:52:07.482185 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:07.482150    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:07.737589 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:07.737503    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:07.988025 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:07.987941    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:08.254970 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:08.254875    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:08.579978 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:08.579886    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:13.050559 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:13.050526    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:13.429699 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:13.429640    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:13.683937 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:13.683855    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:14.854123 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:14.854087    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:15.057189 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.057164    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n"]
Oct 30 21:52:15.060699 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.060657    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n"
Oct 30 21:52:15.121561 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.121478    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n"]
Oct 30 21:52:15.147787 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.147759    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:15.169049 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.169022    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Oct 30 21:52:15.169049 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.169038    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Oct 30 21:52:15.169197 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.169060    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9v7w9\""
Oct 30 21:52:15.226393 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.226364    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7bkt\" (UniqueName: \"kubernetes.io/projected/06c4dd03-7739-4496-90da-00a2abb622d5-kube-api-access-q7bkt\") pod \"kube-auth-proxy-54874bdfcc-2zm4n\" (UID: \"06c4dd03-7739-4496-90da-00a2abb622d5\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n"
Oct 30 21:52:15.226523 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.226406    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06c4dd03-7739-4496-90da-00a2abb622d5-tls-certs\") pod \"kube-auth-proxy-54874bdfcc-2zm4n\" (UID: \"06c4dd03-7739-4496-90da-00a2abb622d5\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n"
Oct 30 21:52:15.226523 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.226427    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06c4dd03-7739-4496-90da-00a2abb622d5-tmp\") pod \"kube-auth-proxy-54874bdfcc-2zm4n\" (UID: \"06c4dd03-7739-4496-90da-00a2abb622d5\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n"
Oct 30 21:52:15.326963 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.326938    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06c4dd03-7739-4496-90da-00a2abb622d5-tls-certs\") pod \"kube-auth-proxy-54874bdfcc-2zm4n\" (UID: \"06c4dd03-7739-4496-90da-00a2abb622d5\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n"
Oct 30 21:52:15.327089 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.326970    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06c4dd03-7739-4496-90da-00a2abb622d5-tmp\") pod \"kube-auth-proxy-54874bdfcc-2zm4n\" (UID: \"06c4dd03-7739-4496-90da-00a2abb622d5\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n"
Oct 30 21:52:15.327089 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.327022    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7bkt\" (UniqueName: \"kubernetes.io/projected/06c4dd03-7739-4496-90da-00a2abb622d5-kube-api-access-q7bkt\") pod \"kube-auth-proxy-54874bdfcc-2zm4n\" (UID: \"06c4dd03-7739-4496-90da-00a2abb622d5\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n"
Oct 30 21:52:15.329335 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.329315    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06c4dd03-7739-4496-90da-00a2abb622d5-tmp\") pod \"kube-auth-proxy-54874bdfcc-2zm4n\" (UID: \"06c4dd03-7739-4496-90da-00a2abb622d5\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n"
Oct 30 21:52:15.329499 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.329480    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06c4dd03-7739-4496-90da-00a2abb622d5-tls-certs\") pod \"kube-auth-proxy-54874bdfcc-2zm4n\" (UID: \"06c4dd03-7739-4496-90da-00a2abb622d5\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n"
Oct 30 21:52:15.422184 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.422153    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7bkt\" (UniqueName: \"kubernetes.io/projected/06c4dd03-7739-4496-90da-00a2abb622d5-kube-api-access-q7bkt\") pod \"kube-auth-proxy-54874bdfcc-2zm4n\" (UID: \"06c4dd03-7739-4496-90da-00a2abb622d5\") " pod="openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n"
Oct 30 21:52:15.483791 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.483764    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:15.672805 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.672738    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n"
Oct 30 21:52:15.775849 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:15.775819    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:16.060769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:16.060596    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:16.062295 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:16.062188    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n"]
Oct 30 21:52:16.064829 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:52:16.064808    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c4dd03_7739_4496_90da_00a2abb622d5.slice/crio-6bb7afaf52090acce85cdf13f7482a5c69ee6e00d5f9cc7b076f5438d5191d4e WatchSource:0}: Error finding container 6bb7afaf52090acce85cdf13f7482a5c69ee6e00d5f9cc7b076f5438d5191d4e: Status 404 returned error can't find the container with id 6bb7afaf52090acce85cdf13f7482a5c69ee6e00d5f9cc7b076f5438d5191d4e
Oct 30 21:52:16.325189 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:16.325116    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:16.633590 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:16.633510    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:16.908715 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:16.908660    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n" event={"ID":"06c4dd03-7739-4496-90da-00a2abb622d5","Type":"ContainerStarted","Data":"6bb7afaf52090acce85cdf13f7482a5c69ee6e00d5f9cc7b076f5438d5191d4e"}
Oct 30 21:52:16.925640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:16.925611    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:19.389266 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:19.389179    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:19.638484 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:19.638455    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:19.826958 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:19.826889    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-shrlf"]
Oct 30 21:52:19.830184 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:19.830166    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-shrlf"
Oct 30 21:52:19.881829 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:19.881809    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 21:52:19.922872 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:19.922849    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n" event={"ID":"06c4dd03-7739-4496-90da-00a2abb622d5","Type":"ContainerStarted","Data":"52a528910b61eaf4a10e70b3d09c0e01151eaf925462dff2b9571c0a767ae97f"}
Oct 30 21:52:19.931248 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:19.931233    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 21:52:19.931407 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:19.931395    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-vd4rq\""
Oct 30 21:52:19.932433 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:19.932417    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-shrlf"]
Oct 30 21:52:19.963377 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:19.963347    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcb7g\" (UniqueName: \"kubernetes.io/projected/2c5c3512-2dff-49da-bbd8-cd000c5c61a3-kube-api-access-lcb7g\") pod \"authorino-56c6c9ddd5-shrlf\" (UID: \"2c5c3512-2dff-49da-bbd8-cd000c5c61a3\") " pod="kuadrant-system/authorino-56c6c9ddd5-shrlf"
Oct 30 21:52:20.060622 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:20.060568    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54874bdfcc-2zm4n" podStartSLOduration=2.178082995 podStartE2EDuration="5.060412896s" totalImagesPullingTime="2.882329901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:20.059926578 +0000 UTC m=+478.108534275" watchObservedRunningTime="2026-10-30 21:52:20.060412896 +0000 UTC m=+478.109020592"
Oct 30 21:52:20.064184 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:20.064159    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcb7g\" (UniqueName: \"kubernetes.io/projected/2c5c3512-2dff-49da-bbd8-cd000c5c61a3-kube-api-access-lcb7g\") pod \"authorino-56c6c9ddd5-shrlf\" (UID: \"2c5c3512-2dff-49da-bbd8-cd000c5c61a3\") " pod="kuadrant-system/authorino-56c6c9ddd5-shrlf"
Oct 30 21:52:20.124997 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:20.124938    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcb7g\" (UniqueName: \"kubernetes.io/projected/2c5c3512-2dff-49da-bbd8-cd000c5c61a3-kube-api-access-lcb7g\") pod \"authorino-56c6c9ddd5-shrlf\" (UID: \"2c5c3512-2dff-49da-bbd8-cd000c5c61a3\") " pod="kuadrant-system/authorino-56c6c9ddd5-shrlf"
Oct 30 21:52:20.159587 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:20.159562    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-shrlf"
Oct 30 21:52:20.530913 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:20.530884    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-shrlf"]
Oct 30 21:52:20.534599 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:52:20.534569    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c5c3512_2dff_49da_bbd8_cd000c5c61a3.slice/crio-2547d1d6970301b1f38e240ebe95bf9018996c60c4df6a877753727c47fed84a WatchSource:0}: Error finding container 2547d1d6970301b1f38e240ebe95bf9018996c60c4df6a877753727c47fed84a: Status 404 returned error can't find the container with id 2547d1d6970301b1f38e240ebe95bf9018996c60c4df6a877753727c47fed84a
Oct 30 21:52:20.928526 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:20.928492    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-shrlf" event={"ID":"2c5c3512-2dff-49da-bbd8-cd000c5c61a3","Type":"ContainerStarted","Data":"2547d1d6970301b1f38e240ebe95bf9018996c60c4df6a877753727c47fed84a"}
Oct 30 21:52:20.933487 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:20.933461    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:21.183091 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:21.183009    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:23.243855 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:23.243794    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:23.942382 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:23.942349    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-shrlf" event={"ID":"2c5c3512-2dff-49da-bbd8-cd000c5c61a3","Type":"ContainerStarted","Data":"3f8c3c11df86926ea6a9b36767fab4bf7b535df9136d6e36771972a23a8c58e2"}
Oct 30 21:52:24.056673 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:24.056575    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-shrlf" podStartSLOduration=1.800823603 podStartE2EDuration="5.056558715s" totalImagesPullingTime="3.255735112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:24.055151623 +0000 UTC m=+482.103759319" watchObservedRunningTime="2026-10-30 21:52:24.056558715 +0000 UTC m=+482.105166411"
Oct 30 21:52:25.622360 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:25.622314    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:26.128173 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:26.128139    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:26.380768 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:26.380662    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:26.627418 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:26.627387    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:32.157351 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:52:32.157269    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:52:33.288178 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:33.288130    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:34.443101 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:34.443057    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:34.751502 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:34.751409    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:35.683447 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:35.683403    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:36.012630 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:36.012542    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:37.432388 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:37.432327    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:37.830358 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:37.830259    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:42.305971 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.305941    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"]
Oct 30 21:52:42.309277 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.309261    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"
Oct 30 21:52:42.329092 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.329070    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1310003-6f92-423b-9484-63ec209e2167-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-bgt9j\" (UID: \"f1310003-6f92-423b-9484-63ec209e2167\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"
Oct 30 21:52:42.329187 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.329114    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hx4n\" (UniqueName: \"kubernetes.io/projected/f1310003-6f92-423b-9484-63ec209e2167-kube-api-access-5hx4n\") pod \"kserve-module-controller-manager-7566cf5fc8-bgt9j\" (UID: \"f1310003-6f92-423b-9484-63ec209e2167\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"
Oct 30 21:52:42.329187 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.329135    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1310003-6f92-423b-9484-63ec209e2167-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-bgt9j\" (UID: \"f1310003-6f92-423b-9484-63ec209e2167\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"
Oct 30 21:52:42.329255 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.329232    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1310003-6f92-423b-9484-63ec209e2167-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-bgt9j\" (UID: \"f1310003-6f92-423b-9484-63ec209e2167\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"
Oct 30 21:52:42.361353 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.361333    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 21:52:42.410813 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.410792    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 21:52:42.411089 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.410862    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-m8tm5\""
Oct 30 21:52:42.429656 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.429626    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1310003-6f92-423b-9484-63ec209e2167-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-bgt9j\" (UID: \"f1310003-6f92-423b-9484-63ec209e2167\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"
Oct 30 21:52:42.429792 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.429717    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hx4n\" (UniqueName: \"kubernetes.io/projected/f1310003-6f92-423b-9484-63ec209e2167-kube-api-access-5hx4n\") pod \"kserve-module-controller-manager-7566cf5fc8-bgt9j\" (UID: \"f1310003-6f92-423b-9484-63ec209e2167\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"
Oct 30 21:52:42.429792 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.429750    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1310003-6f92-423b-9484-63ec209e2167-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-bgt9j\" (UID: \"f1310003-6f92-423b-9484-63ec209e2167\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"
Oct 30 21:52:42.429792 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.429780    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1310003-6f92-423b-9484-63ec209e2167-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-bgt9j\" (UID: \"f1310003-6f92-423b-9484-63ec209e2167\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"
Oct 30 21:52:42.429990 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.429971    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1310003-6f92-423b-9484-63ec209e2167-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-bgt9j\" (UID: \"f1310003-6f92-423b-9484-63ec209e2167\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"
Oct 30 21:52:42.430104 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.430087    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1310003-6f92-423b-9484-63ec209e2167-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-bgt9j\" (UID: \"f1310003-6f92-423b-9484-63ec209e2167\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"
Oct 30 21:52:42.510357 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.510331    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Oct 30 21:52:42.511586 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.511565    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"]
Oct 30 21:52:42.513003 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.512983    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hx4n\" (UniqueName: \"kubernetes.io/projected/f1310003-6f92-423b-9484-63ec209e2167-kube-api-access-5hx4n\") pod \"kserve-module-controller-manager-7566cf5fc8-bgt9j\" (UID: \"f1310003-6f92-423b-9484-63ec209e2167\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"
Oct 30 21:52:42.521484 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.521463    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1310003-6f92-423b-9484-63ec209e2167-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-bgt9j\" (UID: \"f1310003-6f92-423b-9484-63ec209e2167\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"
Oct 30 21:52:42.621949 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:42.621901    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"
Oct 30 21:52:43.045994 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:43.045974    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"]
Oct 30 21:52:43.048877 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:52:43.048848    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1310003_6f92_423b_9484_63ec209e2167.slice/crio-d0be115284767cd0f99713d4acacee8e2a974a30d488cdb7740d19002a723ceb WatchSource:0}: Error finding container d0be115284767cd0f99713d4acacee8e2a974a30d488cdb7740d19002a723ceb: Status 404 returned error can't find the container with id d0be115284767cd0f99713d4acacee8e2a974a30d488cdb7740d19002a723ceb
Oct 30 21:52:44.028340 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:44.028308    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j" event={"ID":"f1310003-6f92-423b-9484-63ec209e2167","Type":"ContainerStarted","Data":"d0be115284767cd0f99713d4acacee8e2a974a30d488cdb7740d19002a723ceb"}
Oct 30 21:52:46.039085 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:46.039027    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j" event={"ID":"f1310003-6f92-423b-9484-63ec209e2167","Type":"ContainerStarted","Data":"7af42ab2787d46512f2fdb25158b71dc36ebd349e63499818b61da59cff57a65"}
Oct 30 21:52:46.039504 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:46.039172    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"
Oct 30 21:52:46.225834 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:46.225781    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j" podStartSLOduration=2.292459369 podStartE2EDuration="4.225765859s" totalImagesPullingTime="1.93330649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:46.206420236 +0000 UTC m=+504.255027928" watchObservedRunningTime="2026-10-30 21:52:46.225765859 +0000 UTC m=+504.274373554"
Oct 30 21:52:54.537776 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:54.537735    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:57.580761 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:52:57.580724    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:02.156373 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:53:02.156337    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:53:05.791959 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:05.791917    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:06.096170 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:06.096082    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:06.337248 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:06.337215    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-2k2zm"]
Oct 30 21:53:06.339494 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:06.339472    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-2k2zm"
Oct 30 21:53:06.406485 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:06.406453    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/395bfd29-a743-48e0-9a19-137fefd272e0-data\") pod \"postgres-7cdbf6dc44-2k2zm\" (UID: \"395bfd29-a743-48e0-9a19-137fefd272e0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-2k2zm"
Oct 30 21:53:06.406646 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:06.406517    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpvgs\" (UniqueName: \"kubernetes.io/projected/395bfd29-a743-48e0-9a19-137fefd272e0-kube-api-access-mpvgs\") pod \"postgres-7cdbf6dc44-2k2zm\" (UID: \"395bfd29-a743-48e0-9a19-137fefd272e0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-2k2zm"
Oct 30 21:53:06.440845 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:06.440815    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:53:06.440845 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:06.440815    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:53:06.440845 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:06.440825    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Oct 30 21:53:06.441057 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:06.440887    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-hldnt\""
Oct 30 21:53:06.442117 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:06.442099    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-2k2zm"]
Oct 30 21:53:06.507997 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:06.507963    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpvgs\" (UniqueName: \"kubernetes.io/projected/395bfd29-a743-48e0-9a19-137fefd272e0-kube-api-access-mpvgs\") pod \"postgres-7cdbf6dc44-2k2zm\" (UID: \"395bfd29-a743-48e0-9a19-137fefd272e0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-2k2zm"
Oct 30 21:53:06.508161 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:06.508028    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/395bfd29-a743-48e0-9a19-137fefd272e0-data\") pod \"postgres-7cdbf6dc44-2k2zm\" (UID: \"395bfd29-a743-48e0-9a19-137fefd272e0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-2k2zm"
Oct 30 21:53:06.508415 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:06.508388    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/395bfd29-a743-48e0-9a19-137fefd272e0-data\") pod \"postgres-7cdbf6dc44-2k2zm\" (UID: \"395bfd29-a743-48e0-9a19-137fefd272e0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-2k2zm"
Oct 30 21:53:06.528108 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:06.528083    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:06.569335 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:06.569300    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpvgs\" (UniqueName: \"kubernetes.io/projected/395bfd29-a743-48e0-9a19-137fefd272e0-kube-api-access-mpvgs\") pod \"postgres-7cdbf6dc44-2k2zm\" (UID: \"395bfd29-a743-48e0-9a19-137fefd272e0\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-2k2zm"
Oct 30 21:53:06.650590 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:06.650560    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-2k2zm"
Oct 30 21:53:07.018625 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:07.018544    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-2k2zm"]
Oct 30 21:53:07.022063 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:53:07.022035    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod395bfd29_a743_48e0_9a19_137fefd272e0.slice/crio-1fd6720b1f728e1faeb8f52ae2b372ba11b4dd5515bf381a549b1f1cbf220ec5 WatchSource:0}: Error finding container 1fd6720b1f728e1faeb8f52ae2b372ba11b4dd5515bf381a549b1f1cbf220ec5: Status 404 returned error can't find the container with id 1fd6720b1f728e1faeb8f52ae2b372ba11b4dd5515bf381a549b1f1cbf220ec5
Oct 30 21:53:07.044313 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:07.044286    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-bgt9j"
Oct 30 21:53:07.132380 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:07.132343    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-2k2zm" event={"ID":"395bfd29-a743-48e0-9a19-137fefd272e0","Type":"ContainerStarted","Data":"1fd6720b1f728e1faeb8f52ae2b372ba11b4dd5515bf381a549b1f1cbf220ec5"}
Oct 30 21:53:14.166856 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:14.166824    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-2k2zm" event={"ID":"395bfd29-a743-48e0-9a19-137fefd272e0","Type":"ContainerStarted","Data":"43412cbb642d1c242699ebeeb9192e656ac552c224853f0b87eada9f3e1f3489"}
Oct 30 21:53:14.167246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:14.166898    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-2k2zm"
Oct 30 21:53:14.286523 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:14.286470    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-2k2zm" podStartSLOduration=1.545649686 podStartE2EDuration="8.286455383s" totalImagesPullingTime="6.740805697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:14.285907268 +0000 UTC m=+532.334514963" watchObservedRunningTime="2026-10-30 21:53:14.286455383 +0000 UTC m=+532.335063075"
Oct 30 21:53:15.181199 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:15.181172    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:20.201408 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:20.201377    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-2k2zm"
Oct 30 21:53:26.131900 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:26.131864    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:27.245587 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:27.245552    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:32.156443 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:53:32.156407    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:53:37.725829 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:37.725796    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:38.213217 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:38.213186    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:38.504745 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:38.504649    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:42.258413 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:42.258383    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:42.612258 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:42.612187    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:43.106691 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.106661    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"]
Oct 30 21:53:43.109868 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.109854    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.193272 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.193234    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4db1d392-2834-4515-84fe-db46cc2c091a-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.193272 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.193267    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4db1d392-2834-4515-84fe-db46cc2c091a-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.193486 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.193371    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx92s\" (UniqueName: \"kubernetes.io/projected/4db1d392-2834-4515-84fe-db46cc2c091a-kube-api-access-lx92s\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.193486 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.193403    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4db1d392-2834-4515-84fe-db46cc2c091a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.193486 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.193423    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4db1d392-2834-4515-84fe-db46cc2c091a-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.193486 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.193472    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4db1d392-2834-4515-84fe-db46cc2c091a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.193730 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.193520    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4db1d392-2834-4515-84fe-db46cc2c091a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.216045 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.216023    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"]
Oct 30 21:53:43.294216 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.294189    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx92s\" (UniqueName: \"kubernetes.io/projected/4db1d392-2834-4515-84fe-db46cc2c091a-kube-api-access-lx92s\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.294652 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.294233    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4db1d392-2834-4515-84fe-db46cc2c091a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.294652 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.294344    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4db1d392-2834-4515-84fe-db46cc2c091a-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.294652 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.294377    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4db1d392-2834-4515-84fe-db46cc2c091a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.294652 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.294404    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4db1d392-2834-4515-84fe-db46cc2c091a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.294652 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.294433    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4db1d392-2834-4515-84fe-db46cc2c091a-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.294652 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.294488    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4db1d392-2834-4515-84fe-db46cc2c091a-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.295409 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.295383    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4db1d392-2834-4515-84fe-db46cc2c091a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.296939 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.296911    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4db1d392-2834-4515-84fe-db46cc2c091a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.297063 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.296951    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4db1d392-2834-4515-84fe-db46cc2c091a-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.297063 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.296955    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4db1d392-2834-4515-84fe-db46cc2c091a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.297063 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.297004    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4db1d392-2834-4515-84fe-db46cc2c091a-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.357095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.357039    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4db1d392-2834-4515-84fe-db46cc2c091a-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.360360 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.360343    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx92s\" (UniqueName: \"kubernetes.io/projected/4db1d392-2834-4515-84fe-db46cc2c091a-kube-api-access-lx92s\") pod \"istiod-openshift-gateway-7ddd9cfdc8-7z498\" (UID: \"4db1d392-2834-4515-84fe-db46cc2c091a\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.421328 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.421305    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:43.914447 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.914395    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"]
Oct 30 21:53:43.917307 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:53:43.917282    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db1d392_2834_4515_84fe_db46cc2c091a.slice/crio-19a9c73f188ac12d55231218d5cda6b07dc604e654313afc6ad99f582e663dcb WatchSource:0}: Error finding container 19a9c73f188ac12d55231218d5cda6b07dc604e654313afc6ad99f582e663dcb: Status 404 returned error can't find the container with id 19a9c73f188ac12d55231218d5cda6b07dc604e654313afc6ad99f582e663dcb
Oct 30 21:53:43.919498 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.919469    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:53:43.919574 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:43.919526    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:53:44.287839 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:44.287758    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498" event={"ID":"4db1d392-2834-4515-84fe-db46cc2c091a","Type":"ContainerStarted","Data":"fe64599497663bb10df714561826d2aa7de27a6a258b3b1c6d3b09125f429788"}
Oct 30 21:53:44.287839 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:44.287818    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498" event={"ID":"4db1d392-2834-4515-84fe-db46cc2c091a","Type":"ContainerStarted","Data":"19a9c73f188ac12d55231218d5cda6b07dc604e654313afc6ad99f582e663dcb"}
Oct 30 21:53:44.288047 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:44.287978    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:44.289348 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:44.289320    4918 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-7z498 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:53:44.289463 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:44.289371    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498" podUID="4db1d392-2834-4515-84fe-db46cc2c091a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:53:44.411128 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:44.410929    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498" podStartSLOduration=1.410911516 podStartE2EDuration="1.410911516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:44.409538309 +0000 UTC m=+562.458146005" watchObservedRunningTime="2026-10-30 21:53:44.410911516 +0000 UTC m=+562.459519212"
Oct 30 21:53:45.291821 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:45.291784    4918 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-7z498 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:53:45.291967 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:45.291843    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498" podUID="4db1d392-2834-4515-84fe-db46cc2c091a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:53:47.520479 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:47.520429    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:48.292888 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.292860    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-7z498"
Oct 30 21:53:48.520994 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.520961    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"]
Oct 30 21:53:48.521383 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.521175    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg" podUID="73d1ad74-3bf0-4943-a1a2-261bd5167d2b" containerName="discovery" containerID="cri-o://0056ed07d40bcf5acae2e2cd1371a52f00b617ac945a44628addf2ccc764c0df" gracePeriod=30
Oct 30 21:53:48.760628 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.760579    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:53:48.838012 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.837975    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-csr-dns-cert\") pod \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") "
Oct 30 21:53:48.838153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.838030    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-kubeconfig\") pod \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") "
Oct 30 21:53:48.838153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.838077    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-kube-api-access-kg6dv\" (UniqueName: \"kubernetes.io/projected/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-kube-api-access-kg6dv\") pod \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") "
Oct 30 21:53:48.838153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.838096    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-csr-ca-configmap\") pod \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") "
Oct 30 21:53:48.838153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.838122    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-token\" (UniqueName: \"kubernetes.io/projected/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-token\") pod \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") "
Oct 30 21:53:48.838355 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.838245    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-local-certs\") pod \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") "
Oct 30 21:53:48.838355 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.838293    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-cacerts\" (UniqueName: \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-cacerts\") pod \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\" (UID: \"73d1ad74-3bf0-4943-a1a2-261bd5167d2b\") "
Oct 30 21:53:48.838926 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.838826    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-csr-ca-configmap" pod "73d1ad74-3bf0-4943-a1a2-261bd5167d2b" (UID: "73d1ad74-3bf0-4943-a1a2-261bd5167d2b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:53:48.840844 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.840818    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-token" pod "73d1ad74-3bf0-4943-a1a2-261bd5167d2b" (UID: "73d1ad74-3bf0-4943-a1a2-261bd5167d2b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:53:48.840982 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.840933    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-kubeconfig" pod "73d1ad74-3bf0-4943-a1a2-261bd5167d2b" (UID: "73d1ad74-3bf0-4943-a1a2-261bd5167d2b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:53:48.841055 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.841025    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-kube-api-access-kg6dv" pod "73d1ad74-3bf0-4943-a1a2-261bd5167d2b" (UID: "73d1ad74-3bf0-4943-a1a2-261bd5167d2b"). InnerVolumeSpecName "kube-api-access-kg6dv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:53:48.841134 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.841102    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-local-certs" pod "73d1ad74-3bf0-4943-a1a2-261bd5167d2b" (UID: "73d1ad74-3bf0-4943-a1a2-261bd5167d2b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:53:48.841256 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.841177    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-cacerts" pod "73d1ad74-3bf0-4943-a1a2-261bd5167d2b" (UID: "73d1ad74-3bf0-4943-a1a2-261bd5167d2b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:53:48.841451 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.841424    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-csr-dns-cert" pod "73d1ad74-3bf0-4943-a1a2-261bd5167d2b" (UID: "73d1ad74-3bf0-4943-a1a2-261bd5167d2b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:53:48.939975 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.939947    4918 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-cacerts\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:48.939975 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.939972    4918 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-csr-dns-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:48.939975 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.939982    4918 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-kubeconfig\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:48.940183 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.939991    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg6dv\" (UniqueName: \"kubernetes.io/projected/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-kube-api-access-kg6dv\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:48.940183 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.940001    4918 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-csr-ca-configmap\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:48.940183 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.940010    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:48.940183 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:48.940018    4918 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73d1ad74-3bf0-4943-a1a2-261bd5167d2b-local-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:49.308730 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:49.308664    4918 generic.go:356] "Generic (PLEG): container finished" podID="73d1ad74-3bf0-4943-a1a2-261bd5167d2b" containerID="0056ed07d40bcf5acae2e2cd1371a52f00b617ac945a44628addf2ccc764c0df" exitCode=0
Oct 30 21:53:49.308893 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:49.308741    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"
Oct 30 21:53:49.308893 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:49.308746    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg" event={"ID":"73d1ad74-3bf0-4943-a1a2-261bd5167d2b","Type":"ContainerDied","Data":"0056ed07d40bcf5acae2e2cd1371a52f00b617ac945a44628addf2ccc764c0df"}
Oct 30 21:53:49.308893 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:49.308795    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg" event={"ID":"73d1ad74-3bf0-4943-a1a2-261bd5167d2b","Type":"ContainerDied","Data":"cc52c2ca2fa31a429e802d2d7087a0a47da9e17ecf91100e443530d022b8bb05"}
Oct 30 21:53:49.308893 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:49.308815    4918 scope.go:122] "RemoveContainer" containerID="0056ed07d40bcf5acae2e2cd1371a52f00b617ac945a44628addf2ccc764c0df"
Oct 30 21:53:49.312540 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:49.312505    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:49.318246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:49.318224    4918 scope.go:122] "RemoveContainer" containerID="0056ed07d40bcf5acae2e2cd1371a52f00b617ac945a44628addf2ccc764c0df"
Oct 30 21:53:49.318511 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:53:49.318493    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0056ed07d40bcf5acae2e2cd1371a52f00b617ac945a44628addf2ccc764c0df\": container with ID starting with 0056ed07d40bcf5acae2e2cd1371a52f00b617ac945a44628addf2ccc764c0df not found: ID does not exist" containerID="0056ed07d40bcf5acae2e2cd1371a52f00b617ac945a44628addf2ccc764c0df"
Oct 30 21:53:49.318559 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:49.318520    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0056ed07d40bcf5acae2e2cd1371a52f00b617ac945a44628addf2ccc764c0df"} err="failed to get container status \"0056ed07d40bcf5acae2e2cd1371a52f00b617ac945a44628addf2ccc764c0df\": rpc error: code = NotFound desc = could not find container \"0056ed07d40bcf5acae2e2cd1371a52f00b617ac945a44628addf2ccc764c0df\": container with ID starting with 0056ed07d40bcf5acae2e2cd1371a52f00b617ac945a44628addf2ccc764c0df not found: ID does not exist"
Oct 30 21:53:49.474031 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:49.473992    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"]
Oct 30 21:53:49.523139 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:49.523113    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mvctg"]
Oct 30 21:53:50.070287 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:50.070257    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="73d1ad74-3bf0-4943-a1a2-261bd5167d2b" path="/var/lib/kubelet/pods/73d1ad74-3bf0-4943-a1a2-261bd5167d2b/volumes"
Oct 30 21:53:50.303108 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:50.303068    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:55.534694 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:55.534653    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:55.795081 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:55.795008    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:56.050648 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:56.050559    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:56.314456 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:56.314369    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:56.566112 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:56.566026    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:56.824875 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:53:56.824794    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:02.157272 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:54:02.157187    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:54:14.639853 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:14.639818    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:14.904184 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:14.904102    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:15.532886 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:15.532852    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:16.866175 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:16.866137    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:17.195286 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.195257    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:17.491866 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.491775    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:17.804956 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.804869    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"]
Oct 30 21:54:17.805244 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.805232    4918 cpu_manager.go:414] "containerMap: removing container" podUID="73d1ad74-3bf0-4943-a1a2-261bd5167d2b" containerName="discovery"
Oct 30 21:54:17.805288 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.805245    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="73d1ad74-3bf0-4943-a1a2-261bd5167d2b" containerName="discovery"
Oct 30 21:54:17.805325 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.805299    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="73d1ad74-3bf0-4943-a1a2-261bd5167d2b" containerName="discovery"
Oct 30 21:54:17.807190 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.807174    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:17.860881 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.860853    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz5xt\" (UniqueName: \"kubernetes.io/projected/8739da63-b621-415a-8cb5-f8928bf1b08b-kube-api-access-jz5xt\") pod \"maas-api-6d669c7fcd-jt888\" (UID: \"8739da63-b621-415a-8cb5-f8928bf1b08b\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:17.860998 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.860888    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8739da63-b621-415a-8cb5-f8928bf1b08b-maas-api-tls\") pod \"maas-api-6d669c7fcd-jt888\" (UID: \"8739da63-b621-415a-8cb5-f8928bf1b08b\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:17.860998 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.860910    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8739da63-b621-415a-8cb5-f8928bf1b08b-openshift-service-ca\") pod \"maas-api-6d669c7fcd-jt888\" (UID: \"8739da63-b621-415a-8cb5-f8928bf1b08b\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:17.861068 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.861047    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8739da63-b621-415a-8cb5-f8928bf1b08b-metrics-certs\") pod \"maas-api-6d669c7fcd-jt888\" (UID: \"8739da63-b621-415a-8cb5-f8928bf1b08b\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:17.911966 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.911945    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 21:54:17.911966 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.911945    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 30 21:54:17.912317 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.911976    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vp6qk\""
Oct 30 21:54:17.926771 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.926750    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"]
Oct 30 21:54:17.961720 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.961668    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz5xt\" (UniqueName: \"kubernetes.io/projected/8739da63-b621-415a-8cb5-f8928bf1b08b-kube-api-access-jz5xt\") pod \"maas-api-6d669c7fcd-jt888\" (UID: \"8739da63-b621-415a-8cb5-f8928bf1b08b\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:17.961814 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.961727    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8739da63-b621-415a-8cb5-f8928bf1b08b-maas-api-tls\") pod \"maas-api-6d669c7fcd-jt888\" (UID: \"8739da63-b621-415a-8cb5-f8928bf1b08b\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:17.961912 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.961890    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8739da63-b621-415a-8cb5-f8928bf1b08b-openshift-service-ca\") pod \"maas-api-6d669c7fcd-jt888\" (UID: \"8739da63-b621-415a-8cb5-f8928bf1b08b\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:17.962018 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.962002    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8739da63-b621-415a-8cb5-f8928bf1b08b-metrics-certs\") pod \"maas-api-6d669c7fcd-jt888\" (UID: \"8739da63-b621-415a-8cb5-f8928bf1b08b\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:17.962519 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.962496    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8739da63-b621-415a-8cb5-f8928bf1b08b-openshift-service-ca\") pod \"maas-api-6d669c7fcd-jt888\" (UID: \"8739da63-b621-415a-8cb5-f8928bf1b08b\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:17.964280 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.964262    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8739da63-b621-415a-8cb5-f8928bf1b08b-maas-api-tls\") pod \"maas-api-6d669c7fcd-jt888\" (UID: \"8739da63-b621-415a-8cb5-f8928bf1b08b\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:17.964364 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:17.964349    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8739da63-b621-415a-8cb5-f8928bf1b08b-metrics-certs\") pod \"maas-api-6d669c7fcd-jt888\" (UID: \"8739da63-b621-415a-8cb5-f8928bf1b08b\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:18.022673 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:18.022653    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz5xt\" (UniqueName: \"kubernetes.io/projected/8739da63-b621-415a-8cb5-f8928bf1b08b-kube-api-access-jz5xt\") pod \"maas-api-6d669c7fcd-jt888\" (UID: \"8739da63-b621-415a-8cb5-f8928bf1b08b\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:18.118723 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:18.118654    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:18.491785 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:18.491745    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"]
Oct 30 21:54:18.495174 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:54:18.495144    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8739da63_b621_415a_8cb5_f8928bf1b08b.slice/crio-921db3d5a55fdb53ead1a74dc2f87b34fe43217507e79c0bd1e10ddc3b145734 WatchSource:0}: Error finding container 921db3d5a55fdb53ead1a74dc2f87b34fe43217507e79c0bd1e10ddc3b145734: Status 404 returned error can't find the container with id 921db3d5a55fdb53ead1a74dc2f87b34fe43217507e79c0bd1e10ddc3b145734
Oct 30 21:54:19.441024 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:19.440991    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888" event={"ID":"8739da63-b621-415a-8cb5-f8928bf1b08b","Type":"ContainerStarted","Data":"921db3d5a55fdb53ead1a74dc2f87b34fe43217507e79c0bd1e10ddc3b145734"}
Oct 30 21:54:21.451990 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:21.451954    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888" event={"ID":"8739da63-b621-415a-8cb5-f8928bf1b08b","Type":"ContainerStarted","Data":"51c01e47e8d6b9da509150d6dbb0333024d1e07c7e56af36b8f33c895376cbf8"}
Oct 30 21:54:21.452329 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:21.452046    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:22.092743 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:22.092712    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 21:54:22.094472 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:22.094451    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 21:54:27.461359 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:27.461329    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:27.580284 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:27.580229    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888" podStartSLOduration=7.709508313 podStartE2EDuration="10.580214001s" totalImagesPullingTime="2.870705688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:21.606034695 +0000 UTC m=+599.654642391" watchObservedRunningTime="2026-10-30 21:54:27.580214001 +0000 UTC m=+605.628821695"
Oct 30 21:54:32.157300 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:54:32.157265    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:54:38.227122 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.227090    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:38.493846 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.493775    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:38.733817 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.733785    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-699557768d-h2h47"]
Oct 30 21:54:38.738090 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.738067    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 21:54:38.819141 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.819117    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fec3021-78f4-4790-9d33-772cb1e15a22-maas-api-tls\") pod \"maas-api-699557768d-h2h47\" (UID: \"9fec3021-78f4-4790-9d33-772cb1e15a22\") " pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 21:54:38.819251 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.819162    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fec3021-78f4-4790-9d33-772cb1e15a22-metrics-certs\") pod \"maas-api-699557768d-h2h47\" (UID: \"9fec3021-78f4-4790-9d33-772cb1e15a22\") " pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 21:54:38.819251 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.819181    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fec3021-78f4-4790-9d33-772cb1e15a22-openshift-service-ca\") pod \"maas-api-699557768d-h2h47\" (UID: \"9fec3021-78f4-4790-9d33-772cb1e15a22\") " pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 21:54:38.819330 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.819315    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2m9r\" (UniqueName: \"kubernetes.io/projected/9fec3021-78f4-4790-9d33-772cb1e15a22-kube-api-access-f2m9r\") pod \"maas-api-699557768d-h2h47\" (UID: \"9fec3021-78f4-4790-9d33-772cb1e15a22\") " pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 21:54:38.853529 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.853505    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-699557768d-h2h47"]
Oct 30 21:54:38.920269 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.920237    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fec3021-78f4-4790-9d33-772cb1e15a22-maas-api-tls\") pod \"maas-api-699557768d-h2h47\" (UID: \"9fec3021-78f4-4790-9d33-772cb1e15a22\") " pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 21:54:38.920412 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.920293    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fec3021-78f4-4790-9d33-772cb1e15a22-metrics-certs\") pod \"maas-api-699557768d-h2h47\" (UID: \"9fec3021-78f4-4790-9d33-772cb1e15a22\") " pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 21:54:38.920492 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.920471    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fec3021-78f4-4790-9d33-772cb1e15a22-openshift-service-ca\") pod \"maas-api-699557768d-h2h47\" (UID: \"9fec3021-78f4-4790-9d33-772cb1e15a22\") " pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 21:54:38.920559 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.920529    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2m9r\" (UniqueName: \"kubernetes.io/projected/9fec3021-78f4-4790-9d33-772cb1e15a22-kube-api-access-f2m9r\") pod \"maas-api-699557768d-h2h47\" (UID: \"9fec3021-78f4-4790-9d33-772cb1e15a22\") " pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 21:54:38.921111 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.921091    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fec3021-78f4-4790-9d33-772cb1e15a22-openshift-service-ca\") pod \"maas-api-699557768d-h2h47\" (UID: \"9fec3021-78f4-4790-9d33-772cb1e15a22\") " pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 21:54:38.922905 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.922886    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fec3021-78f4-4790-9d33-772cb1e15a22-metrics-certs\") pod \"maas-api-699557768d-h2h47\" (UID: \"9fec3021-78f4-4790-9d33-772cb1e15a22\") " pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 21:54:38.922991 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.922961    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fec3021-78f4-4790-9d33-772cb1e15a22-maas-api-tls\") pod \"maas-api-699557768d-h2h47\" (UID: \"9fec3021-78f4-4790-9d33-772cb1e15a22\") " pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 21:54:38.983053 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:38.983021    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2m9r\" (UniqueName: \"kubernetes.io/projected/9fec3021-78f4-4790-9d33-772cb1e15a22-kube-api-access-f2m9r\") pod \"maas-api-699557768d-h2h47\" (UID: \"9fec3021-78f4-4790-9d33-772cb1e15a22\") " pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 21:54:39.050176 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:39.050102    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 21:54:39.342668 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:39.342595    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6845bc4bd4-5vkn6"]
Oct 30 21:54:39.345167 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:39.345151    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6845bc4bd4-5vkn6"
Oct 30 21:54:39.399033 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:39.399005    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 30 21:54:39.405522 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:39.405501    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6845bc4bd4-5vkn6"]
Oct 30 21:54:39.424335 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:39.424314    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ckgx\" (UniqueName: \"kubernetes.io/projected/4b9985b8-c336-411b-b7a0-07315f5662a4-kube-api-access-7ckgx\") pod \"authorino-6845bc4bd4-5vkn6\" (UID: \"4b9985b8-c336-411b-b7a0-07315f5662a4\") " pod="kuadrant-system/authorino-6845bc4bd4-5vkn6"
Oct 30 21:54:39.424426 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:39.424342    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9985b8-c336-411b-b7a0-07315f5662a4-tls-cert\") pod \"authorino-6845bc4bd4-5vkn6\" (UID: \"4b9985b8-c336-411b-b7a0-07315f5662a4\") " pod="kuadrant-system/authorino-6845bc4bd4-5vkn6"
Oct 30 21:54:39.472988 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:39.472963    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-699557768d-h2h47"]
Oct 30 21:54:39.476433 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:54:39.476403    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fec3021_78f4_4790_9d33_772cb1e15a22.slice/crio-fab2ddbbb985a0687796e590952c162f6d5c7e3345a8bee757de2bb3b9c1b933 WatchSource:0}: Error finding container fab2ddbbb985a0687796e590952c162f6d5c7e3345a8bee757de2bb3b9c1b933: Status 404 returned error can't find the container with id fab2ddbbb985a0687796e590952c162f6d5c7e3345a8bee757de2bb3b9c1b933
Oct 30 21:54:39.525713 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:39.525665    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ckgx\" (UniqueName: \"kubernetes.io/projected/4b9985b8-c336-411b-b7a0-07315f5662a4-kube-api-access-7ckgx\") pod \"authorino-6845bc4bd4-5vkn6\" (UID: \"4b9985b8-c336-411b-b7a0-07315f5662a4\") " pod="kuadrant-system/authorino-6845bc4bd4-5vkn6"
Oct 30 21:54:39.525824 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:39.525733    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9985b8-c336-411b-b7a0-07315f5662a4-tls-cert\") pod \"authorino-6845bc4bd4-5vkn6\" (UID: \"4b9985b8-c336-411b-b7a0-07315f5662a4\") " pod="kuadrant-system/authorino-6845bc4bd4-5vkn6"
Oct 30 21:54:39.528296 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:39.528276    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9985b8-c336-411b-b7a0-07315f5662a4-tls-cert\") pod \"authorino-6845bc4bd4-5vkn6\" (UID: \"4b9985b8-c336-411b-b7a0-07315f5662a4\") " pod="kuadrant-system/authorino-6845bc4bd4-5vkn6"
Oct 30 21:54:39.535647 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:39.535619    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47" event={"ID":"9fec3021-78f4-4790-9d33-772cb1e15a22","Type":"ContainerStarted","Data":"fab2ddbbb985a0687796e590952c162f6d5c7e3345a8bee757de2bb3b9c1b933"}
Oct 30 21:54:39.592055 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:39.592035    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ckgx\" (UniqueName: \"kubernetes.io/projected/4b9985b8-c336-411b-b7a0-07315f5662a4-kube-api-access-7ckgx\") pod \"authorino-6845bc4bd4-5vkn6\" (UID: \"4b9985b8-c336-411b-b7a0-07315f5662a4\") " pod="kuadrant-system/authorino-6845bc4bd4-5vkn6"
Oct 30 21:54:39.656045 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:39.656025    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6845bc4bd4-5vkn6"
Oct 30 21:54:40.026125 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:40.026053    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6845bc4bd4-5vkn6"]
Oct 30 21:54:40.028997 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:54:40.028969    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b9985b8_c336_411b_b7a0_07315f5662a4.slice/crio-a166789e7dcb202752605a2f24ea85f5e2544471999fba8db73385bd676d0073 WatchSource:0}: Error finding container a166789e7dcb202752605a2f24ea85f5e2544471999fba8db73385bd676d0073: Status 404 returned error can't find the container with id a166789e7dcb202752605a2f24ea85f5e2544471999fba8db73385bd676d0073
Oct 30 21:54:40.542225 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:40.542189    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6845bc4bd4-5vkn6" event={"ID":"4b9985b8-c336-411b-b7a0-07315f5662a4","Type":"ContainerStarted","Data":"a166789e7dcb202752605a2f24ea85f5e2544471999fba8db73385bd676d0073"}
Oct 30 21:54:40.543625 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:40.543594    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47" event={"ID":"9fec3021-78f4-4790-9d33-772cb1e15a22","Type":"ContainerStarted","Data":"3890086cc5a22bb28e188c2e45b367b1340ebaca9ed3aca6b96aa53aaeebb17a"}
Oct 30 21:54:40.543754 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:40.543719    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 21:54:40.662531 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:40.662481    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47" podStartSLOduration=1.8002061440000001 podStartE2EDuration="2.66246588s" totalImagesPullingTime="862.259736ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:40.662353067 +0000 UTC m=+618.710960763" watchObservedRunningTime="2026-10-30 21:54:40.66246588 +0000 UTC m=+618.711073576"
Oct 30 21:54:41.549597 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:41.549558    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6845bc4bd4-5vkn6" event={"ID":"4b9985b8-c336-411b-b7a0-07315f5662a4","Type":"ContainerStarted","Data":"dd6bf17776c26304f6d5c8995d4bd4b2bb5fb3ed0af057b8c4bcfec34af24b3e"}
Oct 30 21:54:41.664724 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:41.664328    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6845bc4bd4-5vkn6" podStartSLOduration=1.328871394 podStartE2EDuration="2.664310042s" totalImagesPullingTime="1.335438648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:54:41.6635451 +0000 UTC m=+619.712152794" watchObservedRunningTime="2026-10-30 21:54:41.664310042 +0000 UTC m=+619.712917740"
Oct 30 21:54:41.703887 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:41.703859    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-shrlf"]
Oct 30 21:54:41.704089 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:41.704068    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-shrlf" podUID="2c5c3512-2dff-49da-bbd8-cd000c5c61a3" containerName="authorino" containerID="cri-o://3f8c3c11df86926ea6a9b36767fab4bf7b535df9136d6e36771972a23a8c58e2" gracePeriod=30
Oct 30 21:54:41.944346 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:41.944321    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-shrlf"
Oct 30 21:54:42.045194 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:42.045163    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2c5c3512-2dff-49da-bbd8-cd000c5c61a3-kube-api-access-lcb7g\" (UniqueName: \"kubernetes.io/projected/2c5c3512-2dff-49da-bbd8-cd000c5c61a3-kube-api-access-lcb7g\") pod \"2c5c3512-2dff-49da-bbd8-cd000c5c61a3\" (UID: \"2c5c3512-2dff-49da-bbd8-cd000c5c61a3\") "
Oct 30 21:54:42.047461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:42.047425    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c5c3512-2dff-49da-bbd8-cd000c5c61a3-kube-api-access-lcb7g" pod "2c5c3512-2dff-49da-bbd8-cd000c5c61a3" (UID: "2c5c3512-2dff-49da-bbd8-cd000c5c61a3"). InnerVolumeSpecName "kube-api-access-lcb7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:54:42.147376 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:42.146117    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcb7g\" (UniqueName: \"kubernetes.io/projected/2c5c3512-2dff-49da-bbd8-cd000c5c61a3-kube-api-access-lcb7g\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:42.234891 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:42.234800    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:42.485399 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:42.485315    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:42.555659 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:42.555628    4918 generic.go:356] "Generic (PLEG): container finished" podID="2c5c3512-2dff-49da-bbd8-cd000c5c61a3" containerID="3f8c3c11df86926ea6a9b36767fab4bf7b535df9136d6e36771972a23a8c58e2" exitCode=0
Oct 30 21:54:42.556101 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:42.555712    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-shrlf"
Oct 30 21:54:42.556101 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:42.555716    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-shrlf" event={"ID":"2c5c3512-2dff-49da-bbd8-cd000c5c61a3","Type":"ContainerDied","Data":"3f8c3c11df86926ea6a9b36767fab4bf7b535df9136d6e36771972a23a8c58e2"}
Oct 30 21:54:42.556101 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:42.555757    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-shrlf" event={"ID":"2c5c3512-2dff-49da-bbd8-cd000c5c61a3","Type":"ContainerDied","Data":"2547d1d6970301b1f38e240ebe95bf9018996c60c4df6a877753727c47fed84a"}
Oct 30 21:54:42.556101 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:42.555773    4918 scope.go:122] "RemoveContainer" containerID="3f8c3c11df86926ea6a9b36767fab4bf7b535df9136d6e36771972a23a8c58e2"
Oct 30 21:54:42.564561 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:42.564540    4918 scope.go:122] "RemoveContainer" containerID="3f8c3c11df86926ea6a9b36767fab4bf7b535df9136d6e36771972a23a8c58e2"
Oct 30 21:54:42.564881 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:54:42.564863    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f8c3c11df86926ea6a9b36767fab4bf7b535df9136d6e36771972a23a8c58e2\": container with ID starting with 3f8c3c11df86926ea6a9b36767fab4bf7b535df9136d6e36771972a23a8c58e2 not found: ID does not exist" containerID="3f8c3c11df86926ea6a9b36767fab4bf7b535df9136d6e36771972a23a8c58e2"
Oct 30 21:54:42.564956 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:42.564890    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f8c3c11df86926ea6a9b36767fab4bf7b535df9136d6e36771972a23a8c58e2"} err="failed to get container status \"3f8c3c11df86926ea6a9b36767fab4bf7b535df9136d6e36771972a23a8c58e2\": rpc error: code = NotFound desc = could not find container \"3f8c3c11df86926ea6a9b36767fab4bf7b535df9136d6e36771972a23a8c58e2\": container with ID starting with 3f8c3c11df86926ea6a9b36767fab4bf7b535df9136d6e36771972a23a8c58e2 not found: ID does not exist"
Oct 30 21:54:42.722752 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:42.722719    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-shrlf"]
Oct 30 21:54:42.726543 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:42.726520    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-shrlf"]
Oct 30 21:54:44.070503 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:44.070467    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2c5c3512-2dff-49da-bbd8-cd000c5c61a3" path="/var/lib/kubelet/pods/2c5c3512-2dff-49da-bbd8-cd000c5c61a3/volumes"
Oct 30 21:54:46.555703 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:46.555649    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 21:54:46.724283 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:46.724249    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"]
Oct 30 21:54:46.724494 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:46.724466    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888" podUID="8739da63-b621-415a-8cb5-f8928bf1b08b" containerName="maas-api" containerID="cri-o://51c01e47e8d6b9da509150d6dbb0333024d1e07c7e56af36b8f33c895376cbf8" gracePeriod=30
Oct 30 21:54:46.972958 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:46.972935    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:47.080367 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.080340    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8739da63-b621-415a-8cb5-f8928bf1b08b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8739da63-b621-415a-8cb5-f8928bf1b08b-maas-api-tls\") pod \"8739da63-b621-415a-8cb5-f8928bf1b08b\" (UID: \"8739da63-b621-415a-8cb5-f8928bf1b08b\") "
Oct 30 21:54:47.080500 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.080381    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8739da63-b621-415a-8cb5-f8928bf1b08b-kube-api-access-jz5xt\" (UniqueName: \"kubernetes.io/projected/8739da63-b621-415a-8cb5-f8928bf1b08b-kube-api-access-jz5xt\") pod \"8739da63-b621-415a-8cb5-f8928bf1b08b\" (UID: \"8739da63-b621-415a-8cb5-f8928bf1b08b\") "
Oct 30 21:54:47.080500 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.080429    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8739da63-b621-415a-8cb5-f8928bf1b08b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8739da63-b621-415a-8cb5-f8928bf1b08b-metrics-certs\") pod \"8739da63-b621-415a-8cb5-f8928bf1b08b\" (UID: \"8739da63-b621-415a-8cb5-f8928bf1b08b\") "
Oct 30 21:54:47.080500 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.080456    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8739da63-b621-415a-8cb5-f8928bf1b08b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8739da63-b621-415a-8cb5-f8928bf1b08b-openshift-service-ca\") pod \"8739da63-b621-415a-8cb5-f8928bf1b08b\" (UID: \"8739da63-b621-415a-8cb5-f8928bf1b08b\") "
Oct 30 21:54:47.080924 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.080899    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8739da63-b621-415a-8cb5-f8928bf1b08b-openshift-service-ca" pod "8739da63-b621-415a-8cb5-f8928bf1b08b" (UID: "8739da63-b621-415a-8cb5-f8928bf1b08b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:54:47.082779 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.082751    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8739da63-b621-415a-8cb5-f8928bf1b08b-maas-api-tls" pod "8739da63-b621-415a-8cb5-f8928bf1b08b" (UID: "8739da63-b621-415a-8cb5-f8928bf1b08b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:54:47.082862 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.082810    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8739da63-b621-415a-8cb5-f8928bf1b08b-kube-api-access-jz5xt" pod "8739da63-b621-415a-8cb5-f8928bf1b08b" (UID: "8739da63-b621-415a-8cb5-f8928bf1b08b"). InnerVolumeSpecName "kube-api-access-jz5xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:54:47.082862 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.082831    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8739da63-b621-415a-8cb5-f8928bf1b08b-metrics-certs" pod "8739da63-b621-415a-8cb5-f8928bf1b08b" (UID: "8739da63-b621-415a-8cb5-f8928bf1b08b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:54:47.181658 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.181629    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8739da63-b621-415a-8cb5-f8928bf1b08b-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:47.181658 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.181655    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8739da63-b621-415a-8cb5-f8928bf1b08b-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:47.181847 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.181665    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz5xt\" (UniqueName: \"kubernetes.io/projected/8739da63-b621-415a-8cb5-f8928bf1b08b-kube-api-access-jz5xt\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:47.181847 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.181675    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8739da63-b621-415a-8cb5-f8928bf1b08b-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:47.579960 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.579882    4918 generic.go:356] "Generic (PLEG): container finished" podID="8739da63-b621-415a-8cb5-f8928bf1b08b" containerID="51c01e47e8d6b9da509150d6dbb0333024d1e07c7e56af36b8f33c895376cbf8" exitCode=0
Oct 30 21:54:47.579960 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.579931    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"
Oct 30 21:54:47.580457 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.579970    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888" event={"ID":"8739da63-b621-415a-8cb5-f8928bf1b08b","Type":"ContainerDied","Data":"51c01e47e8d6b9da509150d6dbb0333024d1e07c7e56af36b8f33c895376cbf8"}
Oct 30 21:54:47.580457 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.580040    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888" event={"ID":"8739da63-b621-415a-8cb5-f8928bf1b08b","Type":"ContainerDied","Data":"921db3d5a55fdb53ead1a74dc2f87b34fe43217507e79c0bd1e10ddc3b145734"}
Oct 30 21:54:47.580457 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.580076    4918 scope.go:122] "RemoveContainer" containerID="51c01e47e8d6b9da509150d6dbb0333024d1e07c7e56af36b8f33c895376cbf8"
Oct 30 21:54:47.589394 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.589379    4918 scope.go:122] "RemoveContainer" containerID="51c01e47e8d6b9da509150d6dbb0333024d1e07c7e56af36b8f33c895376cbf8"
Oct 30 21:54:47.589714 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:54:47.589691    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51c01e47e8d6b9da509150d6dbb0333024d1e07c7e56af36b8f33c895376cbf8\": container with ID starting with 51c01e47e8d6b9da509150d6dbb0333024d1e07c7e56af36b8f33c895376cbf8 not found: ID does not exist" containerID="51c01e47e8d6b9da509150d6dbb0333024d1e07c7e56af36b8f33c895376cbf8"
Oct 30 21:54:47.589756 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.589725    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51c01e47e8d6b9da509150d6dbb0333024d1e07c7e56af36b8f33c895376cbf8"} err="failed to get container status \"51c01e47e8d6b9da509150d6dbb0333024d1e07c7e56af36b8f33c895376cbf8\": rpc error: code = NotFound desc = could not find container \"51c01e47e8d6b9da509150d6dbb0333024d1e07c7e56af36b8f33c895376cbf8\": container with ID starting with 51c01e47e8d6b9da509150d6dbb0333024d1e07c7e56af36b8f33c895376cbf8 not found: ID does not exist"
Oct 30 21:54:47.743966 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.743947    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"]
Oct 30 21:54:47.793123 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:47.793099    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-jt888"]
Oct 30 21:54:48.070323 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:48.070292    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8739da63-b621-415a-8cb5-f8928bf1b08b" path="/var/lib/kubelet/pods/8739da63-b621-415a-8cb5-f8928bf1b08b/volumes"
Oct 30 21:54:54.251191 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:54.251154    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:59.293250 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:59.293210    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:59.584821 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:54:59.584737    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:02.156621 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:55:02.156580    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:55:15.891453 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:15.891418    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:32.156729 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:55:32.156621    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:55:46.693512 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:46.693473    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:46.964004 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:46.963913    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:52.076452 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:52.076419    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:52.331324 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:52.331245    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:55.730219 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:55.730169    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:59.099615 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.099581    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"]
Oct 30 21:55:59.100025 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.099984    4918 cpu_manager.go:414] "containerMap: removing container" podUID="2c5c3512-2dff-49da-bbd8-cd000c5c61a3" containerName="authorino"
Oct 30 21:55:59.100025 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.099996    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2c5c3512-2dff-49da-bbd8-cd000c5c61a3" containerName="authorino"
Oct 30 21:55:59.100025 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.100004    4918 cpu_manager.go:414] "containerMap: removing container" podUID="8739da63-b621-415a-8cb5-f8928bf1b08b" containerName="maas-api"
Oct 30 21:55:59.100025 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.100009    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8739da63-b621-415a-8cb5-f8928bf1b08b" containerName="maas-api"
Oct 30 21:55:59.100155 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.100077    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="2c5c3512-2dff-49da-bbd8-cd000c5c61a3" containerName="authorino"
Oct 30 21:55:59.100155 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.100085    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="8739da63-b621-415a-8cb5-f8928bf1b08b" containerName="maas-api"
Oct 30 21:55:59.103214 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.103194    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.120490 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.120466    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncj7j\" (UniqueName: \"kubernetes.io/projected/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-kube-api-access-ncj7j\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.120613 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.120505    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.120613 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.120526    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.120734 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.120608    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.120734 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.120722    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.120824 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.120768    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.155634 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.155604    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 30 21:55:59.204777 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.204735    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m2997\""
Oct 30 21:55:59.204777 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.204751    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 30 21:55:59.205027 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.204835    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Oct 30 21:55:59.206278 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.206260    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"]
Oct 30 21:55:59.222017 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.221985    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.222151 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.222027    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.222151 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.222069    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncj7j\" (UniqueName: \"kubernetes.io/projected/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-kube-api-access-ncj7j\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.222151 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.222091    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.222151 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.222109    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.222151 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.222123    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.222654 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.222624    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.222782 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.222665    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.222782 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.222701    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.224750 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.224720    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.224871 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.224791    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.285599 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.285556    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncj7j\" (UniqueName: \"kubernetes.io/projected/6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c-kube-api-access-ncj7j\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb\" (UID: \"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.309215 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.309183    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:59.415814 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.415780    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:55:59.798623 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.798544    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"]
Oct 30 21:55:59.801800 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:55:59.801768    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c12ccc3_d1d2_4dbe_a5c6_87023edabc3c.slice/crio-8762596bcf1ced76e48f626ec76a87c213e22d0fe6d22e77f1d4ce86cbf85810 WatchSource:0}: Error finding container 8762596bcf1ced76e48f626ec76a87c213e22d0fe6d22e77f1d4ce86cbf85810: Status 404 returned error can't find the container with id 8762596bcf1ced76e48f626ec76a87c213e22d0fe6d22e77f1d4ce86cbf85810
Oct 30 21:55:59.803143 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.803125    4918 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:55:59.900012 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:55:59.899977    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb" event={"ID":"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c","Type":"ContainerStarted","Data":"8762596bcf1ced76e48f626ec76a87c213e22d0fe6d22e77f1d4ce86cbf85810"}
Oct 30 21:56:01.915878 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:01.915836    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb" event={"ID":"6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c","Type":"ContainerStarted","Data":"472d1faf3f03cb384c9d2f89833cb5ce0e7484db759ad3f1e83bb4d60645d664"}
Oct 30 21:56:02.034387 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:02.034331    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb" podStartSLOduration=1.562344316 podStartE2EDuration="3.034313247s" totalImagesPullingTime="1.471968931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:55:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:56:02.032764879 +0000 UTC m=+700.081372574" watchObservedRunningTime="2026-10-30 21:56:02.034313247 +0000 UTC m=+700.082920943"
Oct 30 21:56:02.158047 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:56:02.158002    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:56:02.416848 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:02.416813    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:56:04.110703 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.110656    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"]
Oct 30 21:56:04.114035 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.114013    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.165749 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.165716    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1150673c-da76-4039-a140-830fcd2b5673-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.166018 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.165978    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1150673c-da76-4039-a140-830fcd2b5673-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.166136 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.166053    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjf8f\" (UniqueName: \"kubernetes.io/projected/1150673c-da76-4039-a140-830fcd2b5673-kube-api-access-xjf8f\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.166136 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.166109    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1150673c-da76-4039-a140-830fcd2b5673-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.166265 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.166239    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1150673c-da76-4039-a140-830fcd2b5673-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.166474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.166298    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1150673c-da76-4039-a140-830fcd2b5673-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.166551 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.166480    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Oct 30 21:56:04.216881 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.216850    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"]
Oct 30 21:56:04.266955 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.266921    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1150673c-da76-4039-a140-830fcd2b5673-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.267153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.266962    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1150673c-da76-4039-a140-830fcd2b5673-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.267153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.267004    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjf8f\" (UniqueName: \"kubernetes.io/projected/1150673c-da76-4039-a140-830fcd2b5673-kube-api-access-xjf8f\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.267153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.267028    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1150673c-da76-4039-a140-830fcd2b5673-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.267153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.267060    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1150673c-da76-4039-a140-830fcd2b5673-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.267153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.267090    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1150673c-da76-4039-a140-830fcd2b5673-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.267474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.267447    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1150673c-da76-4039-a140-830fcd2b5673-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.267474 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.267463    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1150673c-da76-4039-a140-830fcd2b5673-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.267609 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.267499    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1150673c-da76-4039-a140-830fcd2b5673-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.269582 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.269558    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1150673c-da76-4039-a140-830fcd2b5673-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.269714 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.269664    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1150673c-da76-4039-a140-830fcd2b5673-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.313565 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.313533    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:04.327805 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.327782    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjf8f\" (UniqueName: \"kubernetes.io/projected/1150673c-da76-4039-a140-830fcd2b5673-kube-api-access-xjf8f\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-ksqwd\" (UID: \"1150673c-da76-4039-a140-830fcd2b5673\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.426609 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.426571    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:04.805983 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.805910    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"]
Oct 30 21:56:04.809217 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:56:04.809179    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1150673c_da76_4039_a140_830fcd2b5673.slice/crio-d9a85b37f11f7c1e8827ed488947840ac9f8eaf75b8c4a8244f5f3b70c265be2 WatchSource:0}: Error finding container d9a85b37f11f7c1e8827ed488947840ac9f8eaf75b8c4a8244f5f3b70c265be2: Status 404 returned error can't find the container with id d9a85b37f11f7c1e8827ed488947840ac9f8eaf75b8c4a8244f5f3b70c265be2
Oct 30 21:56:04.929485 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:04.929451    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd" event={"ID":"1150673c-da76-4039-a140-830fcd2b5673","Type":"ContainerStarted","Data":"d9a85b37f11f7c1e8827ed488947840ac9f8eaf75b8c4a8244f5f3b70c265be2"}
Oct 30 21:56:05.934756 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:05.934721    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd" event={"ID":"1150673c-da76-4039-a140-830fcd2b5673","Type":"ContainerStarted","Data":"4cdebfee9bc4c40069f6b98e7db34e0467712c5ced4379d60aade440f1382423"}
Oct 30 21:56:06.055556 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:06.055499    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd" podStartSLOduration=1.459894059 podStartE2EDuration="2.055485406s" totalImagesPullingTime="595.591347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:56:06.054072906 +0000 UTC m=+704.102680600" watchObservedRunningTime="2026-10-30 21:56:06.055485406 +0000 UTC m=+704.104093101"
Oct 30 21:56:06.426833 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:06.426799    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:08.284337 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:08.284299    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:09.416505 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:09.416462    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:56:09.429695 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:09.429653    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:56:09.962560 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:09.962535    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb"
Oct 30 21:56:11.587761 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.587725    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"]
Oct 30 21:56:11.591238 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.591221    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.636248 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.636216    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2f7fac5-efa4-4b44-a61c-a707942ed520-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.636248 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.636257    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7fll\" (UniqueName: \"kubernetes.io/projected/f2f7fac5-efa4-4b44-a61c-a707942ed520-kube-api-access-p7fll\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.636513 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.636376    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2f7fac5-efa4-4b44-a61c-a707942ed520-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.636513 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.636428    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2f7fac5-efa4-4b44-a61c-a707942ed520-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.636620 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.636516    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2f7fac5-efa4-4b44-a61c-a707942ed520-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.636660 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.636635    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2f7fac5-efa4-4b44-a61c-a707942ed520-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.692947 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.692910    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Oct 30 21:56:11.694339 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.694316    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"]
Oct 30 21:56:11.737914 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.737871    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2f7fac5-efa4-4b44-a61c-a707942ed520-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.738111 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.737935    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2f7fac5-efa4-4b44-a61c-a707942ed520-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.738111 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.737959    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7fll\" (UniqueName: \"kubernetes.io/projected/f2f7fac5-efa4-4b44-a61c-a707942ed520-kube-api-access-p7fll\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.738111 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.737995    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2f7fac5-efa4-4b44-a61c-a707942ed520-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.738111 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.738028    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2f7fac5-efa4-4b44-a61c-a707942ed520-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.738111 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.738067    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2f7fac5-efa4-4b44-a61c-a707942ed520-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.738443 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.738416    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2f7fac5-efa4-4b44-a61c-a707942ed520-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.738524 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.738427    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2f7fac5-efa4-4b44-a61c-a707942ed520-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.738524 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.738505    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2f7fac5-efa4-4b44-a61c-a707942ed520-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.740385 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.740368    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2f7fac5-efa4-4b44-a61c-a707942ed520-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.740808 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.740786    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2f7fac5-efa4-4b44-a61c-a707942ed520-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.789844 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.789802    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:11.799050 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.799019    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7fll\" (UniqueName: \"kubernetes.io/projected/f2f7fac5-efa4-4b44-a61c-a707942ed520-kube-api-access-p7fll\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-dlqgz\" (UID: \"f2f7fac5-efa4-4b44-a61c-a707942ed520\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:11.909795 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:11.909760    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:12.301303 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:12.301230    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"]
Oct 30 21:56:12.304630 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:56:12.304600    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2f7fac5_efa4_4b44_a61c_a707942ed520.slice/crio-35b2d6d2f72e73cf962a55e7925e25377e0f33693bff80e9fa404459d702e569 WatchSource:0}: Error finding container 35b2d6d2f72e73cf962a55e7925e25377e0f33693bff80e9fa404459d702e569: Status 404 returned error can't find the container with id 35b2d6d2f72e73cf962a55e7925e25377e0f33693bff80e9fa404459d702e569
Oct 30 21:56:12.966202 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:12.966173    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz" event={"ID":"f2f7fac5-efa4-4b44-a61c-a707942ed520","Type":"ContainerStarted","Data":"513f4cce8925b3f74dc739a14527c31e02c2368c7d1465f9ff3c8118b73f49df"}
Oct 30 21:56:12.966479 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:12.966224    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz" event={"ID":"f2f7fac5-efa4-4b44-a61c-a707942ed520","Type":"ContainerStarted","Data":"35b2d6d2f72e73cf962a55e7925e25377e0f33693bff80e9fa404459d702e569"}
Oct 30 21:56:14.089122 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:14.089065    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz" podStartSLOduration=2.49336192 podStartE2EDuration="3.089046428s" totalImagesPullingTime="595.684508ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:56:14.08851994 +0000 UTC m=+712.137127635" watchObservedRunningTime="2026-10-30 21:56:14.089046428 +0000 UTC m=+712.137654123"
Oct 30 21:56:14.426984 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:14.426954    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:14.439092 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:14.439061    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:14.910898 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:14.910871    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:14.986642 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:14.986611    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd"
Oct 30 21:56:16.238450 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:16.238417    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:18.583357 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:18.583315    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:21.193711 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.193651    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"]
Oct 30 21:56:21.197255 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.197229    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.298338 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.298309    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Oct 30 21:56:21.299905 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.299879    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"]
Oct 30 21:56:21.324234 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.324208    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/028c3206-7879-46be-a78b-5e5b1ad9086f-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.324368 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.324257    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/028c3206-7879-46be-a78b-5e5b1ad9086f-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.324406 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.324383    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/028c3206-7879-46be-a78b-5e5b1ad9086f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.324448 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.324433    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/028c3206-7879-46be-a78b-5e5b1ad9086f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.324482 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.324468    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/028c3206-7879-46be-a78b-5e5b1ad9086f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.324565 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.324547    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6c9n\" (UniqueName: \"kubernetes.io/projected/028c3206-7879-46be-a78b-5e5b1ad9086f-kube-api-access-w6c9n\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.426011 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.425952    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/028c3206-7879-46be-a78b-5e5b1ad9086f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.426209 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.426030    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/028c3206-7879-46be-a78b-5e5b1ad9086f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.426209 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.426070    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/028c3206-7879-46be-a78b-5e5b1ad9086f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.426209 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.426102    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6c9n\" (UniqueName: \"kubernetes.io/projected/028c3206-7879-46be-a78b-5e5b1ad9086f-kube-api-access-w6c9n\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.426209 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.426169    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/028c3206-7879-46be-a78b-5e5b1ad9086f-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.426426 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.426229    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/028c3206-7879-46be-a78b-5e5b1ad9086f-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.426556 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.426531    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/028c3206-7879-46be-a78b-5e5b1ad9086f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.426619 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.426601    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/028c3206-7879-46be-a78b-5e5b1ad9086f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.426706 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.426632    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/028c3206-7879-46be-a78b-5e5b1ad9086f-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.428848 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.428818    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/028c3206-7879-46be-a78b-5e5b1ad9086f-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.428981 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.428970    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/028c3206-7879-46be-a78b-5e5b1ad9086f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.432539 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.432511    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:21.486823 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.486760    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6c9n\" (UniqueName: \"kubernetes.io/projected/028c3206-7879-46be-a78b-5e5b1ad9086f-kube-api-access-w6c9n\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd\" (UID: \"028c3206-7879-46be-a78b-5e5b1ad9086f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.509824 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.509793    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:21.892097 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.892011    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"]
Oct 30 21:56:21.894846 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:56:21.894812    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod028c3206_7879_46be_a78b_5e5b1ad9086f.slice/crio-9679ae82139552b8cad93583dec0daf66a5be45f42a0a1966fd87606ff42a383 WatchSource:0}: Error finding container 9679ae82139552b8cad93583dec0daf66a5be45f42a0a1966fd87606ff42a383: Status 404 returned error can't find the container with id 9679ae82139552b8cad93583dec0daf66a5be45f42a0a1966fd87606ff42a383
Oct 30 21:56:21.910750 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.910728    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:21.923652 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:21.923633    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:22.008621 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:22.008590    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd" event={"ID":"028c3206-7879-46be-a78b-5e5b1ad9086f","Type":"ContainerStarted","Data":"9679ae82139552b8cad93583dec0daf66a5be45f42a0a1966fd87606ff42a383"}
Oct 30 21:56:22.020415 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:22.020386    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz"
Oct 30 21:56:23.015443 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:23.015408    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd" event={"ID":"028c3206-7879-46be-a78b-5e5b1ad9086f","Type":"ContainerStarted","Data":"426b32127fa9127416b3acd2a4d8927e7d75e2f211971cefe71bae2253c65fb2"}
Oct 30 21:56:23.133656 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:23.133596    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd" podStartSLOduration=1.555082616 podStartE2EDuration="2.133579016s" totalImagesPullingTime="578.4964ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:56:23.132674777 +0000 UTC m=+721.181282473" watchObservedRunningTime="2026-10-30 21:56:23.133579016 +0000 UTC m=+721.182186716"
Oct 30 21:56:23.510181 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:23.510152    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:25.673728 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:25.673695    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:26.399026 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.398996    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"]
Oct 30 21:56:26.402503 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.402486    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.454844 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.454821    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-v5mg8\""
Oct 30 21:56:26.505575 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.505553    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"]
Oct 30 21:56:26.571648 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.571621    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.571824 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.571657    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.571824 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.571709    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2595e4a7-d998-437d-b5e5-761a943f1b48-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.571824 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.571776    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtsmd\" (UniqueName: \"kubernetes.io/projected/2595e4a7-d998-437d-b5e5-761a943f1b48-kube-api-access-qtsmd\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.571931 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.571898    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.571966 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.571936    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.572006 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.571990    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.572073 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.572055    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.572153 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.572137    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.673062 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.673002    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.673062 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.673034    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.673062 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.673057    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.673309 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.673081    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.673309 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.673098    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.673309 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.673143    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2595e4a7-d998-437d-b5e5-761a943f1b48-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.673309 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.673174    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtsmd\" (UniqueName: \"kubernetes.io/projected/2595e4a7-d998-437d-b5e5-761a943f1b48-kube-api-access-qtsmd\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.673309 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.673215    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.673309 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.673243    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.673631 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.673434    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.673631 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.673492    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.673631 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.673544    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.673631 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.673623    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.674337 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.674315    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2595e4a7-d998-437d-b5e5-761a943f1b48-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.675556 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.675535    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.675739 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.675721    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.734757 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.734734    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:26.734877 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:26.734860    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtsmd\" (UniqueName: \"kubernetes.io/projected/2595e4a7-d998-437d-b5e5-761a943f1b48-kube-api-access-qtsmd\") pod \"maas-default-gateway-openshift-default-6cc458d887-b5pbc\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:27.015981 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:27.015900    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:27.493375 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:27.493352    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"]
Oct 30 21:56:27.495838 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:56:27.495812    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2595e4a7_d998_437d_b5e5_761a943f1b48.slice/crio-351d160ca5bdbece3c800f5d37d38debfe7e8a02202698e54852ae88496e9561 WatchSource:0}: Error finding container 351d160ca5bdbece3c800f5d37d38debfe7e8a02202698e54852ae88496e9561: Status 404 returned error can't find the container with id 351d160ca5bdbece3c800f5d37d38debfe7e8a02202698e54852ae88496e9561
Oct 30 21:56:28.039550 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:28.039515    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc" event={"ID":"2595e4a7-d998-437d-b5e5-761a943f1b48","Type":"ContainerStarted","Data":"351d160ca5bdbece3c800f5d37d38debfe7e8a02202698e54852ae88496e9561"}
Oct 30 21:56:31.249250 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:31.249214    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:56:31.249660 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:31.249301    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:56:31.249660 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:31.249344    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:56:31.510084 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:31.509989    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:31.522661 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:31.522638    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:32.060158 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:32.060055    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc" event={"ID":"2595e4a7-d998-437d-b5e5-761a943f1b48","Type":"ContainerStarted","Data":"34d6365e0535aca1553c4b6d800c2d954bbe106bd02cb47c693709d5f665a92a"}
Oct 30 21:56:32.076163 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:32.076137    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd"
Oct 30 21:56:32.157398 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:56:32.157366    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:56:32.182788 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:32.182740    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc" podStartSLOduration=2.432200686 podStartE2EDuration="6.182725694s" totalImagesPullingTime="3.750525008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:56:32.181179773 +0000 UTC m=+730.229787468" watchObservedRunningTime="2026-10-30 21:56:32.182725694 +0000 UTC m=+730.231333388"
Oct 30 21:56:33.017711 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:33.016932    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:33.019251 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:33.019226    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-b5pbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Oct 30 21:56:33.019383 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:33.019274    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc" podUID="2595e4a7-d998-437d-b5e5-761a943f1b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Oct 30 21:56:34.017710 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:34.016949    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-b5pbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Oct 30 21:56:34.017710 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:34.017007    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc" podUID="2595e4a7-d998-437d-b5e5-761a943f1b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Oct 30 21:56:35.018047 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:35.017985    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-b5pbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Oct 30 21:56:35.018434 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:35.018065    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc" podUID="2595e4a7-d998-437d-b5e5-761a943f1b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Oct 30 21:56:36.016780 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:36.016314    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-b5pbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Oct 30 21:56:36.016780 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:36.016391    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc" podUID="2595e4a7-d998-437d-b5e5-761a943f1b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Oct 30 21:56:37.017724 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:37.016965    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-b5pbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Oct 30 21:56:37.017724 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:37.017025    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc" podUID="2595e4a7-d998-437d-b5e5-761a943f1b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Oct 30 21:56:38.016403 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:38.016365    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-b5pbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Oct 30 21:56:38.016578 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:38.016426    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc" podUID="2595e4a7-d998-437d-b5e5-761a943f1b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Oct 30 21:56:39.401875 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:39.401842    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:39.402410 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:39.402236    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:39.403106 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:39.403078    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 21:56:41.545334 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.545304    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"]
Oct 30 21:56:41.551079 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.551054    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.619534 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.619508    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52eecdf8-4440-473e-8281-bc1f46457178-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.619648 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.619559    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.619648 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.619632    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.619749 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.619663    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.619749 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.619727    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52eecdf8-4440-473e-8281-bc1f46457178-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.619749 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.619744    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhz29\" (UniqueName: \"kubernetes.io/projected/52eecdf8-4440-473e-8281-bc1f46457178-kube-api-access-zhz29\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.619842 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.619762    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.619842 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.619803    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.619903 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.619890    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52eecdf8-4440-473e-8281-bc1f46457178-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.643833 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.643805    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"]
Oct 30 21:56:41.721139 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.721114    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52eecdf8-4440-473e-8281-bc1f46457178-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.721281 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.721143    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhz29\" (UniqueName: \"kubernetes.io/projected/52eecdf8-4440-473e-8281-bc1f46457178-kube-api-access-zhz29\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.721281 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.721161    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.721281 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.721179    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.721281 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.721227    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52eecdf8-4440-473e-8281-bc1f46457178-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.721558 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.721355    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52eecdf8-4440-473e-8281-bc1f46457178-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.721558 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.721439    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.721558 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.721456    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.721558 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.721493    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.721795 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.721586    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.721795 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.721717    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.721871 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.721820    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.721915 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.721898    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.721956 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.721943    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52eecdf8-4440-473e-8281-bc1f46457178-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.723906 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.723877    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.724233 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.724210    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52eecdf8-4440-473e-8281-bc1f46457178-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.781835 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.781808    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52eecdf8-4440-473e-8281-bc1f46457178-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.781947 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.781928    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhz29\" (UniqueName: \"kubernetes.io/projected/52eecdf8-4440-473e-8281-bc1f46457178-kube-api-access-zhz29\") pod \"maas-default-gateway-openshift-default-6cc458d887-4s5w7\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:41.864128 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:41.864058    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:42.289825 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:42.289786    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"]
Oct 30 21:56:42.292709 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:56:42.292656    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52eecdf8_4440_473e_8281_bc1f46457178.slice/crio-c2c584012a37dcf174906d7b16a43a644ef523fd14767e243579194244ffbc3a WatchSource:0}: Error finding container c2c584012a37dcf174906d7b16a43a644ef523fd14767e243579194244ffbc3a: Status 404 returned error can't find the container with id c2c584012a37dcf174906d7b16a43a644ef523fd14767e243579194244ffbc3a
Oct 30 21:56:42.295651 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:42.295619    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:56:42.295775 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:42.295727    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:56:42.295846 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:42.295775    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:56:43.122531 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:43.122483    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7" event={"ID":"52eecdf8-4440-473e-8281-bc1f46457178","Type":"ContainerStarted","Data":"fda5dac92e3a1483083b557c2594651a0d2b022e5e89858319e97bf762ceef3c"}
Oct 30 21:56:43.122531 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:43.122534    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7" event={"ID":"52eecdf8-4440-473e-8281-bc1f46457178","Type":"ContainerStarted","Data":"c2c584012a37dcf174906d7b16a43a644ef523fd14767e243579194244ffbc3a"}
Oct 30 21:56:43.292308 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:43.292253    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7" podStartSLOduration=2.292240289 podStartE2EDuration="2.292240289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:56:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:56:43.290953185 +0000 UTC m=+741.339560879" watchObservedRunningTime="2026-10-30 21:56:43.292240289 +0000 UTC m=+741.340847984"
Oct 30 21:56:43.864987 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:43.864946    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:43.866345 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:43.866318    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4s5w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Oct 30 21:56:43.866486 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:43.866375    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7" podUID="52eecdf8-4440-473e-8281-bc1f46457178" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Oct 30 21:56:44.864752 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:44.864715    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4s5w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Oct 30 21:56:44.865131 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:44.864782    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7" podUID="52eecdf8-4440-473e-8281-bc1f46457178" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Oct 30 21:56:45.864828 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:45.864789    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4s5w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Oct 30 21:56:45.865226 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:45.864841    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7" podUID="52eecdf8-4440-473e-8281-bc1f46457178" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Oct 30 21:56:46.865177 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:46.865144    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4s5w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Oct 30 21:56:46.865541 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:46.865195    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7" podUID="52eecdf8-4440-473e-8281-bc1f46457178" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Oct 30 21:56:47.864549 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:47.864512    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4s5w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Oct 30 21:56:47.864760 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:47.864575    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7" podUID="52eecdf8-4440-473e-8281-bc1f46457178" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Oct 30 21:56:48.864918 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:48.864883    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4s5w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Oct 30 21:56:48.865388 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:48.864946    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7" podUID="52eecdf8-4440-473e-8281-bc1f46457178" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Oct 30 21:56:50.502621 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:50.502587    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:50.503084 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:50.502987    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:50.503785 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:50.503766    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 21:56:52.572449 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:52.572418    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67477bcb55-qcgwz"]
Oct 30 21:56:52.577121 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:52.577103    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67477bcb55-qcgwz"
Oct 30 21:56:52.620435 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:52.620410    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hm22\" (UniqueName: \"kubernetes.io/projected/564fcd76-e252-410f-b88c-db8e1370d2f0-kube-api-access-5hm22\") pod \"authorino-67477bcb55-qcgwz\" (UID: \"564fcd76-e252-410f-b88c-db8e1370d2f0\") " pod="kuadrant-system/authorino-67477bcb55-qcgwz"
Oct 30 21:56:52.620524 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:52.620447    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/564fcd76-e252-410f-b88c-db8e1370d2f0-tls-cert\") pod \"authorino-67477bcb55-qcgwz\" (UID: \"564fcd76-e252-410f-b88c-db8e1370d2f0\") " pod="kuadrant-system/authorino-67477bcb55-qcgwz"
Oct 30 21:56:52.633078 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:52.633058    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67477bcb55-qcgwz"]
Oct 30 21:56:52.721511 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:52.721480    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hm22\" (UniqueName: \"kubernetes.io/projected/564fcd76-e252-410f-b88c-db8e1370d2f0-kube-api-access-5hm22\") pod \"authorino-67477bcb55-qcgwz\" (UID: \"564fcd76-e252-410f-b88c-db8e1370d2f0\") " pod="kuadrant-system/authorino-67477bcb55-qcgwz"
Oct 30 21:56:52.721628 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:52.721522    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/564fcd76-e252-410f-b88c-db8e1370d2f0-tls-cert\") pod \"authorino-67477bcb55-qcgwz\" (UID: \"564fcd76-e252-410f-b88c-db8e1370d2f0\") " pod="kuadrant-system/authorino-67477bcb55-qcgwz"
Oct 30 21:56:52.723989 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:52.723971    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/564fcd76-e252-410f-b88c-db8e1370d2f0-tls-cert\") pod \"authorino-67477bcb55-qcgwz\" (UID: \"564fcd76-e252-410f-b88c-db8e1370d2f0\") " pod="kuadrant-system/authorino-67477bcb55-qcgwz"
Oct 30 21:56:52.789620 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:52.789591    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hm22\" (UniqueName: \"kubernetes.io/projected/564fcd76-e252-410f-b88c-db8e1370d2f0-kube-api-access-5hm22\") pod \"authorino-67477bcb55-qcgwz\" (UID: \"564fcd76-e252-410f-b88c-db8e1370d2f0\") " pod="kuadrant-system/authorino-67477bcb55-qcgwz"
Oct 30 21:56:52.883671 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:52.883602    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:52.888427 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:52.888409    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67477bcb55-qcgwz"
Oct 30 21:56:53.200740 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:53.200705    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:53.260386 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:53.260363    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67477bcb55-qcgwz"]
Oct 30 21:56:53.263298 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:56:53.263269    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod564fcd76_e252_410f_b88c_db8e1370d2f0.slice/crio-582f2b970173210aed10514add50e1e7253543ac6ab3fd5bd95c12b069418e2d WatchSource:0}: Error finding container 582f2b970173210aed10514add50e1e7253543ac6ab3fd5bd95c12b069418e2d: Status 404 returned error can't find the container with id 582f2b970173210aed10514add50e1e7253543ac6ab3fd5bd95c12b069418e2d
Oct 30 21:56:54.169694 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:54.169647    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67477bcb55-qcgwz" event={"ID":"564fcd76-e252-410f-b88c-db8e1370d2f0","Type":"ContainerStarted","Data":"582f2b970173210aed10514add50e1e7253543ac6ab3fd5bd95c12b069418e2d"}
Oct 30 21:56:55.176169 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:55.176136    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67477bcb55-qcgwz" event={"ID":"564fcd76-e252-410f-b88c-db8e1370d2f0","Type":"ContainerStarted","Data":"6c3fb2da8f4a6eb75a8f9ba13b22d59e0114f90b11ea9d5fc188dbb52e672231"}
Oct 30 21:56:55.291434 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:55.291390    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-67477bcb55-qcgwz" podStartSLOduration=1.741780353 podStartE2EDuration="3.291377543s" totalImagesPullingTime="1.54959719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:56:55.289596031 +0000 UTC m=+753.338203726" watchObservedRunningTime="2026-10-30 21:56:55.291377543 +0000 UTC m=+753.339985245"
Oct 30 21:56:55.341693 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:55.341649    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6845bc4bd4-5vkn6"]
Oct 30 21:56:55.341918 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:55.341894    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6845bc4bd4-5vkn6" podUID="4b9985b8-c336-411b-b7a0-07315f5662a4" containerName="authorino" containerID="cri-o://dd6bf17776c26304f6d5c8995d4bd4b2bb5fb3ed0af057b8c4bcfec34af24b3e" gracePeriod=30
Oct 30 21:56:55.590922 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:55.590898    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6845bc4bd4-5vkn6"
Oct 30 21:56:55.649622 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:55.649585    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b9985b8-c336-411b-b7a0-07315f5662a4-kube-api-access-7ckgx\" (UniqueName: \"kubernetes.io/projected/4b9985b8-c336-411b-b7a0-07315f5662a4-kube-api-access-7ckgx\") pod \"4b9985b8-c336-411b-b7a0-07315f5662a4\" (UID: \"4b9985b8-c336-411b-b7a0-07315f5662a4\") "
Oct 30 21:56:55.649837 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:55.649646    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4b9985b8-c336-411b-b7a0-07315f5662a4-tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9985b8-c336-411b-b7a0-07315f5662a4-tls-cert\") pod \"4b9985b8-c336-411b-b7a0-07315f5662a4\" (UID: \"4b9985b8-c336-411b-b7a0-07315f5662a4\") "
Oct 30 21:56:55.659355 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:55.659308    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9985b8-c336-411b-b7a0-07315f5662a4-kube-api-access-7ckgx" pod "4b9985b8-c336-411b-b7a0-07315f5662a4" (UID: "4b9985b8-c336-411b-b7a0-07315f5662a4"). InnerVolumeSpecName "kube-api-access-7ckgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:56:55.666975 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:55.666945    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b9985b8-c336-411b-b7a0-07315f5662a4-tls-cert" pod "4b9985b8-c336-411b-b7a0-07315f5662a4" (UID: "4b9985b8-c336-411b-b7a0-07315f5662a4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:56:55.753480 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:55.753396    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ckgx\" (UniqueName: \"kubernetes.io/projected/4b9985b8-c336-411b-b7a0-07315f5662a4-kube-api-access-7ckgx\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:55.753480 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:55.753430    4918 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4b9985b8-c336-411b-b7a0-07315f5662a4-tls-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:56.181725 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:56.181672    4918 generic.go:356] "Generic (PLEG): container finished" podID="4b9985b8-c336-411b-b7a0-07315f5662a4" containerID="dd6bf17776c26304f6d5c8995d4bd4b2bb5fb3ed0af057b8c4bcfec34af24b3e" exitCode=0
Oct 30 21:56:56.182119 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:56.181747    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6845bc4bd4-5vkn6"
Oct 30 21:56:56.182119 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:56.181753    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6845bc4bd4-5vkn6" event={"ID":"4b9985b8-c336-411b-b7a0-07315f5662a4","Type":"ContainerDied","Data":"dd6bf17776c26304f6d5c8995d4bd4b2bb5fb3ed0af057b8c4bcfec34af24b3e"}
Oct 30 21:56:56.182119 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:56.181802    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6845bc4bd4-5vkn6" event={"ID":"4b9985b8-c336-411b-b7a0-07315f5662a4","Type":"ContainerDied","Data":"a166789e7dcb202752605a2f24ea85f5e2544471999fba8db73385bd676d0073"}
Oct 30 21:56:56.182119 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:56.181825    4918 scope.go:122] "RemoveContainer" containerID="dd6bf17776c26304f6d5c8995d4bd4b2bb5fb3ed0af057b8c4bcfec34af24b3e"
Oct 30 21:56:56.190760 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:56.190744    4918 scope.go:122] "RemoveContainer" containerID="dd6bf17776c26304f6d5c8995d4bd4b2bb5fb3ed0af057b8c4bcfec34af24b3e"
Oct 30 21:56:56.191039 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:56:56.191021    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd6bf17776c26304f6d5c8995d4bd4b2bb5fb3ed0af057b8c4bcfec34af24b3e\": container with ID starting with dd6bf17776c26304f6d5c8995d4bd4b2bb5fb3ed0af057b8c4bcfec34af24b3e not found: ID does not exist" containerID="dd6bf17776c26304f6d5c8995d4bd4b2bb5fb3ed0af057b8c4bcfec34af24b3e"
Oct 30 21:56:56.191117 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:56.191047    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd6bf17776c26304f6d5c8995d4bd4b2bb5fb3ed0af057b8c4bcfec34af24b3e"} err="failed to get container status \"dd6bf17776c26304f6d5c8995d4bd4b2bb5fb3ed0af057b8c4bcfec34af24b3e\": rpc error: code = NotFound desc = could not find container \"dd6bf17776c26304f6d5c8995d4bd4b2bb5fb3ed0af057b8c4bcfec34af24b3e\": container with ID starting with dd6bf17776c26304f6d5c8995d4bd4b2bb5fb3ed0af057b8c4bcfec34af24b3e not found: ID does not exist"
Oct 30 21:56:56.346230 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:56.346149    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6845bc4bd4-5vkn6"]
Oct 30 21:56:56.351989 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:56.351962    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6845bc4bd4-5vkn6"]
Oct 30 21:56:58.073037 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:56:58.073005    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4b9985b8-c336-411b-b7a0-07315f5662a4" path="/var/lib/kubelet/pods/4b9985b8-c336-411b-b7a0-07315f5662a4/volumes"
Oct 30 21:57:00.132115 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:00.132077    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:00.398383 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:00.398338    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:02.167216 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:57:02.167177    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:57:04.412156 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:04.412122    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:04.782568 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:04.782471    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:16.585700 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:16.585642    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:26.894033 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:26.893989    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"]
Oct 30 21:57:26.894566 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:26.894546    4918 cpu_manager.go:414] "containerMap: removing container" podUID="4b9985b8-c336-411b-b7a0-07315f5662a4" containerName="authorino"
Oct 30 21:57:26.894648 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:26.894569    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4b9985b8-c336-411b-b7a0-07315f5662a4" containerName="authorino"
Oct 30 21:57:26.894725 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:26.894707    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="4b9985b8-c336-411b-b7a0-07315f5662a4" containerName="authorino"
Oct 30 21:57:26.899065 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:26.899045    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:26.934140 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:26.934114    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:26.934247 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:26.934148    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8432ea7a-2ead-4570-b028-260fb1361662-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:26.934247 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:26.934175    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ns29\" (UniqueName: \"kubernetes.io/projected/8432ea7a-2ead-4570-b028-260fb1361662-kube-api-access-7ns29\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:26.934329 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:26.934250    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:26.934329 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:26.934278    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:26.934406 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:26.934334    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:26.934406 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:26.934362    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:26.934406 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:26.934389    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8432ea7a-2ead-4570-b028-260fb1361662-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:26.934511 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:26.934458    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8432ea7a-2ead-4570-b028-260fb1361662-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.035606 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.035576    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8432ea7a-2ead-4570-b028-260fb1361662-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.035755 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.035632    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8432ea7a-2ead-4570-b028-260fb1361662-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.035755 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.035662    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.035755 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.035709    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8432ea7a-2ead-4570-b028-260fb1361662-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.035755 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.035737    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ns29\" (UniqueName: \"kubernetes.io/projected/8432ea7a-2ead-4570-b028-260fb1361662-kube-api-access-7ns29\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.035950 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.035755    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.035950 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.035779    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.035950 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.035835    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.035950 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.035872    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.036214 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.036187    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.036288 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.036258    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.036346 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.036333    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.036492 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.036465    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.036557 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.036543    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8432ea7a-2ead-4570-b028-260fb1361662-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.038334 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.038313    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8432ea7a-2ead-4570-b028-260fb1361662-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.038466 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.038316    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.097224 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.097194    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8432ea7a-2ead-4570-b028-260fb1361662-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.097512 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.097489    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ns29\" (UniqueName: \"kubernetes.io/projected/8432ea7a-2ead-4570-b028-260fb1361662-kube-api-access-7ns29\") pod \"maas-default-gateway-openshift-default-6cc458d887-qclln\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.103148 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.103126    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"]
Oct 30 21:57:27.210851 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.210776    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:27.639033 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.639009    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"]
Oct 30 21:57:27.641540 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:57:27.641510    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8432ea7a_2ead_4570_b028_260fb1361662.slice/crio-3ae12826af4a4d01f74bafb9b1ab2835c3a828a66379c3e3716f70979896098e WatchSource:0}: Error finding container 3ae12826af4a4d01f74bafb9b1ab2835c3a828a66379c3e3716f70979896098e: Status 404 returned error can't find the container with id 3ae12826af4a4d01f74bafb9b1ab2835c3a828a66379c3e3716f70979896098e
Oct 30 21:57:27.643749 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.643667    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:57:27.643837 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.643785    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:57:27.643837 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:27.643817    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:57:28.331571 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:28.331536    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln" event={"ID":"8432ea7a-2ead-4570-b028-260fb1361662","Type":"ContainerStarted","Data":"3aa45f72ef0c80eb7ea2e1438d1ea4b8d13ffbde6be958484cda4e06fedea0e1"}
Oct 30 21:57:28.332066 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:28.331589    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln" event={"ID":"8432ea7a-2ead-4570-b028-260fb1361662","Type":"ContainerStarted","Data":"3ae12826af4a4d01f74bafb9b1ab2835c3a828a66379c3e3716f70979896098e"}
Oct 30 21:57:28.564013 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:28.563960    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln" podStartSLOduration=2.563946414 podStartE2EDuration="2.563946414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:57:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:57:28.514222463 +0000 UTC m=+786.562830159" watchObservedRunningTime="2026-10-30 21:57:28.563946414 +0000 UTC m=+786.612554109"
Oct 30 21:57:29.216988 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:29.216956    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:29.219275 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:29.219250    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-qclln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Oct 30 21:57:29.219414 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:29.219328    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln" podUID="8432ea7a-2ead-4570-b028-260fb1361662" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Oct 30 21:57:30.212139 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:30.212104    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-qclln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Oct 30 21:57:30.212758 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:30.212716    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln" podUID="8432ea7a-2ead-4570-b028-260fb1361662" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Oct 30 21:57:31.215705 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:31.215030    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-qclln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Oct 30 21:57:31.215705 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:31.215097    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln" podUID="8432ea7a-2ead-4570-b028-260fb1361662" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Oct 30 21:57:32.156459 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:57:32.156422    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:57:32.215716 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:32.215065    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-qclln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Oct 30 21:57:32.215716 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:32.215135    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln" podUID="8432ea7a-2ead-4570-b028-260fb1361662" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Oct 30 21:57:33.212042 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:33.212002    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-qclln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Oct 30 21:57:33.212339 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:33.212311    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln" podUID="8432ea7a-2ead-4570-b028-260fb1361662" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Oct 30 21:57:33.236669 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:33.236639    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:33.697828 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:33.697792    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:34.211297 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:34.211271    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-qclln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Oct 30 21:57:34.211446 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:34.211342    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln" podUID="8432ea7a-2ead-4570-b028-260fb1361662" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Oct 30 21:57:35.339810 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:35.339777    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:35.611288 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:35.611206    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:35.837485 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:35.837455    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:35.837841 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:35.837808    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:35.838795 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:35.838775    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 21:57:47.085638 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:47.085600    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:47.424990 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:57:47.424956    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:02.157988 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:58:02.157943    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:58:16.934093 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:16.934056    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:18.499477 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:18.499443    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:25.428148 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:25.428114    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:25.699157 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:25.699077    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:25.920352 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:25.920316    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"]
Oct 30 21:58:25.924069 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:25.924052    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:25.965831 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:25.965430    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:25.965831 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:25.965478    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:25.965831 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:25.965512    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:25.965831 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:25.965543    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98ndk\" (UniqueName: \"kubernetes.io/projected/6ab4caf4-843c-46ef-a936-a8eb42f5053f-kube-api-access-98ndk\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:25.965831 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:25.965566    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:25.965831 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:25.965587    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:25.965831 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:25.965605    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:25.965831 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:25.965623    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:25.965831 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:25.965646    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:25.976650 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:25.976623    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-cef074-openshift-default-dockercfg-vkbnc\""
Oct 30 21:58:26.036798 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.036772    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"]
Oct 30 21:58:26.067059 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.067033    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.067193 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.067065    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.067193 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.067094    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.067193 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.067131    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98ndk\" (UniqueName: \"kubernetes.io/projected/6ab4caf4-843c-46ef-a936-a8eb42f5053f-kube-api-access-98ndk\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.067386 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.067331    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.067535 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.067510    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.067614 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.067585    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.067702 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.067622    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.067702 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.067649    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.067981 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.067718    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.068116 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.068047    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.068309 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.068289    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.068410 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.068363    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.068410 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.068387    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.069787 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.069764    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.069896 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.069819    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.120507 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.120478    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:26.127722 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.127674    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98ndk\" (UniqueName: \"kubernetes.io/projected/6ab4caf4-843c-46ef-a936-a8eb42f5053f-kube-api-access-98ndk\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.127803 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.127783    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-c2wkq\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.260539 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.260479    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:26.382054 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.382009    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:26.543751 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.541733    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"]
Oct 30 21:58:26.547020 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.546990    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.599129 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.599105    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-7df73b-openshift-default-dockercfg-r7qb2\""
Oct 30 21:58:26.619838 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.619808    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"]
Oct 30 21:58:26.622823 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.622800    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:26.673579 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.673555    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.673744 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.673596    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.673744 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.673730    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.673856 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.673812    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.673856 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.673843    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.673937 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.673873    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.674009 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.673975    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmckh\" (UniqueName: \"kubernetes.io/projected/1fec41f1-9d5d-410f-99ac-299ee5385f24-kube-api-access-tmckh\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.674046 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.674028    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fec41f1-9d5d-410f-99ac-299ee5385f24-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.674114 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.674095    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.714073 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.714045    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"]
Oct 30 21:58:26.717155 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:58:26.717120    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab4caf4_843c_46ef_a936_a8eb42f5053f.slice/crio-4bdf4e7426498a29dd962dd1178265746f6f17b064e39ecd5e53e92976af6618 WatchSource:0}: Error finding container 4bdf4e7426498a29dd962dd1178265746f6f17b064e39ecd5e53e92976af6618: Status 404 returned error can't find the container with id 4bdf4e7426498a29dd962dd1178265746f6f17b064e39ecd5e53e92976af6618
Oct 30 21:58:26.719341 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.719309    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:58:26.719396 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.719373    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:58:26.719450 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.719409    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:58:26.778629 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.778356    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.778629 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.778415    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.778629 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.778443    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.778629 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.778490    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.778998 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.778552    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.778998 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.778749    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.778998 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.778950    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.779167 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.779008    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmckh\" (UniqueName: \"kubernetes.io/projected/1fec41f1-9d5d-410f-99ac-299ee5385f24-kube-api-access-tmckh\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.779167 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.779049    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fec41f1-9d5d-410f-99ac-299ee5385f24-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.785734 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.779937    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fec41f1-9d5d-410f-99ac-299ee5385f24-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.785734 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.780337    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.785734 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.780580    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.785734 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.780856    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.785734 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.782910    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.785734 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.784479    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.785734 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.785480    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.843543 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.843469    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.853268 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.853240    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmckh\" (UniqueName: \"kubernetes.io/projected/1fec41f1-9d5d-410f-99ac-299ee5385f24-kube-api-access-tmckh\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.862125 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.862098    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:26.874104 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:26.874079    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:27.188293 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.188258    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:27.235122 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.235097    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"]
Oct 30 21:58:27.239625 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.239607    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.284012 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.283986    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.284145 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.284035    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0856582a-2e5e-4d49-9f58-9cf10c008b41-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.284145 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.284054    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.284234 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.284214    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.284287 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.284269    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.284350 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.284331    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.284382 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.284365    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2srr\" (UniqueName: \"kubernetes.io/projected/0856582a-2e5e-4d49-9f58-9cf10c008b41-kube-api-access-c2srr\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.284417 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.284397    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.284535 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.284515    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.291649 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.291626    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-536975-openshift-default-dockercfg-xkvs2\""
Oct 30 21:58:27.300129 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.300103    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"]
Oct 30 21:58:27.302858 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.302834    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"]
Oct 30 21:58:27.306379 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:58:27.306350    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fec41f1_9d5d_410f_99ac_299ee5385f24.slice/crio-248c1831079ef563b76d5552fac08bfd4f5408afa12dcb0f41cbf3f76c17ea85 WatchSource:0}: Error finding container 248c1831079ef563b76d5552fac08bfd4f5408afa12dcb0f41cbf3f76c17ea85: Status 404 returned error can't find the container with id 248c1831079ef563b76d5552fac08bfd4f5408afa12dcb0f41cbf3f76c17ea85
Oct 30 21:58:27.309056 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.309027    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:58:27.309155 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.309084    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:58:27.309155 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.309124    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:58:27.385586 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.385549    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.385756 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.385636    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.385756 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.385713    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0856582a-2e5e-4d49-9f58-9cf10c008b41-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.385756 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.385740    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.385931 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.385787    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.385931 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.385825    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.385931 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.385861    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.385931 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.385895    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2srr\" (UniqueName: \"kubernetes.io/projected/0856582a-2e5e-4d49-9f58-9cf10c008b41-kube-api-access-c2srr\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.403300 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.400025    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.403300 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.400288    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.403300 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.400495    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.403300 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.401296    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0856582a-2e5e-4d49-9f58-9cf10c008b41-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.403300 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.403161    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.403722 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.385941    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.407561 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.404250    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.417433 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.417407    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.445565 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.445492    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:27.465611 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.465578    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.465746 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.465665    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2srr\" (UniqueName: \"kubernetes.io/projected/0856582a-2e5e-4d49-9f58-9cf10c008b41-kube-api-access-c2srr\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.552692 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.552650    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:27.562259 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.562235    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"]
Oct 30 21:58:27.566606 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.566587    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.623154 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.623124    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-b9fbe2-openshift-default-dockercfg-jrtfd\""
Oct 30 21:58:27.631989 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.631932    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"]
Oct 30 21:58:27.639395 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.639353    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq" event={"ID":"6ab4caf4-843c-46ef-a936-a8eb42f5053f","Type":"ContainerStarted","Data":"3584487eac3a3cf7cf6cce69e8cfa0aabba580f1b22fec974e403392924bb5dc"}
Oct 30 21:58:27.639521 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.639424    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq" event={"ID":"6ab4caf4-843c-46ef-a936-a8eb42f5053f","Type":"ContainerStarted","Data":"4bdf4e7426498a29dd962dd1178265746f6f17b064e39ecd5e53e92976af6618"}
Oct 30 21:58:27.641365 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.641341    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj" event={"ID":"1fec41f1-9d5d-410f-99ac-299ee5385f24","Type":"ContainerStarted","Data":"30e6c194511c42eb8fd8b901434e3be4167a434910d2286340c95391de26d453"}
Oct 30 21:58:27.641472 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.641393    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj" event={"ID":"1fec41f1-9d5d-410f-99ac-299ee5385f24","Type":"ContainerStarted","Data":"248c1831079ef563b76d5552fac08bfd4f5408afa12dcb0f41cbf3f76c17ea85"}
Oct 30 21:58:27.722775 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.719595    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-podinfo\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.722775 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.719803    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-workload-certs\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.722775 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.719958    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-data\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.722775 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.720074    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-envoy\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.722775 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.720110    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4vhz\" (UniqueName: \"kubernetes.io/projected/fa1a78dc-c5da-469a-af25-77d846ba4e92-kube-api-access-n4vhz\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.722775 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.720141    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-credential-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.722775 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.720232    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-token\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.722775 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.720265    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-workload-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.722775 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.720321    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa1a78dc-c5da-469a-af25-77d846ba4e92-istiod-ca-cert\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.788108 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.788072    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:27.812990 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.812945    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj" podStartSLOduration=1.812929588 podStartE2EDuration="1.812929588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:27.811167731 +0000 UTC m=+845.859775436" watchObservedRunningTime="2026-10-30 21:58:27.812929588 +0000 UTC m=+845.861537283"
Oct 30 21:58:27.821479 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.821373    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-data\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.821479 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.821420    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-envoy\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.821479 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.821452    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4vhz\" (UniqueName: \"kubernetes.io/projected/fa1a78dc-c5da-469a-af25-77d846ba4e92-kube-api-access-n4vhz\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.821764 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.821484    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-credential-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.821764 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.821514    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-token\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.821764 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.821545    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-workload-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.821764 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.821592    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa1a78dc-c5da-469a-af25-77d846ba4e92-istiod-ca-cert\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.821764 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.821660    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-podinfo\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.822026 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.821780    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-workload-certs\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.822026 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.821880    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-data\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.822026 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.821913    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-credential-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.822364 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.822341    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-workload-certs\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.822872 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.822821    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-workload-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.822965 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.822865    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa1a78dc-c5da-469a-af25-77d846ba4e92-istiod-ca-cert\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.824143 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.824122    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-envoy\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.824749 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.824728    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-podinfo\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.862461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.862438    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:27.884345 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.884317    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-token\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.884454 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.884436    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4vhz\" (UniqueName: \"kubernetes.io/projected/fa1a78dc-c5da-469a-af25-77d846ba4e92-kube-api-access-n4vhz\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:27.951095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.950958    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq" podStartSLOduration=2.950933244 podStartE2EDuration="2.950933244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:27.938433447 +0000 UTC m=+845.987041149" watchObservedRunningTime="2026-10-30 21:58:27.950933244 +0000 UTC m=+845.999540939"
Oct 30 21:58:27.951308 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.951228    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"]
Oct 30 21:58:27.954637 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:58:27.954609    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0856582a_2e5e_4d49_9f58_9cf10c008b41.slice/crio-5c0399bbc353349a4168f368a8782924f19bce32a57c8658e48326b3ec65e88a WatchSource:0}: Error finding container 5c0399bbc353349a4168f368a8782924f19bce32a57c8658e48326b3ec65e88a: Status 404 returned error can't find the container with id 5c0399bbc353349a4168f368a8782924f19bce32a57c8658e48326b3ec65e88a
Oct 30 21:58:27.959446 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.958431    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:58:27.959446 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.958518    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:58:27.959446 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:27.958558    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:58:28.058319 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:28.058288    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:28.181186 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:28.181152    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:28.261785 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:28.261668    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:28.270723 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:28.270026    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:28.587462 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:28.587431    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"]
Oct 30 21:58:28.590134 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:58:28.590104    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa1a78dc_c5da_469a_af25_77d846ba4e92.slice/crio-8d547dfdff6a049a4ca5a2d05e525ddafc552992755803fb2b3ea34486f7a27e WatchSource:0}: Error finding container 8d547dfdff6a049a4ca5a2d05e525ddafc552992755803fb2b3ea34486f7a27e: Status 404 returned error can't find the container with id 8d547dfdff6a049a4ca5a2d05e525ddafc552992755803fb2b3ea34486f7a27e
Oct 30 21:58:28.592453 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:28.592421    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:58:28.592534 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:28.592484    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:58:28.592534 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:28.592510    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:58:28.647293 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:28.647265    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2" event={"ID":"fa1a78dc-c5da-469a-af25-77d846ba4e92","Type":"ContainerStarted","Data":"8d547dfdff6a049a4ca5a2d05e525ddafc552992755803fb2b3ea34486f7a27e"}
Oct 30 21:58:28.648855 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:28.648823    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng" event={"ID":"0856582a-2e5e-4d49-9f58-9cf10c008b41","Type":"ContainerStarted","Data":"939f6a3775ea4112441e303cbbc1fb49f801887af07eb4ba3da9e8ec6bac83f0"}
Oct 30 21:58:28.648957 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:28.648879    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng" event={"ID":"0856582a-2e5e-4d49-9f58-9cf10c008b41","Type":"ContainerStarted","Data":"5c0399bbc353349a4168f368a8782924f19bce32a57c8658e48326b3ec65e88a"}
Oct 30 21:58:28.649368 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:28.649340    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:28.649885 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:28.649868    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:58:28.772640 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:28.772588    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng" podStartSLOduration=1.772572024 podStartE2EDuration="1.772572024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:28.770336924 +0000 UTC m=+846.818944618" watchObservedRunningTime="2026-10-30 21:58:28.772572024 +0000 UTC m=+846.821179718"
Oct 30 21:58:28.867345 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:28.867268    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:29.553287 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:29.553258    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:29.558079 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:29.558053    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:29.655391 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:29.655351    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2" event={"ID":"fa1a78dc-c5da-469a-af25-77d846ba4e92","Type":"ContainerStarted","Data":"e1d6dc8bbd0c1f592c7245742a97890fd5ba047dc9555ced13446994ed0cb156"}
Oct 30 21:58:29.655962 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:29.655939    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:29.656038 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:29.655987    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:29.656402 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:29.656381    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:58:29.656774 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:29.656761    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:58:29.929055 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:29.929005    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2" podStartSLOduration=2.928988351 podStartE2EDuration="2.928988351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:29.927401199 +0000 UTC m=+847.976008894" watchObservedRunningTime="2026-10-30 21:58:29.928988351 +0000 UTC m=+847.977596045"
Oct 30 21:58:30.181575 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:30.181498    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:30.186626 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:30.186605    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:30.660440 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:30.660411    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:30.661182 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:30.661162    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:58:30.966410 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:30.966328    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:31.209531 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:31.209501    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:31.580582 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:31.580548    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:31.815907 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:31.815875    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:32.156630 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:58:32.156597    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:58:32.263870 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:32.263837    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:32.542033 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:32.541942    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:33.058922 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:33.058886    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:33.321581 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:33.321500    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:35.336439 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:35.336296    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:35.607289 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:35.607204    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:36.088300 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:36.088265    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:36.356213 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:36.356126    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:36.907360 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:36.907329    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:37.263341 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.263254    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:37.373874 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.373846    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"]
Oct 30 21:58:37.405726 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.401036    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 21:58:37.436650 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.436621    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"]
Oct 30 21:58:37.483386 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.483352    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-b2f165-serving-cert\""
Oct 30 21:58:37.520552 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.520493    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ed40e1-2fa4-4b27-89bb-c3409c173828-metrics-certs\") pod \"maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw\" (UID: \"05ed40e1-2fa4-4b27-89bb-c3409c173828\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 21:58:37.520552 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.520525    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ed40e1-2fa4-4b27-89bb-c3409c173828-maas-api-tls\") pod \"maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw\" (UID: \"05ed40e1-2fa4-4b27-89bb-c3409c173828\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 21:58:37.520780 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.520562    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2lcp\" (UniqueName: \"kubernetes.io/projected/05ed40e1-2fa4-4b27-89bb-c3409c173828-kube-api-access-t2lcp\") pod \"maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw\" (UID: \"05ed40e1-2fa4-4b27-89bb-c3409c173828\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 21:58:37.520780 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.520727    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05ed40e1-2fa4-4b27-89bb-c3409c173828-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw\" (UID: \"05ed40e1-2fa4-4b27-89bb-c3409c173828\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 21:58:37.621899 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.621871    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ed40e1-2fa4-4b27-89bb-c3409c173828-metrics-certs\") pod \"maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw\" (UID: \"05ed40e1-2fa4-4b27-89bb-c3409c173828\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 21:58:37.621899 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.621901    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ed40e1-2fa4-4b27-89bb-c3409c173828-maas-api-tls\") pod \"maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw\" (UID: \"05ed40e1-2fa4-4b27-89bb-c3409c173828\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 21:58:37.622067 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.621926    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2lcp\" (UniqueName: \"kubernetes.io/projected/05ed40e1-2fa4-4b27-89bb-c3409c173828-kube-api-access-t2lcp\") pod \"maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw\" (UID: \"05ed40e1-2fa4-4b27-89bb-c3409c173828\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 21:58:37.622067 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.621957    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05ed40e1-2fa4-4b27-89bb-c3409c173828-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw\" (UID: \"05ed40e1-2fa4-4b27-89bb-c3409c173828\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 21:58:37.622623 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.622601    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05ed40e1-2fa4-4b27-89bb-c3409c173828-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw\" (UID: \"05ed40e1-2fa4-4b27-89bb-c3409c173828\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 21:58:37.624352 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.624325    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ed40e1-2fa4-4b27-89bb-c3409c173828-maas-api-tls\") pod \"maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw\" (UID: \"05ed40e1-2fa4-4b27-89bb-c3409c173828\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 21:58:37.624449 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.624365    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ed40e1-2fa4-4b27-89bb-c3409c173828-metrics-certs\") pod \"maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw\" (UID: \"05ed40e1-2fa4-4b27-89bb-c3409c173828\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 21:58:37.684111 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.684082    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2lcp\" (UniqueName: \"kubernetes.io/projected/05ed40e1-2fa4-4b27-89bb-c3409c173828-kube-api-access-t2lcp\") pod \"maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw\" (UID: \"05ed40e1-2fa4-4b27-89bb-c3409c173828\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 21:58:37.720025 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.720001    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 21:58:37.752162 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.752127    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:37.989409 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:37.989376    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:38.097327 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:38.097146    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"]
Oct 30 21:58:38.099946 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:58:38.099918    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ed40e1_2fa4_4b27_89bb_c3409c173828.slice/crio-d130384e28c2271f1153ce7fd2fac5bcdf8efe08a6c26b0c933f0d4dd09c86f2 WatchSource:0}: Error finding container d130384e28c2271f1153ce7fd2fac5bcdf8efe08a6c26b0c933f0d4dd09c86f2: Status 404 returned error can't find the container with id d130384e28c2271f1153ce7fd2fac5bcdf8efe08a6c26b0c933f0d4dd09c86f2
Oct 30 21:58:38.240350 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:38.240327    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:38.698295 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:38.698255    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw" event={"ID":"05ed40e1-2fa4-4b27-89bb-c3409c173828","Type":"ContainerStarted","Data":"d130384e28c2271f1153ce7fd2fac5bcdf8efe08a6c26b0c933f0d4dd09c86f2"}
Oct 30 21:58:39.704418 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:39.704380    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw" event={"ID":"05ed40e1-2fa4-4b27-89bb-c3409c173828","Type":"ContainerStarted","Data":"374aaeb941d66aa7362d76e0135015f6d017cb7226e0707d3bf3e18a03be1aec"}
Oct 30 21:58:39.704935 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:39.704500    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 21:58:39.822393 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:39.822340    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw" podStartSLOduration=1.9756600199999999 podStartE2EDuration="2.822328441s" totalImagesPullingTime="846.668421ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:39.820754444 +0000 UTC m=+857.869362139" watchObservedRunningTime="2026-10-30 21:58:39.822328441 +0000 UTC m=+857.870936137"
Oct 30 21:58:40.422708 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:40.420435    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:40.668204 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:40.668169    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:42.766674 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:42.766639    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"]
Oct 30 21:58:42.769882 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:42.769862    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:42.821760 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:42.821738    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-a7b06b-serving-cert\""
Oct 30 21:58:42.873137 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:42.873114    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"]
Oct 30 21:58:42.877535 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:42.877513    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09941908-8213-44f4-be72-a5bfe5317ed5-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:42.877645 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:42.877549    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cngls\" (UniqueName: \"kubernetes.io/projected/09941908-8213-44f4-be72-a5bfe5317ed5-kube-api-access-cngls\") pod \"maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:42.877645 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:42.877574    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-maas-api-tls\") pod \"maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:42.877645 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:42.877594    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-metrics-certs\") pod \"maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:42.897250 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:42.897225    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:42.981352 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:42.981316    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09941908-8213-44f4-be72-a5bfe5317ed5-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:42.981352 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:42.981364    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cngls\" (UniqueName: \"kubernetes.io/projected/09941908-8213-44f4-be72-a5bfe5317ed5-kube-api-access-cngls\") pod \"maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:42.981738 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:42.981405    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-maas-api-tls\") pod \"maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:42.981738 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:42.981435    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-metrics-certs\") pod \"maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:42.982525 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:42.982498    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09941908-8213-44f4-be72-a5bfe5317ed5-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:42.982634 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:58:42.982507    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-serving-cert: secret "maas-api-e2e-worker-w5-a7b06b-serving-cert" not found
Oct 30 21:58:42.982634 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:58:42.982591    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-maas-api-tls podName:09941908-8213-44f4-be72-a5bfe5317ed5 nodeName:}" failed. No retries permitted until 2026-10-30 21:58:43.482572 +0000 UTC m=+861.531179687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-maas-api-tls") pod "maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8" (UID: "09941908-8213-44f4-be72-a5bfe5317ed5") : secret "maas-api-e2e-worker-w5-a7b06b-serving-cert" not found
Oct 30 21:58:42.987914 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:42.987887    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-metrics-certs\") pod \"maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:43.045169 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:43.045117    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cngls\" (UniqueName: \"kubernetes.io/projected/09941908-8213-44f4-be72-a5bfe5317ed5-kube-api-access-cngls\") pod \"maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:43.185562 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:43.185531    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:43.426269 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:43.426239    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:43.486260 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:43.486227    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-maas-api-tls\") pod \"maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:43.488714 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:43.488675    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-maas-api-tls\") pod \"maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:43.683452 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:43.683374    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:44.060008 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:44.059985    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"]
Oct 30 21:58:44.062401 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:58:44.062373    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09941908_8213_44f4_be72_a5bfe5317ed5.slice/crio-e80f193aa4ab79f494d1596537d6ea39b465f030cc1bd1bd8c074da507316c37 WatchSource:0}: Error finding container e80f193aa4ab79f494d1596537d6ea39b465f030cc1bd1bd8c074da507316c37: Status 404 returned error can't find the container with id e80f193aa4ab79f494d1596537d6ea39b465f030cc1bd1bd8c074da507316c37
Oct 30 21:58:44.729530 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:44.729495    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8" event={"ID":"09941908-8213-44f4-be72-a5bfe5317ed5","Type":"ContainerStarted","Data":"e80f193aa4ab79f494d1596537d6ea39b465f030cc1bd1bd8c074da507316c37"}
Oct 30 21:58:45.388835 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:45.388791    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:45.748534 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:45.745240    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:45.748534 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:45.747669    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 21:58:45.757704 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:45.756814    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8" event={"ID":"09941908-8213-44f4-be72-a5bfe5317ed5","Type":"ContainerStarted","Data":"f37435000ee60a8031d7856e9b0932bdd811f93d5969e7a72d8de8af871291fb"}
Oct 30 21:58:45.757704 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:45.757586    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:46.050770 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:46.030776    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:46.207168 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:46.197716    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8" podStartSLOduration=3.364619486 podStartE2EDuration="4.19767615s" totalImagesPullingTime="833.056664ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:46.014489186 +0000 UTC m=+864.063096881" watchObservedRunningTime="2026-10-30 21:58:46.19767615 +0000 UTC m=+864.246283847"
Oct 30 21:58:46.207168 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:46.199290    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"]
Oct 30 21:58:46.217720 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:46.212407    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"
Oct 30 21:58:46.231028 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:46.231000    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/627ab374-d53d-4ade-a310-a61333cc74b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv\" (UID: \"627ab374-d53d-4ade-a310-a61333cc74b2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"
Oct 30 21:58:46.231146 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:46.231049    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8tt5\" (UniqueName: \"kubernetes.io/projected/627ab374-d53d-4ade-a310-a61333cc74b2-kube-api-access-j8tt5\") pod \"payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv\" (UID: \"627ab374-d53d-4ade-a310-a61333cc74b2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"
Oct 30 21:58:46.264671 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:46.264641    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"]
Oct 30 21:58:46.265101 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:46.265081    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-536975-dockercfg-bwhtk\""
Oct 30 21:58:46.265972 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:46.265952    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-536975\""
Oct 30 21:58:46.331560 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:46.331502    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/627ab374-d53d-4ade-a310-a61333cc74b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv\" (UID: \"627ab374-d53d-4ade-a310-a61333cc74b2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"
Oct 30 21:58:46.331560 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:46.331545    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8tt5\" (UniqueName: \"kubernetes.io/projected/627ab374-d53d-4ade-a310-a61333cc74b2-kube-api-access-j8tt5\") pod \"payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv\" (UID: \"627ab374-d53d-4ade-a310-a61333cc74b2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"
Oct 30 21:58:46.332358 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:46.332339    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/627ab374-d53d-4ade-a310-a61333cc74b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv\" (UID: \"627ab374-d53d-4ade-a310-a61333cc74b2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"
Oct 30 21:58:46.392292 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:46.392263    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8tt5\" (UniqueName: \"kubernetes.io/projected/627ab374-d53d-4ade-a310-a61333cc74b2-kube-api-access-j8tt5\") pod \"payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv\" (UID: \"627ab374-d53d-4ade-a310-a61333cc74b2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"
Oct 30 21:58:46.531441 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:46.531414    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"
Oct 30 21:58:46.904461 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:46.904435    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"]
Oct 30 21:58:46.906969 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:58:46.906942    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod627ab374_d53d_4ade_a310_a61333cc74b2.slice/crio-9db98d689d25bb11c08e058780ada08ad2e37169cfe653ac997f949f225e8316 WatchSource:0}: Error finding container 9db98d689d25bb11c08e058780ada08ad2e37169cfe653ac997f949f225e8316: Status 404 returned error can't find the container with id 9db98d689d25bb11c08e058780ada08ad2e37169cfe653ac997f949f225e8316
Oct 30 21:58:46.930229 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:46.930195    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:47.239815 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:47.239711    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:47.766775 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:47.766738    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv" event={"ID":"627ab374-d53d-4ade-a310-a61333cc74b2","Type":"ContainerStarted","Data":"9db98d689d25bb11c08e058780ada08ad2e37169cfe653ac997f949f225e8316"}
Oct 30 21:58:48.397040 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.397004    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"]
Oct 30 21:58:48.401293 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.401266    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:48.450420 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.450391    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-metrics-certs\") pod \"maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:48.450591 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.450426    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c637c629-35bf-4b7e-9e5e-85e17cd23837-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:48.450591 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.450546    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-maas-api-tls\") pod \"maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:48.450824 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.450743    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz84d\" (UniqueName: \"kubernetes.io/projected/c637c629-35bf-4b7e-9e5e-85e17cd23837-kube-api-access-pz84d\") pod \"maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:48.456495 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.456468    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-b9fbe2-serving-cert\""
Oct 30 21:58:48.508876 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.508844    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"]
Oct 30 21:58:48.552095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.552057    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-metrics-certs\") pod \"maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:48.552278 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.552115    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c637c629-35bf-4b7e-9e5e-85e17cd23837-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:48.552278 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.552173    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-maas-api-tls\") pod \"maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:48.552405 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.552301    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz84d\" (UniqueName: \"kubernetes.io/projected/c637c629-35bf-4b7e-9e5e-85e17cd23837-kube-api-access-pz84d\") pod \"maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:48.552895 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:58:48.552587    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-serving-cert: secret "maas-api-e2e-worker-w6-b9fbe2-serving-cert" not found
Oct 30 21:58:48.552895 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:58:48.552665    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-maas-api-tls podName:c637c629-35bf-4b7e-9e5e-85e17cd23837 nodeName:}" failed. No retries permitted until 2026-10-30 21:58:49.052641782 +0000 UTC m=+867.101249475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-maas-api-tls") pod "maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs" (UID: "c637c629-35bf-4b7e-9e5e-85e17cd23837") : secret "maas-api-e2e-worker-w6-b9fbe2-serving-cert" not found
Oct 30 21:58:48.552895 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.552869    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c637c629-35bf-4b7e-9e5e-85e17cd23837-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:48.555493 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.555469    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-metrics-certs\") pod \"maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:48.616115 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.616083    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz84d\" (UniqueName: \"kubernetes.io/projected/c637c629-35bf-4b7e-9e5e-85e17cd23837-kube-api-access-pz84d\") pod \"maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:48.698924 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.698833    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:48.940085 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:48.940046    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:49.073850 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:49.073767    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-maas-api-tls\") pod \"maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:49.076428 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:49.076401    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-maas-api-tls\") pod \"maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:49.190250 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:49.190213    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:49.321005 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:49.320648    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:49.731722 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:49.726571    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"]
Oct 30 21:58:49.778440 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:49.778400    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv" event={"ID":"627ab374-d53d-4ade-a310-a61333cc74b2","Type":"ContainerStarted","Data":"934dab25e02268cae87267f00db962fd057e41386b578d0172bdbfa5f6f97486"}
Oct 30 21:58:49.778610 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:49.778595    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"
Oct 30 21:58:49.779643 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:49.779617    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs" event={"ID":"c637c629-35bf-4b7e-9e5e-85e17cd23837","Type":"ContainerStarted","Data":"3acd5fc984f61082bc52e937cf137ee2e6a060e2ccdbfd879f41c1c9f2ac7045"}
Oct 30 21:58:49.894804 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:49.894756    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv" podStartSLOduration=1.189615067 podStartE2EDuration="3.894743502s" totalImagesPullingTime="2.705128435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:49.892801879 +0000 UTC m=+867.941409575" watchObservedRunningTime="2026-10-30 21:58:49.894743502 +0000 UTC m=+867.943351196"
Oct 30 21:58:50.475617 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:50.475586    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:50.786912 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:50.786817    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs" event={"ID":"c637c629-35bf-4b7e-9e5e-85e17cd23837","Type":"ContainerStarted","Data":"e3b918c8c2c3043f66d2fae24ae18c2642be67a79eb5483eae59ec869a4d0641"}
Oct 30 21:58:50.905507 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:50.905457    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs" podStartSLOduration=2.090132283 podStartE2EDuration="2.905444408s" totalImagesPullingTime="815.312125ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:50.903351419 +0000 UTC m=+868.951959114" watchObservedRunningTime="2026-10-30 21:58:50.905444408 +0000 UTC m=+868.954052104"
Oct 30 21:58:51.791836 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:51.791810    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:52.752546 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:52.751773    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:52.792056 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:52.792028    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 21:58:52.989251 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:52.989214    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:53.361724 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.361693    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"]
Oct 30 21:58:53.365381 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.365365    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"
Oct 30 21:58:53.417367 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.417338    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-bf7cbf\""
Oct 30 21:58:53.417499 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.417443    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-bf7cbf-dockercfg-v4xp8\""
Oct 30 21:58:53.423246 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.423226    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"]
Oct 30 21:58:53.447176 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.447153    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqm58\" (UniqueName: \"kubernetes.io/projected/34de2b70-307f-4377-81ac-b5e8913dab09-kube-api-access-jqm58\") pod \"payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf\" (UID: \"34de2b70-307f-4377-81ac-b5e8913dab09\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"
Oct 30 21:58:53.447282 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.447188    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34de2b70-307f-4377-81ac-b5e8913dab09-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf\" (UID: \"34de2b70-307f-4377-81ac-b5e8913dab09\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"
Oct 30 21:58:53.548598 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.548571    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqm58\" (UniqueName: \"kubernetes.io/projected/34de2b70-307f-4377-81ac-b5e8913dab09-kube-api-access-jqm58\") pod \"payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf\" (UID: \"34de2b70-307f-4377-81ac-b5e8913dab09\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"
Oct 30 21:58:53.548736 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.548604    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34de2b70-307f-4377-81ac-b5e8913dab09-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf\" (UID: \"34de2b70-307f-4377-81ac-b5e8913dab09\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"
Oct 30 21:58:53.549356 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.549332    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34de2b70-307f-4377-81ac-b5e8913dab09-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf\" (UID: \"34de2b70-307f-4377-81ac-b5e8913dab09\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"
Oct 30 21:58:53.609244 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.609220    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqm58\" (UniqueName: \"kubernetes.io/projected/34de2b70-307f-4377-81ac-b5e8913dab09-kube-api-access-jqm58\") pod \"payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf\" (UID: \"34de2b70-307f-4377-81ac-b5e8913dab09\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"
Oct 30 21:58:53.671841 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.671820    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"]
Oct 30 21:58:53.675513 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.675496    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:58:53.677637 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.677619    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"
Oct 30 21:58:53.727229 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.727188    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-536975-serving-cert\""
Oct 30 21:58:53.740244 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.740222    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"]
Oct 30 21:58:53.750877 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.750784    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6bpm\" (UniqueName: \"kubernetes.io/projected/0579a89d-adad-4b2a-ab61-1b8aee98905b-kube-api-access-r6bpm\") pod \"maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:58:53.750877 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.750853    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-metrics-certs\") pod \"maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:58:53.751013 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.750978    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0579a89d-adad-4b2a-ab61-1b8aee98905b-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:58:53.751101 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.751080    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-maas-api-tls\") pod \"maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:58:53.851899 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.851860    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0579a89d-adad-4b2a-ab61-1b8aee98905b-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:58:53.852373 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.851928    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-maas-api-tls\") pod \"maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:58:53.852373 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.852025    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6bpm\" (UniqueName: \"kubernetes.io/projected/0579a89d-adad-4b2a-ab61-1b8aee98905b-kube-api-access-r6bpm\") pod \"maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:58:53.852373 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.852100    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-metrics-certs\") pod \"maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:58:53.852373 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:58:53.852032    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-serving-cert: secret "maas-api-e2e-worker-w4-536975-serving-cert" not found
Oct 30 21:58:53.852373 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:58:53.852205    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-maas-api-tls podName:0579a89d-adad-4b2a-ab61-1b8aee98905b nodeName:}" failed. No retries permitted until 2026-10-30 21:58:54.352188897 +0000 UTC m=+872.400796571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-maas-api-tls") pod "maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5" (UID: "0579a89d-adad-4b2a-ab61-1b8aee98905b") : secret "maas-api-e2e-worker-w4-536975-serving-cert" not found
Oct 30 21:58:53.852669 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.852644    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0579a89d-adad-4b2a-ab61-1b8aee98905b-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:58:53.854559 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.854538    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-metrics-certs\") pod \"maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:58:53.912634 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.912610    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6bpm\" (UniqueName: \"kubernetes.io/projected/0579a89d-adad-4b2a-ab61-1b8aee98905b-kube-api-access-r6bpm\") pod \"maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:58:53.967847 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:53.967769    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:54.072874 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:54.072848    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"]
Oct 30 21:58:54.075477 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:58:54.075452    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34de2b70_307f_4377_81ac_b5e8913dab09.slice/crio-e397f4cf054a97626360d7f8f53d8beeba7d26b4a428685c717cad2543631d70 WatchSource:0}: Error finding container e397f4cf054a97626360d7f8f53d8beeba7d26b4a428685c717cad2543631d70: Status 404 returned error can't find the container with id e397f4cf054a97626360d7f8f53d8beeba7d26b4a428685c717cad2543631d70
Oct 30 21:58:54.213887 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:54.213845    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:54.357433 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:54.357370    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-maas-api-tls\") pod \"maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:58:54.359803 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:54.359783    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-maas-api-tls\") pod \"maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:58:54.452095 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:54.452070    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:54.589126 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:54.589086    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:58:54.814209 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:54.814176    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf" event={"ID":"34de2b70-307f-4377-81ac-b5e8913dab09","Type":"ContainerStarted","Data":"9baad860919fa5c06094275b64abcc66af2eecfc6de7078d6a1b8278eff354ec"}
Oct 30 21:58:54.814353 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:54.814227    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf" event={"ID":"34de2b70-307f-4377-81ac-b5e8913dab09","Type":"ContainerStarted","Data":"e397f4cf054a97626360d7f8f53d8beeba7d26b4a428685c717cad2543631d70"}
Oct 30 21:58:54.814353 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:54.814330    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"
Oct 30 21:58:54.930665 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:54.930577    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf" podStartSLOduration=1.9305624799999999 podStartE2EDuration="1.93056248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:54.92923438 +0000 UTC m=+872.977842074" watchObservedRunningTime="2026-10-30 21:58:54.93056248 +0000 UTC m=+872.979170174"
Oct 30 21:58:55.016364 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:55.016325    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"]
Oct 30 21:58:55.019585 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:58:55.019557    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0579a89d_adad_4b2a_ab61_1b8aee98905b.slice/crio-ef8c0b126c68e490c0c5a8d2666a1e0a78a1d849c5872bfc4326314ca7062b06 WatchSource:0}: Error finding container ef8c0b126c68e490c0c5a8d2666a1e0a78a1d849c5872bfc4326314ca7062b06: Status 404 returned error can't find the container with id ef8c0b126c68e490c0c5a8d2666a1e0a78a1d849c5872bfc4326314ca7062b06
Oct 30 21:58:55.821236 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:55.821202    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5" event={"ID":"0579a89d-adad-4b2a-ab61-1b8aee98905b","Type":"ContainerStarted","Data":"ef8c0b126c68e490c0c5a8d2666a1e0a78a1d849c5872bfc4326314ca7062b06"}
Oct 30 21:58:56.827742 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:56.827676    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5" event={"ID":"0579a89d-adad-4b2a-ab61-1b8aee98905b","Type":"ContainerStarted","Data":"1f8aa9115842cf2e94b5a1f6363cb354c3e4c395637e734a215a8ebe9f08e5ca"}
Oct 30 21:58:56.828126 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:56.827775    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:58:56.958498 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:56.958445    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5" podStartSLOduration=3.165494722 podStartE2EDuration="3.958430612s" totalImagesPullingTime="792.93589ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:58:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:58:56.956653291 +0000 UTC m=+875.005260985" watchObservedRunningTime="2026-10-30 21:58:56.958430612 +0000 UTC m=+875.007038303"
Oct 30 21:58:57.802476 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:57.802442    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 21:58:59.377473 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:58:59.377441    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:00.790331 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:00.790298    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"
Oct 30 21:59:02.113806 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:02.113771    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:02.158169 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:59:02.158130    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:59:02.837865 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:02.837838    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 21:59:04.316439 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:04.316402    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:04.559703 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:04.556315    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:05.843840 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:05.842892    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"
Oct 30 21:59:09.068599 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.068568    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"]
Oct 30 21:59:09.081887 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.080115    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:09.155907 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.155751    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"]
Oct 30 21:59:09.171496 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.171464    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-metrics-certs\") pod \"maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:09.171651 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.171577    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a9898d-8632-43e1-ba70-78e4f9efb462-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:09.171651 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.171612    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfnj9\" (UniqueName: \"kubernetes.io/projected/f6a9898d-8632-43e1-ba70-78e4f9efb462-kube-api-access-xfnj9\") pod \"maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:09.171752 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.171696    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-maas-api-tls\") pod \"maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:09.186419 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.186390    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-cef074-serving-cert\""
Oct 30 21:59:09.273057 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.273017    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a9898d-8632-43e1-ba70-78e4f9efb462-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:09.273286 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.273263    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfnj9\" (UniqueName: \"kubernetes.io/projected/f6a9898d-8632-43e1-ba70-78e4f9efb462-kube-api-access-xfnj9\") pod \"maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:09.273399 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.273384    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-maas-api-tls\") pod \"maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:09.273882 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.273503    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-metrics-certs\") pod \"maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:09.273882 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:59:09.273565    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-serving-cert: secret "maas-api-e2e-worker-w3-cef074-serving-cert" not found
Oct 30 21:59:09.273882 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.273631    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a9898d-8632-43e1-ba70-78e4f9efb462-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:09.273882 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:59:09.273641    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-maas-api-tls podName:f6a9898d-8632-43e1-ba70-78e4f9efb462 nodeName:}" failed. No retries permitted until 2026-10-30 21:59:09.773619885 +0000 UTC m=+887.822227573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-maas-api-tls") pod "maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk" (UID: "f6a9898d-8632-43e1-ba70-78e4f9efb462") : secret "maas-api-e2e-worker-w3-cef074-serving-cert" not found
Oct 30 21:59:09.276647 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.276626    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-metrics-certs\") pod \"maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:09.362485 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.361931    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfnj9\" (UniqueName: \"kubernetes.io/projected/f6a9898d-8632-43e1-ba70-78e4f9efb462-kube-api-access-xfnj9\") pod \"maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:09.384384 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.384280    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:09.624746 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.624650    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:09.786917 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.786871    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-maas-api-tls\") pod \"maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:09.789501 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.789476    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-maas-api-tls\") pod \"maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:09.997984 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:09.997951    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:10.390102 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:10.390068    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"]
Oct 30 21:59:10.391927 ip-10-0-142-154 kubenswrapper[4918]: W1030 21:59:10.391892    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a9898d_8632_43e1_ba70_78e4f9efb462.slice/crio-e3cbfbfdee7bdf80279e2de07427c6437284c8906170f4c2c3bd76aef0bcaddd WatchSource:0}: Error finding container e3cbfbfdee7bdf80279e2de07427c6437284c8906170f4c2c3bd76aef0bcaddd: Status 404 returned error can't find the container with id e3cbfbfdee7bdf80279e2de07427c6437284c8906170f4c2c3bd76aef0bcaddd
Oct 30 21:59:10.900010 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:10.899955    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk" event={"ID":"f6a9898d-8632-43e1-ba70-78e4f9efb462","Type":"ContainerStarted","Data":"e3cbfbfdee7bdf80279e2de07427c6437284c8906170f4c2c3bd76aef0bcaddd"}
Oct 30 21:59:11.907600 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:11.907562    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk" event={"ID":"f6a9898d-8632-43e1-ba70-78e4f9efb462","Type":"ContainerStarted","Data":"c4208c0e00399a5e64ef5004be3abc1dde8c81b091e7b56a4f245af9d9ac3df1"}
Oct 30 21:59:11.908037 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:11.907742    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:12.027672 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:12.027617    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk" podStartSLOduration=2.19176411 podStartE2EDuration="3.027602111s" totalImagesPullingTime="835.838001ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:59:12.024737074 +0000 UTC m=+890.073344772" watchObservedRunningTime="2026-10-30 21:59:12.027602111 +0000 UTC m=+890.076209806"
Oct 30 21:59:13.921842 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:13.921811    4918 generic.go:356] "Generic (PLEG): container finished" podID="0856582a-2e5e-4d49-9f58-9cf10c008b41" containerID="939f6a3775ea4112441e303cbbc1fb49f801887af07eb4ba3da9e8ec6bac83f0" exitCode=0
Oct 30 21:59:13.922288 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:13.921879    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng" event={"ID":"0856582a-2e5e-4d49-9f58-9cf10c008b41","Type":"ContainerDied","Data":"939f6a3775ea4112441e303cbbc1fb49f801887af07eb4ba3da9e8ec6bac83f0"}
Oct 30 21:59:13.922288 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:13.922287    4918 scope.go:122] "RemoveContainer" containerID="939f6a3775ea4112441e303cbbc1fb49f801887af07eb4ba3da9e8ec6bac83f0"
Oct 30 21:59:13.923571 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:13.923550    4918 generic.go:356] "Generic (PLEG): container finished" podID="fa1a78dc-c5da-469a-af25-77d846ba4e92" containerID="e1d6dc8bbd0c1f592c7245742a97890fd5ba047dc9555ced13446994ed0cb156" exitCode=0
Oct 30 21:59:13.923675 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:13.923628    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2" event={"ID":"fa1a78dc-c5da-469a-af25-77d846ba4e92","Type":"ContainerDied","Data":"e1d6dc8bbd0c1f592c7245742a97890fd5ba047dc9555ced13446994ed0cb156"}
Oct 30 21:59:13.923675 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:13.923636    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:59:13.923769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:13.923730    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:59:13.923769 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:13.923764    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:59:13.923949 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:13.923936    4918 scope.go:122] "RemoveContainer" containerID="e1d6dc8bbd0c1f592c7245742a97890fd5ba047dc9555ced13446994ed0cb156"
Oct 30 21:59:13.925037 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:13.925011    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:59:13.925129 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:13.925071    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:59:13.925129 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:13.925109    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:59:14.412575 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:14.412529    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:14.656088 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:14.656052    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:59:14.959719 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:14.959651    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng" event={"ID":"0856582a-2e5e-4d49-9f58-9cf10c008b41","Type":"ContainerStarted","Data":"841af1963f4b123e11328c8c6a8543281e350881d11d56ab36963e8a51a39ed2"}
Oct 30 21:59:14.964716 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:14.963895    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2" event={"ID":"fa1a78dc-c5da-469a-af25-77d846ba4e92","Type":"ContainerStarted","Data":"67fb6677709f81c38ba3a97332f3db5e4ad844d0abccd0a64259db7a2e257c36"}
Oct 30 21:59:15.183499 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:15.182278    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:59:15.183499 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:15.183356    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Oct 30 21:59:15.183499 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:15.183407    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2" podUID="fa1a78dc-c5da-469a-af25-77d846ba4e92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Oct 30 21:59:15.553965 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:15.553929    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:59:15.554327 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:15.554306    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Oct 30 21:59:15.554478 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:15.554453    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng" podUID="0856582a-2e5e-4d49-9f58-9cf10c008b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Oct 30 21:59:15.662818 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:15.662781    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:59:16.181518 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:16.181463    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Oct 30 21:59:16.182069 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:16.181524    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2" podUID="fa1a78dc-c5da-469a-af25-77d846ba4e92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Oct 30 21:59:16.556210 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:16.556119    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Oct 30 21:59:16.556471 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:16.556441    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng" podUID="0856582a-2e5e-4d49-9f58-9cf10c008b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Oct 30 21:59:17.181667 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:17.181633    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Oct 30 21:59:17.182208 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:17.181756    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2" podUID="fa1a78dc-c5da-469a-af25-77d846ba4e92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Oct 30 21:59:17.320728 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:17.320622    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:17.558234 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:17.558140    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Oct 30 21:59:17.558529 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:17.558489    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng" podUID="0856582a-2e5e-4d49-9f58-9cf10c008b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Oct 30 21:59:17.953175 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:17.953142    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 21:59:18.182193 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:18.182151    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Oct 30 21:59:18.182720 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:18.182201    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2" podUID="fa1a78dc-c5da-469a-af25-77d846ba4e92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Oct 30 21:59:18.573703 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:18.572833    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Oct 30 21:59:18.573703 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:18.572896    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng" podUID="0856582a-2e5e-4d49-9f58-9cf10c008b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Oct 30 21:59:19.210716 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:19.210589    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Oct 30 21:59:19.210716 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:19.210644    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2" podUID="fa1a78dc-c5da-469a-af25-77d846ba4e92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Oct 30 21:59:19.229830 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:19.229651    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:19.498296 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:19.498209    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:19.576869 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:19.574845    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Oct 30 21:59:19.576869 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:19.574937    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng" podUID="0856582a-2e5e-4d49-9f58-9cf10c008b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Oct 30 21:59:20.182441 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:20.182398    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Oct 30 21:59:20.182639 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:20.182460    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2" podUID="fa1a78dc-c5da-469a-af25-77d846ba4e92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Oct 30 21:59:20.557884 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:20.557800    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:59:20.558301 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:20.558087    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:59:20.558846 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:20.558826    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 21:59:21.186236 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:21.186209    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:59:21.187074 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:21.187052    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 21:59:21.405285 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:21.405235    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:21.912026 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:21.911991    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:22.128376 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:22.128345    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 21:59:22.130996 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:22.130961    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 21:59:22.154318 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:22.154286    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:24.050358 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:24.050332    4918 generic.go:356] "Generic (PLEG): container finished" podID="1fec41f1-9d5d-410f-99ac-299ee5385f24" containerID="30e6c194511c42eb8fd8b901434e3be4167a434910d2286340c95391de26d453" exitCode=0
Oct 30 21:59:24.050702 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:24.050397    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj" event={"ID":"1fec41f1-9d5d-410f-99ac-299ee5385f24","Type":"ContainerDied","Data":"30e6c194511c42eb8fd8b901434e3be4167a434910d2286340c95391de26d453"}
Oct 30 21:59:24.050800 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:24.050785    4918 scope.go:122] "RemoveContainer" containerID="30e6c194511c42eb8fd8b901434e3be4167a434910d2286340c95391de26d453"
Oct 30 21:59:24.051981 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:24.051958    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:59:24.052033 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:24.052023    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:59:24.052068 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:24.052056    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:59:24.734764 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:24.734727    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:25.058636 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:25.058563    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj" event={"ID":"1fec41f1-9d5d-410f-99ac-299ee5385f24","Type":"ContainerStarted","Data":"90d39f06a168ee5342d5a1d88f5263850b6b45861a3f366264c3c78d02d49c40"}
Oct 30 21:59:25.863203 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:25.863166    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:59:25.864354 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:25.864332    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Oct 30 21:59:25.864432 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:25.864379    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj" podUID="1fec41f1-9d5d-410f-99ac-299ee5385f24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Oct 30 21:59:26.069618 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:26.068864    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:26.862802 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:26.862765    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Oct 30 21:59:26.862993 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:26.862832    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj" podUID="1fec41f1-9d5d-410f-99ac-299ee5385f24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Oct 30 21:59:27.862609 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:27.862571    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Oct 30 21:59:27.863019 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:27.862622    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj" podUID="1fec41f1-9d5d-410f-99ac-299ee5385f24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Oct 30 21:59:28.863227 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:28.863187    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Oct 30 21:59:28.863797 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:28.863250    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj" podUID="1fec41f1-9d5d-410f-99ac-299ee5385f24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Oct 30 21:59:29.656490 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:29.656437    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:59:29.863227 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:29.863191    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Oct 30 21:59:29.863376 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:29.863246    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj" podUID="1fec41f1-9d5d-410f-99ac-299ee5385f24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Oct 30 21:59:30.164840 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:30.164731    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:30.867066 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:30.867034    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:59:30.868017 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:30.867989    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 21:59:31.946936 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:31.946902    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:32.156870 ip-10-0-142-154 kubenswrapper[4918]: E1030 21:59:32.156833    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 21:59:32.548148 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:32.548109    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:32.841981 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:32.841897    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:35.562950 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:35.562919    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:36.149578 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:36.149542    4918 generic.go:356] "Generic (PLEG): container finished" podID="6ab4caf4-843c-46ef-a936-a8eb42f5053f" containerID="3584487eac3a3cf7cf6cce69e8cfa0aabba580f1b22fec974e403392924bb5dc" exitCode=0
Oct 30 21:59:36.149772 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:36.149613    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq" event={"ID":"6ab4caf4-843c-46ef-a936-a8eb42f5053f","Type":"ContainerDied","Data":"3584487eac3a3cf7cf6cce69e8cfa0aabba580f1b22fec974e403392924bb5dc"}
Oct 30 21:59:36.149980 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:36.149963    4918 scope.go:122] "RemoveContainer" containerID="3584487eac3a3cf7cf6cce69e8cfa0aabba580f1b22fec974e403392924bb5dc"
Oct 30 21:59:36.151168 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:36.151130    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:59:36.151256 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:36.151206    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:59:36.151256 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:36.151240    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:59:37.157500 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:37.157462    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq" event={"ID":"6ab4caf4-843c-46ef-a936-a8eb42f5053f","Type":"ContainerStarted","Data":"7b57662e18836151ba868a8f451073041661feee85417c5facfeb11cff469a0a"}
Oct 30 21:59:37.261082 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:37.261048    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:59:37.261394 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:37.261373    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Oct 30 21:59:37.261444 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:37.261422    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq" podUID="6ab4caf4-843c-46ef-a936-a8eb42f5053f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Oct 30 21:59:38.260849 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:38.260816    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Oct 30 21:59:38.261245 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:38.260866    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq" podUID="6ab4caf4-843c-46ef-a936-a8eb42f5053f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Oct 30 21:59:38.920342 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:38.920309    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:39.261299 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:39.261215    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Oct 30 21:59:39.261299 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:39.261269    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq" podUID="6ab4caf4-843c-46ef-a936-a8eb42f5053f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Oct 30 21:59:39.572742 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:39.572634    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:39.817307 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:39.817274    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:40.261593 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:40.261559    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Oct 30 21:59:40.262058 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:40.261614    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq" podUID="6ab4caf4-843c-46ef-a936-a8eb42f5053f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Oct 30 21:59:40.878564 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:40.878507    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:41.261195 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:41.261163    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Oct 30 21:59:41.261381 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:41.261216    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq" podUID="6ab4caf4-843c-46ef-a936-a8eb42f5053f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Oct 30 21:59:42.303964 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:42.303926    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:59:42.304478 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:42.304419    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:59:42.313986 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:42.313943    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 21:59:46.406576 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:46.406536    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:51.646727 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:51.646676    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:52.181542 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:52.181502    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:52.776743 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:52.776714    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:53.064109 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:53.064023    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:53.528560 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:53.528508    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:53.809011 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:53.808908    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:54.268872 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:54.268832    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:56.830493 ip-10-0-142-154 kubenswrapper[4918]: I1030 21:59:56.830457    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:00.172921 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:00.172866    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:00.820899 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:00.820860    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:01.065555 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:01.065516    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:02.127028 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:02.126991    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:02.158281 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:00:02.158250    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:00:02.390779 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:02.388542    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:02.944809 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:02.944779    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:07.012560 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:07.012522    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:11.826642 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:11.826605    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:12.321231 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:12.321182    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:12.674792 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:12.674752    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:16.713522 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:16.713478    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:17.231177 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:17.231142    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:17.673279 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:17.673242    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:22.139014 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:22.138976    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:27.128091 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:27.126465    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:27.375761 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:27.375728    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:32.028294 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:32.028257    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:32.157490 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:00:32.157451    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:00:36.904078 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:36.904047    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:38.118228 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:38.118186    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:41.815670 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:41.815631    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:43.918242 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:43.917729    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:46.720215 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:46.720173    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:51.004579 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:50.998968    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:51.630432 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:51.630394    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:56.545900 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:56.545864    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:57.503590 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.503542    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"]
Oct 30 22:00:57.530758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.530728    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.580200 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.580163    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.580562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.580223    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05857f11-e5bc-4236-8811-0b43c6661c1f-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.580562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.580292    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.580562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.580442    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.580562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.580505    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkk5l\" (UniqueName: \"kubernetes.io/projected/05857f11-e5bc-4236-8811-0b43c6661c1f-kube-api-access-tkk5l\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.580562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.580537    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.580783 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.580565    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.580783 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.580610    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.580783 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.580715    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.582847 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.582830    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-b2f165-openshift-default-dockercfg-5fv84\""
Oct 30 22:00:57.634449 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.634420    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"]
Oct 30 22:00:57.682123 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.682084    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.682305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.682132    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.682305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.682178    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.682305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.682239    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.682305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.682281    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05857f11-e5bc-4236-8811-0b43c6661c1f-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.682522 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.682419    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.682600 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.682576    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.682657 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.682582    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.682747 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.682634    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkk5l\" (UniqueName: \"kubernetes.io/projected/05857f11-e5bc-4236-8811-0b43c6661c1f-kube-api-access-tkk5l\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.682807 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.682771    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.683148 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.683108    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.683148 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.683135    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.683312 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.683156    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.684058 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.684036    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05857f11-e5bc-4236-8811-0b43c6661c1f-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.685068 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.685036    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.685307 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.685289    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.744134 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.744103    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.744310 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.744277    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkk5l\" (UniqueName: \"kubernetes.io/projected/05857f11-e5bc-4236-8811-0b43c6661c1f-kube-api-access-tkk5l\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:57.845674 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:57.845600    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:58.277190 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:58.277168    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"]
Oct 30 22:00:58.279920 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:00:58.279892    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05857f11_e5bc_4236_8811_0b43c6661c1f.slice/crio-f096f2cff246f7e5aed691081af0f1c3bf58eabc3af592c01b47e5914be608f8 WatchSource:0}: Error finding container f096f2cff246f7e5aed691081af0f1c3bf58eabc3af592c01b47e5914be608f8: Status 404 returned error can't find the container with id f096f2cff246f7e5aed691081af0f1c3bf58eabc3af592c01b47e5914be608f8
Oct 30 22:00:58.282238 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:58.282211    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:58.282304 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:58.282276    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:58.282342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:58.282310    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:00:58.640136 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:58.640092    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n" event={"ID":"05857f11-e5bc-4236-8811-0b43c6661c1f","Type":"ContainerStarted","Data":"943af6e61bc26b50d9ada36421581aaeb9698aaec00a9c3208efc09fb889ca4e"}
Oct 30 22:00:58.640620 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:58.640160    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n" event={"ID":"05857f11-e5bc-4236-8811-0b43c6661c1f","Type":"ContainerStarted","Data":"f096f2cff246f7e5aed691081af0f1c3bf58eabc3af592c01b47e5914be608f8"}
Oct 30 22:00:58.760363 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:58.760297    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n" podStartSLOduration=1.7602823220000001 podStartE2EDuration="1.760282322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:58.7596409 +0000 UTC m=+996.808248586" watchObservedRunningTime="2026-10-30 22:00:58.760282322 +0000 UTC m=+996.808890018"
Oct 30 22:00:58.845973 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:58.845929    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:00:59.847907 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:59.847874    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 22:00:59.848290 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:00:59.847924    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n" podUID="05857f11-e5bc-4236-8811-0b43c6661c1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 22:01:00.846951 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:00.846911    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 22:01:00.847138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:00.846971    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n" podUID="05857f11-e5bc-4236-8811-0b43c6661c1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 22:01:01.558458 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:01.558425    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:01.846803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:01.846716    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 22:01:01.846803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:01.846774    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n" podUID="05857f11-e5bc-4236-8811-0b43c6661c1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 22:01:02.157247 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:01:02.157211    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:01:02.846655 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:02.846622    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 22:01:02.847076 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:02.846700    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n" podUID="05857f11-e5bc-4236-8811-0b43c6661c1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 22:01:03.846969 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:03.846929    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 22:01:03.847382 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:03.846996    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n" podUID="05857f11-e5bc-4236-8811-0b43c6661c1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 22:01:04.942313 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:04.942275    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:01:04.943305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:04.943276    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:01:04.944131 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:04.944113    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:01:06.436442 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:06.436395    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:07.842963 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:07.842924    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:11.383286 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:11.383251    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:16.347468 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:16.347438    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:18.048845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:18.048808    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:21.200269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:21.200234    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:26.107759 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:26.107721    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:28.121948 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:28.121912    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:31.116757 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:31.116656    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:32.157669 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:01:32.157636    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:01:36.988333 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:36.988304    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:40.817761 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:40.817707    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:43.548897 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.548858    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"]
Oct 30 22:01:43.552722 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.552706    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.604703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.604662    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-a7b06b-openshift-default-dockercfg-2f8cv\""
Oct 30 22:01:43.610172 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.610149    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.610235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.610184    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.610235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.610200    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.610349 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.610329    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.610390 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.610378    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.610424 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.610416    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.610529 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.610514    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.610566 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.610546    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhqj9\" (UniqueName: \"kubernetes.io/projected/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-kube-api-access-fhqj9\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.610601 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.610584    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.656293 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.656267    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"]
Oct 30 22:01:43.711253 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.711214    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.711253 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.711251    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.711470 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.711433    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.711534 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.711472    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.711534 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.711507    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.711637 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.711564    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.711637 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.711587    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhqj9\" (UniqueName: \"kubernetes.io/projected/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-kube-api-access-fhqj9\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.711637 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.711623    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.711835 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.711667    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.711835 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.711718    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.711929 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.711896    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.711981 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.711959    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.712112 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.712091    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.712231 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.712213    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.714040 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.714011    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.714184 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.714168    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.771966 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.771940    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.772156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.772136    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhqj9\" (UniqueName: \"kubernetes.io/projected/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-kube-api-access-fhqj9\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:43.865199 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:43.865143    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:44.297122 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:44.297096    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"]
Oct 30 22:01:44.299525 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:01:44.299499    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec6596d8_bdf7_40fc_8836_ebc001f5b55c.slice/crio-a03e64488a8ab18a46e2bdb2841a075bdf11d7e32ac8a3a036eaa22ebd9f5dac WatchSource:0}: Error finding container a03e64488a8ab18a46e2bdb2841a075bdf11d7e32ac8a3a036eaa22ebd9f5dac: Status 404 returned error can't find the container with id a03e64488a8ab18a46e2bdb2841a075bdf11d7e32ac8a3a036eaa22ebd9f5dac
Oct 30 22:01:44.301719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:44.301666    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:01:44.301798 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:44.301749    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:01:44.301798 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:44.301779    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:01:44.880155 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:44.880117    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d" event={"ID":"ec6596d8-bdf7-40fc-8836-ebc001f5b55c","Type":"ContainerStarted","Data":"a7ea6c131b78fd224e77037d1dfeff05da4c48dce5da8d1b25bcec77a34ace2a"}
Oct 30 22:01:44.880573 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:44.880184    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d" event={"ID":"ec6596d8-bdf7-40fc-8836-ebc001f5b55c","Type":"ContainerStarted","Data":"a03e64488a8ab18a46e2bdb2841a075bdf11d7e32ac8a3a036eaa22ebd9f5dac"}
Oct 30 22:01:45.015707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:45.014533    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d" podStartSLOduration=2.014513008 podStartE2EDuration="2.014513008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:45.012992428 +0000 UTC m=+1043.061600134" watchObservedRunningTime="2026-10-30 22:01:45.014513008 +0000 UTC m=+1043.063120706"
Oct 30 22:01:45.825129 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:45.825096    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:45.866145 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:45.866123    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:45.867327 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:45.867304    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 30 22:01:45.867460 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:45.867345    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d" podUID="ec6596d8-bdf7-40fc-8836-ebc001f5b55c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 30 22:01:46.866296 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:46.866255    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 30 22:01:46.866796 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:46.866358    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d" podUID="ec6596d8-bdf7-40fc-8836-ebc001f5b55c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 30 22:01:47.865898 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:47.865864    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 30 22:01:47.866052 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:47.865924    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d" podUID="ec6596d8-bdf7-40fc-8836-ebc001f5b55c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 30 22:01:48.865713 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:48.865652    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 30 22:01:48.866215 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:48.865746    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d" podUID="ec6596d8-bdf7-40fc-8836-ebc001f5b55c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 30 22:01:49.865625 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:49.865587    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 30 22:01:49.865918 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:49.865647    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d" podUID="ec6596d8-bdf7-40fc-8836-ebc001f5b55c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 30 22:01:50.655051 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:50.655011    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:50.971194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:50.971101    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:50.971762 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:50.971731    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:50.972592 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:50.972567    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:01:52.647444 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:52.647407    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:55.712621 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:01:55.712590    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:00.727135 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:00.727098    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:02.157819 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:02:02.157782    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:02:05.633802 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:05.633764    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:09.647767 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:09.647727    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:10.536166 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:10.536123    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:15.528520 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:15.528484    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:18.467315 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:18.467270    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:20.523999 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.523957    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:20.524496 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.524475    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"]
Oct 30 22:02:20.533714 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.533657    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.554906 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.554878    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-dshm\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.555089 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.555062    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-tmp-dir\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.555145 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.555129    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-home\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.555225 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.555190    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8b2t\" (UniqueName: \"kubernetes.io/projected/a3ac5821-d19a-470a-acf7-f3c069268120-kube-api-access-l8b2t\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.555446 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.555425    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-model-cache\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.555520 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.555476    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3ac5821-d19a-470a-acf7-f3c069268120-tls-certs\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.586992 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.586969    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"]
Oct 30 22:02:20.633670 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.633613    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-7df73b\"/\"openshift-service-ca.crt\""
Oct 30 22:02:20.633868 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.633852    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7df73b\"/\"premium-w0-7df73b-kserve-self-signed-certs\""
Oct 30 22:02:20.635511 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.635495    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-7df73b\"/\"kube-root-ca.crt\""
Oct 30 22:02:20.635565 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.635535    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7df73b\"/\"default-dockercfg-l7s95\""
Oct 30 22:02:20.667400 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.667348    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3ac5821-d19a-470a-acf7-f3c069268120-tls-certs\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.667609 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.667417    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-dshm\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.667609 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.667558    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-tmp-dir\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.667609 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.667605    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-home\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.667895 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.667675    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8b2t\" (UniqueName: \"kubernetes.io/projected/a3ac5821-d19a-470a-acf7-f3c069268120-kube-api-access-l8b2t\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.667895 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.667791    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-model-cache\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.669269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.668317    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-model-cache\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.672307 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.672281    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3ac5821-d19a-470a-acf7-f3c069268120-tls-certs\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.677356 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.676578    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-dshm\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.677356 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.676861    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-tmp-dir\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.677356 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.677072    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-home\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.738182 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.738157    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8b2t\" (UniqueName: \"kubernetes.io/projected/a3ac5821-d19a-470a-acf7-f3c069268120-kube-api-access-l8b2t\") pod \"premium-w0-7df73b-kserve-7c7d7b6769-whn59\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") " pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:20.823650 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.823541    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:20.848847 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:20.848827    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:21.283868 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:21.283846    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"]
Oct 30 22:02:21.286081 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:02:21.286056    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3ac5821_d19a_470a_acf7_f3c069268120.slice/crio-93685401ee08ba0f1333d251086fab4c930c15ea13d0f07ee0538ba64848dc30 WatchSource:0}: Error finding container 93685401ee08ba0f1333d251086fab4c930c15ea13d0f07ee0538ba64848dc30: Status 404 returned error can't find the container with id 93685401ee08ba0f1333d251086fab4c930c15ea13d0f07ee0538ba64848dc30
Oct 30 22:02:22.178299 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:22.178264    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" event={"ID":"a3ac5821-d19a-470a-acf7-f3c069268120","Type":"ContainerStarted","Data":"6b1dcde49e1e04725dd4ad5b2d49f8f8b335f2607f7bc01cc4bf792b752af6ed"}
Oct 30 22:02:22.178759 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:22.178307    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" event={"ID":"a3ac5821-d19a-470a-acf7-f3c069268120","Type":"ContainerStarted","Data":"93685401ee08ba0f1333d251086fab4c930c15ea13d0f07ee0538ba64848dc30"}
Oct 30 22:02:22.295434 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:22.295386    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podStartSLOduration=2.295371309 podStartE2EDuration="2.295371309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:02:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:02:22.294294189 +0000 UTC m=+1080.342901883" watchObservedRunningTime="2026-10-30 22:02:22.295371309 +0000 UTC m=+1080.343979003"
Oct 30 22:02:22.849646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:22.849622    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:25.415953 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:25.415893    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:27.086370 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:27.086333    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:27.410959 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:27.410926    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:30.376101 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:30.376069    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:30.849193 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:30.849163    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:30.861608 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:30.861579    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:31.235130 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:31.235101    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:02:32.158435 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:02:32.158398    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:02:35.250620 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:35.250568    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:40.171589 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:40.171534    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:44.968312 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:44.968276    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:49.844285 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:49.844250    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:54.671232 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:54.671186    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:59.526949 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:02:59.526912    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:02.158715 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:03:02.158610    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:03:04.553580 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:03:04.553546    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:09.454336 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:03:09.454302    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:14.351173 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:03:14.351140    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:18.836239 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:03:18.836197    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:19.386026 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:03:19.385975    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:24.347674 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:03:24.347638    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:29.152645 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:03:29.152606    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:32.157586 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:03:32.157550    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:03:34.054555 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:03:34.054520    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:38.915936 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:03:38.915904    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:43.789181 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:03:43.789141    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:48.926120 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:03:48.926067    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:53.453043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:03:53.453013    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:58.184887 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:03:58.184851    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:02.158957 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:04:02.158909    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:04:03.176269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:03.176235    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:05.908553 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:05.908525    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"]
Oct 30 22:04:05.914296 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:05.914266    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:05.954934 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:05.954878    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-home\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:05.955113 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:05.954974    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9b08f22-10ad-497e-bac2-8ff8156131d5-tls-certs\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:05.955188 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:05.955164    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr5mh\" (UniqueName: \"kubernetes.io/projected/e9b08f22-10ad-497e-bac2-8ff8156131d5-kube-api-access-rr5mh\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:05.955252 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:05.955211    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-dshm\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:05.955308 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:05.955274    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-tmp-dir\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:05.955457 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:05.955439    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-model-cache\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:06.017142 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.017108    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7df73b\"/\"distinct-w0-7df73b-kserve-self-signed-certs\""
Oct 30 22:04:06.019405 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.019382    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"]
Oct 30 22:04:06.060065 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.059530    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-model-cache\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:06.060315 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.060296    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-home\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:06.060455 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.060439    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9b08f22-10ad-497e-bac2-8ff8156131d5-tls-certs\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:06.060669 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.060643    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr5mh\" (UniqueName: \"kubernetes.io/projected/e9b08f22-10ad-497e-bac2-8ff8156131d5-kube-api-access-rr5mh\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:06.060808 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.060709    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-dshm\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:06.060808 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.060732    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-tmp-dir\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:06.068726 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.061147    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-tmp-dir\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:06.070096 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.060031    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-model-cache\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:06.070096 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.070037    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-home\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:06.072187 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.072164    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-dshm\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:06.110393 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.108601    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9b08f22-10ad-497e-bac2-8ff8156131d5-tls-certs\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:06.113103 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.113073    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:06.129880 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.129848    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr5mh\" (UniqueName: \"kubernetes.io/projected/e9b08f22-10ad-497e-bac2-8ff8156131d5-kube-api-access-rr5mh\") pod \"distinct-w0-7df73b-kserve-666cf8f844-qnflb\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:06.229022 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.228937    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:06.662367 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.662339    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"]
Oct 30 22:04:06.664546 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:04:06.664518    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9b08f22_10ad_497e_bac2_8ff8156131d5.slice/crio-f8fdf04a6c1be8c6aab31237202703f35032c732e7a2c3636ee8600b1d861e68 WatchSource:0}: Error finding container f8fdf04a6c1be8c6aab31237202703f35032c732e7a2c3636ee8600b1d861e68: Status 404 returned error can't find the container with id f8fdf04a6c1be8c6aab31237202703f35032c732e7a2c3636ee8600b1d861e68
Oct 30 22:04:06.815030 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.814993    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" event={"ID":"e9b08f22-10ad-497e-bac2-8ff8156131d5","Type":"ContainerStarted","Data":"4958a28e97af074ce1ef8334f1487e0a16592688fefbdcb28b309e084ba9bba5"}
Oct 30 22:04:06.815195 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.815040    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" event={"ID":"e9b08f22-10ad-497e-bac2-8ff8156131d5","Type":"ContainerStarted","Data":"f8fdf04a6c1be8c6aab31237202703f35032c732e7a2c3636ee8600b1d861e68"}
Oct 30 22:04:06.932315 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:06.932099    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podStartSLOduration=1.932081648 podStartE2EDuration="1.932081648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:04:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:04:06.930644495 +0000 UTC m=+1184.979252191" watchObservedRunningTime="2026-10-30 22:04:06.932081648 +0000 UTC m=+1184.980689343"
Oct 30 22:04:07.229848 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:07.229768    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:08.195471 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:08.195438    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:13.068792 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:13.068743    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:14.072228 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.072193    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"]
Oct 30 22:04:14.076601 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.076584    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.164998 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.164974    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.165139 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.165007    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.165139 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.165108    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6363579-8652-4079-b4b7-252ff83d1a33-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.165271 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.165152    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.165271 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.165217    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6363579-8652-4079-b4b7-252ff83d1a33-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.165271 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.165252    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.165405 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.165314    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.165405 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.165396    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvwtr\" (UniqueName: \"kubernetes.io/projected/d6363579-8652-4079-b4b7-252ff83d1a33-kube-api-access-tvwtr\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.165511 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.165422    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6363579-8652-4079-b4b7-252ff83d1a33-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.174795 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.174771    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"]
Oct 30 22:04:14.266207 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.266180    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6363579-8652-4079-b4b7-252ff83d1a33-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.266332 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.266211    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.266332 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.266239    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6363579-8652-4079-b4b7-252ff83d1a33-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.266332 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.266268    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.266332 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.266309    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.266532 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.266361    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvwtr\" (UniqueName: \"kubernetes.io/projected/d6363579-8652-4079-b4b7-252ff83d1a33-kube-api-access-tvwtr\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.266532 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.266379    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6363579-8652-4079-b4b7-252ff83d1a33-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.266532 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.266458    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.266532 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.266495    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.266757 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.266666    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.266808 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.266765    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.267009 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.266986    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.267100 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.267049    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.267250 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.267232    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6363579-8652-4079-b4b7-252ff83d1a33-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.269385 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.269364    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.269558 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.269538    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6363579-8652-4079-b4b7-252ff83d1a33-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.327128 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.327059    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvwtr\" (UniqueName: \"kubernetes.io/projected/d6363579-8652-4079-b4b7-252ff83d1a33-kube-api-access-tvwtr\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.327387 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.327369    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6363579-8652-4079-b4b7-252ff83d1a33-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.390675 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.390647    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:14.824467 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.824442    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"]
Oct 30 22:04:14.826573 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:04:14.826541    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6363579_8652_4079_b4b7_252ff83d1a33.slice/crio-40d005854ea42e90bf7e52507aae39ad0a2d0a1158ba06e0cbef346870993531 WatchSource:0}: Error finding container 40d005854ea42e90bf7e52507aae39ad0a2d0a1158ba06e0cbef346870993531: Status 404 returned error can't find the container with id 40d005854ea42e90bf7e52507aae39ad0a2d0a1158ba06e0cbef346870993531
Oct 30 22:04:14.829246 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.829215    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:04:14.829328 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.829289    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:04:14.829328 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.829322    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:04:14.863357 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.862963    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z" event={"ID":"d6363579-8652-4079-b4b7-252ff83d1a33","Type":"ContainerStarted","Data":"40d005854ea42e90bf7e52507aae39ad0a2d0a1158ba06e0cbef346870993531"}
Oct 30 22:04:14.989395 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.989362    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"]
Oct 30 22:04:14.989602 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.989574    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7" podUID="52eecdf8-4440-473e-8281-bc1f46457178" containerName="istio-proxy" containerID="cri-o://fda5dac92e3a1483083b557c2594651a0d2b022e5e89858319e97bf762ceef3c" gracePeriod=30
Oct 30 22:04:14.992018 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.991993    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"]
Oct 30 22:04:14.992225 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:14.992202    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc" podUID="2595e4a7-d998-437d-b5e5-761a943f1b48" containerName="istio-proxy" containerID="cri-o://34d6365e0535aca1553c4b6d800c2d954bbe106bd02cb47c693709d5f665a92a" gracePeriod=30
Oct 30 22:04:15.870080 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:15.870039    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z" event={"ID":"d6363579-8652-4079-b4b7-252ff83d1a33","Type":"ContainerStarted","Data":"ac1b8fbee7e5a3f44c7159192b3b53a5d62a57246dd45f35951ad7d8634814af"}
Oct 30 22:04:15.991091 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:15.991046    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z" podStartSLOduration=1.991031945 podStartE2EDuration="1.991031945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:04:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:04:15.989550278 +0000 UTC m=+1194.038157975" watchObservedRunningTime="2026-10-30 22:04:15.991031945 +0000 UTC m=+1194.039639640"
Oct 30 22:04:16.229481 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:16.229447    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:16.243194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:16.243158    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:16.390854 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:16.390815    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:16.392388 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:16.392363    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 30 22:04:16.392526 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:16.392418    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z" podUID="d6363579-8652-4079-b4b7-252ff83d1a33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 30 22:04:16.887099 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:16.887069    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:04:17.391385 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:17.391347    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 30 22:04:17.391565 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:17.391425    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z" podUID="d6363579-8652-4079-b4b7-252ff83d1a33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 30 22:04:17.914710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:17.906760    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:18.391407 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:18.391370    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 30 22:04:18.391605 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:18.391432    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z" podUID="d6363579-8652-4079-b4b7-252ff83d1a33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 30 22:04:19.178543 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:19.178502    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:19.391859 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:19.391824    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 30 22:04:19.392053 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:19.391885    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z" podUID="d6363579-8652-4079-b4b7-252ff83d1a33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 30 22:04:20.337336 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.337068    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 22:04:20.381261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.381236    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 22:04:20.391951 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.391929    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Oct 30 22:04:20.392034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.391974    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z" podUID="d6363579-8652-4079-b4b7-252ff83d1a33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Oct 30 22:04:20.456232 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.456198    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2595e4a7-d998-437d-b5e5-761a943f1b48-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2595e4a7-d998-437d-b5e5-761a943f1b48-istiod-ca-cert\") pod \"2595e4a7-d998-437d-b5e5-761a943f1b48\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") "
Oct 30 22:04:20.456368 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.456245    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2595e4a7-d998-437d-b5e5-761a943f1b48-kube-api-access-qtsmd\" (UniqueName: \"kubernetes.io/projected/2595e4a7-d998-437d-b5e5-761a943f1b48-kube-api-access-qtsmd\") pod \"2595e4a7-d998-437d-b5e5-761a943f1b48\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") "
Oct 30 22:04:20.456368 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.456312    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-data\") pod \"2595e4a7-d998-437d-b5e5-761a943f1b48\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") "
Oct 30 22:04:20.456481 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.456387    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-envoy\") pod \"2595e4a7-d998-437d-b5e5-761a943f1b48\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") "
Oct 30 22:04:20.456481 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.456424    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-credential-socket\") pod \"2595e4a7-d998-437d-b5e5-761a943f1b48\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") "
Oct 30 22:04:20.456588 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.456486    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-workload-socket\") pod \"2595e4a7-d998-437d-b5e5-761a943f1b48\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") "
Oct 30 22:04:20.456588 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.456528    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-workload-certs\") pod \"2595e4a7-d998-437d-b5e5-761a943f1b48\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") "
Oct 30 22:04:20.456588 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.456561    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-token\" (UniqueName: \"kubernetes.io/projected/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-token\") pod \"2595e4a7-d998-437d-b5e5-761a943f1b48\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") "
Oct 30 22:04:20.456782 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.456583    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-data" pod "2595e4a7-d998-437d-b5e5-761a943f1b48" (UID: "2595e4a7-d998-437d-b5e5-761a943f1b48"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:20.456782 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.456628    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2595e4a7-d998-437d-b5e5-761a943f1b48-istiod-ca-cert" pod "2595e4a7-d998-437d-b5e5-761a943f1b48" (UID: "2595e4a7-d998-437d-b5e5-761a943f1b48"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:04:20.456782 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.456652    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-podinfo\") pod \"2595e4a7-d998-437d-b5e5-761a943f1b48\" (UID: \"2595e4a7-d998-437d-b5e5-761a943f1b48\") "
Oct 30 22:04:20.456941 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.456798    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-workload-socket" pod "2595e4a7-d998-437d-b5e5-761a943f1b48" (UID: "2595e4a7-d998-437d-b5e5-761a943f1b48"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:20.456941 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.456789    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-credential-socket" pod "2595e4a7-d998-437d-b5e5-761a943f1b48" (UID: "2595e4a7-d998-437d-b5e5-761a943f1b48"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:20.456941 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.456875    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-workload-certs" pod "2595e4a7-d998-437d-b5e5-761a943f1b48" (UID: "2595e4a7-d998-437d-b5e5-761a943f1b48"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:20.457257 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.457147    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.457257 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.457170    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.457257 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.457186    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2595e4a7-d998-437d-b5e5-761a943f1b48-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.457257 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.457199    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.457257 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.457215    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.458710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.458655    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2595e4a7-d998-437d-b5e5-761a943f1b48-kube-api-access-qtsmd" pod "2595e4a7-d998-437d-b5e5-761a943f1b48" (UID: "2595e4a7-d998-437d-b5e5-761a943f1b48"). InnerVolumeSpecName "kube-api-access-qtsmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:04:20.458819 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.458720    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-envoy" pod "2595e4a7-d998-437d-b5e5-761a943f1b48" (UID: "2595e4a7-d998-437d-b5e5-761a943f1b48"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:20.458872 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.458848    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-token" pod "2595e4a7-d998-437d-b5e5-761a943f1b48" (UID: "2595e4a7-d998-437d-b5e5-761a943f1b48"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:04:20.459031 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.458998    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-podinfo" pod "2595e4a7-d998-437d-b5e5-761a943f1b48" (UID: "2595e4a7-d998-437d-b5e5-761a943f1b48"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:04:20.558662 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.558571    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-workload-certs\") pod \"52eecdf8-4440-473e-8281-bc1f46457178\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") "
Oct 30 22:04:20.558662 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.558646    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/52eecdf8-4440-473e-8281-bc1f46457178-kube-api-access-zhz29\" (UniqueName: \"kubernetes.io/projected/52eecdf8-4440-473e-8281-bc1f46457178-kube-api-access-zhz29\") pod \"52eecdf8-4440-473e-8281-bc1f46457178\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") "
Oct 30 22:04:20.558911 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.558724    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/52eecdf8-4440-473e-8281-bc1f46457178-istio-token\" (UniqueName: \"kubernetes.io/projected/52eecdf8-4440-473e-8281-bc1f46457178-istio-token\") pod \"52eecdf8-4440-473e-8281-bc1f46457178\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") "
Oct 30 22:04:20.558911 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.558756    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-credential-socket\") pod \"52eecdf8-4440-473e-8281-bc1f46457178\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") "
Oct 30 22:04:20.558911 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.558814    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-workload-socket\") pod \"52eecdf8-4440-473e-8281-bc1f46457178\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") "
Oct 30 22:04:20.558911 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.558854    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/52eecdf8-4440-473e-8281-bc1f46457178-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52eecdf8-4440-473e-8281-bc1f46457178-istiod-ca-cert\") pod \"52eecdf8-4440-473e-8281-bc1f46457178\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") "
Oct 30 22:04:20.558911 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.558898    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-istio-data\") pod \"52eecdf8-4440-473e-8281-bc1f46457178\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") "
Oct 30 22:04:20.559150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.558936    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-istio-envoy\") pod \"52eecdf8-4440-473e-8281-bc1f46457178\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") "
Oct 30 22:04:20.559150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.559008    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/52eecdf8-4440-473e-8281-bc1f46457178-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52eecdf8-4440-473e-8281-bc1f46457178-istio-podinfo\") pod \"52eecdf8-4440-473e-8281-bc1f46457178\" (UID: \"52eecdf8-4440-473e-8281-bc1f46457178\") "
Oct 30 22:04:20.559734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.559453    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.559734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.559481    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.559734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.559496    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2595e4a7-d998-437d-b5e5-761a943f1b48-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.559734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.559510    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtsmd\" (UniqueName: \"kubernetes.io/projected/2595e4a7-d998-437d-b5e5-761a943f1b48-kube-api-access-qtsmd\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.559734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.559525    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-credential-socket" pod "52eecdf8-4440-473e-8281-bc1f46457178" (UID: "52eecdf8-4440-473e-8281-bc1f46457178"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:20.560063 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.559751    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-workload-certs" pod "52eecdf8-4440-473e-8281-bc1f46457178" (UID: "52eecdf8-4440-473e-8281-bc1f46457178"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:20.560063 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.559861    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52eecdf8-4440-473e-8281-bc1f46457178-istiod-ca-cert" pod "52eecdf8-4440-473e-8281-bc1f46457178" (UID: "52eecdf8-4440-473e-8281-bc1f46457178"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:04:20.560063 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.560039    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-istio-data" pod "52eecdf8-4440-473e-8281-bc1f46457178" (UID: "52eecdf8-4440-473e-8281-bc1f46457178"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:20.561051 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.561009    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-workload-socket" pod "52eecdf8-4440-473e-8281-bc1f46457178" (UID: "52eecdf8-4440-473e-8281-bc1f46457178"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:20.563364 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.563342    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-istio-envoy" pod "52eecdf8-4440-473e-8281-bc1f46457178" (UID: "52eecdf8-4440-473e-8281-bc1f46457178"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:20.563529 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.563495    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52eecdf8-4440-473e-8281-bc1f46457178-kube-api-access-zhz29" pod "52eecdf8-4440-473e-8281-bc1f46457178" (UID: "52eecdf8-4440-473e-8281-bc1f46457178"). InnerVolumeSpecName "kube-api-access-zhz29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:04:20.563633 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.563614    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52eecdf8-4440-473e-8281-bc1f46457178-istio-token" pod "52eecdf8-4440-473e-8281-bc1f46457178" (UID: "52eecdf8-4440-473e-8281-bc1f46457178"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:04:20.564987 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.564966    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/52eecdf8-4440-473e-8281-bc1f46457178-istio-podinfo" pod "52eecdf8-4440-473e-8281-bc1f46457178" (UID: "52eecdf8-4440-473e-8281-bc1f46457178"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:04:20.660776 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.660741    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52eecdf8-4440-473e-8281-bc1f46457178-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.660776 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.660770    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.660990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.660785    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhz29\" (UniqueName: \"kubernetes.io/projected/52eecdf8-4440-473e-8281-bc1f46457178-kube-api-access-zhz29\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.660990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.660799    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52eecdf8-4440-473e-8281-bc1f46457178-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.660990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.660811    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.660990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.660822    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.660990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.660834    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52eecdf8-4440-473e-8281-bc1f46457178-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.660990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.660846    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.660990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.660858    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52eecdf8-4440-473e-8281-bc1f46457178-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:20.907850 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.907814    4918 generic.go:356] "Generic (PLEG): container finished" podID="2595e4a7-d998-437d-b5e5-761a943f1b48" containerID="34d6365e0535aca1553c4b6d800c2d954bbe106bd02cb47c693709d5f665a92a" exitCode=0
Oct 30 22:04:20.908034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.907882    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"
Oct 30 22:04:20.908034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.907898    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc" event={"ID":"2595e4a7-d998-437d-b5e5-761a943f1b48","Type":"ContainerDied","Data":"34d6365e0535aca1553c4b6d800c2d954bbe106bd02cb47c693709d5f665a92a"}
Oct 30 22:04:20.908034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.907955    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc" event={"ID":"2595e4a7-d998-437d-b5e5-761a943f1b48","Type":"ContainerDied","Data":"351d160ca5bdbece3c800f5d37d38debfe7e8a02202698e54852ae88496e9561"}
Oct 30 22:04:20.908034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.907981    4918 scope.go:122] "RemoveContainer" containerID="34d6365e0535aca1553c4b6d800c2d954bbe106bd02cb47c693709d5f665a92a"
Oct 30 22:04:20.909475 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.909445    4918 generic.go:356] "Generic (PLEG): container finished" podID="52eecdf8-4440-473e-8281-bc1f46457178" containerID="fda5dac92e3a1483083b557c2594651a0d2b022e5e89858319e97bf762ceef3c" exitCode=0
Oct 30 22:04:20.909574 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.909501    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7" event={"ID":"52eecdf8-4440-473e-8281-bc1f46457178","Type":"ContainerDied","Data":"fda5dac92e3a1483083b557c2594651a0d2b022e5e89858319e97bf762ceef3c"}
Oct 30 22:04:20.909574 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.909523    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"
Oct 30 22:04:20.909574 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.909542    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7" event={"ID":"52eecdf8-4440-473e-8281-bc1f46457178","Type":"ContainerDied","Data":"c2c584012a37dcf174906d7b16a43a644ef523fd14767e243579194244ffbc3a"}
Oct 30 22:04:20.919248 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.919232    4918 scope.go:122] "RemoveContainer" containerID="34d6365e0535aca1553c4b6d800c2d954bbe106bd02cb47c693709d5f665a92a"
Oct 30 22:04:20.919545 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:04:20.919524    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34d6365e0535aca1553c4b6d800c2d954bbe106bd02cb47c693709d5f665a92a\": container with ID starting with 34d6365e0535aca1553c4b6d800c2d954bbe106bd02cb47c693709d5f665a92a not found: ID does not exist" containerID="34d6365e0535aca1553c4b6d800c2d954bbe106bd02cb47c693709d5f665a92a"
Oct 30 22:04:20.919644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.919553    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34d6365e0535aca1553c4b6d800c2d954bbe106bd02cb47c693709d5f665a92a"} err="failed to get container status \"34d6365e0535aca1553c4b6d800c2d954bbe106bd02cb47c693709d5f665a92a\": rpc error: code = NotFound desc = could not find container \"34d6365e0535aca1553c4b6d800c2d954bbe106bd02cb47c693709d5f665a92a\": container with ID starting with 34d6365e0535aca1553c4b6d800c2d954bbe106bd02cb47c693709d5f665a92a not found: ID does not exist"
Oct 30 22:04:20.919644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.919575    4918 scope.go:122] "RemoveContainer" containerID="fda5dac92e3a1483083b557c2594651a0d2b022e5e89858319e97bf762ceef3c"
Oct 30 22:04:20.933601 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.933566    4918 scope.go:122] "RemoveContainer" containerID="fda5dac92e3a1483083b557c2594651a0d2b022e5e89858319e97bf762ceef3c"
Oct 30 22:04:20.933877 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:04:20.933851    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fda5dac92e3a1483083b557c2594651a0d2b022e5e89858319e97bf762ceef3c\": container with ID starting with fda5dac92e3a1483083b557c2594651a0d2b022e5e89858319e97bf762ceef3c not found: ID does not exist" containerID="fda5dac92e3a1483083b557c2594651a0d2b022e5e89858319e97bf762ceef3c"
Oct 30 22:04:20.933979 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:20.933881    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda5dac92e3a1483083b557c2594651a0d2b022e5e89858319e97bf762ceef3c"} err="failed to get container status \"fda5dac92e3a1483083b557c2594651a0d2b022e5e89858319e97bf762ceef3c\": rpc error: code = NotFound desc = could not find container \"fda5dac92e3a1483083b557c2594651a0d2b022e5e89858319e97bf762ceef3c\": container with ID starting with fda5dac92e3a1483083b557c2594651a0d2b022e5e89858319e97bf762ceef3c not found: ID does not exist"
Oct 30 22:04:21.096934 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:21.096898    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"]
Oct 30 22:04:21.101389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:21.101363    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b5pbc"]
Oct 30 22:04:21.214098 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:21.214020    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"]
Oct 30 22:04:21.218395 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:21.218371    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4s5w7"]
Oct 30 22:04:21.572753 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:21.572645    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:21.573331 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:21.573312    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:21.574877 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:21.574854    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:04:22.073714 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:22.073660    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2595e4a7-d998-437d-b5e5-761a943f1b48" path="/var/lib/kubelet/pods/2595e4a7-d998-437d-b5e5-761a943f1b48/volumes"
Oct 30 22:04:22.074137 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:22.074122    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="52eecdf8-4440-473e-8281-bc1f46457178" path="/var/lib/kubelet/pods/52eecdf8-4440-473e-8281-bc1f46457178/volumes"
Oct 30 22:04:22.163451 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:22.163427    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:04:22.182488 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:22.182466    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:04:22.923850 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:22.923819    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:28.521720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:28.521653    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:32.157486 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:04:32.157398    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:04:32.966557 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:32.966529    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:33.264933 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:33.264843    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:33.518756 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:33.518656    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:38.391864 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.391828    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:38.816893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.816821    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"]
Oct 30 22:04:38.817330 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.817317    4918 cpu_manager.go:414] "containerMap: removing container" podUID="52eecdf8-4440-473e-8281-bc1f46457178" containerName="istio-proxy"
Oct 30 22:04:38.817376 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.817332    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="52eecdf8-4440-473e-8281-bc1f46457178" containerName="istio-proxy"
Oct 30 22:04:38.817376 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.817345    4918 cpu_manager.go:414] "containerMap: removing container" podUID="2595e4a7-d998-437d-b5e5-761a943f1b48" containerName="istio-proxy"
Oct 30 22:04:38.817376 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.817350    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2595e4a7-d998-437d-b5e5-761a943f1b48" containerName="istio-proxy"
Oct 30 22:04:38.817465 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.817417    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="52eecdf8-4440-473e-8281-bc1f46457178" containerName="istio-proxy"
Oct 30 22:04:38.817465 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.817425    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="2595e4a7-d998-437d-b5e5-761a943f1b48" containerName="istio-proxy"
Oct 30 22:04:38.820581 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.820566    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.872013 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.871987    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrlfs\" (UniqueName: \"kubernetes.io/projected/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-kube-api-access-wrlfs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.872145 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.872051    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.872145 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.872110    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.872237 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.872143    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.872237 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.872201    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.872319 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.872238    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.872319 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.872306    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.872382 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.872358    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.872428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.872404    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.872805 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.872786    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-bf7cbf-openshift-default-dockercfg-7rlzz\""
Oct 30 22:04:38.924377 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.924351    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"]
Oct 30 22:04:38.973433 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.973406    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.973582 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.973438    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.973582 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.973458    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.973753 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.973593    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.973753 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.973653    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.973753 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.973712    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.973917 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.973760    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.973917 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.973792    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.973917 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.973885    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrlfs\" (UniqueName: \"kubernetes.io/projected/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-kube-api-access-wrlfs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.973917 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.973909    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.974135 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.974109    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.974204 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.974181    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.974278 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.974256    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.974328 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.974257    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.976128 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.976099    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:38.976264 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:38.976246    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:39.034434 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:39.034411    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:39.034575 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:39.034556    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrlfs\" (UniqueName: \"kubernetes.io/projected/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-kube-api-access-wrlfs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:39.133475 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:39.133412    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:39.564230 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:39.564207    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"]
Oct 30 22:04:39.566753 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:04:39.566725    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e40f78c_3818_40fc_b6c6_f9672b66e2dd.slice/crio-718af2d1bbfb654b4a4a0ebcc7fef07ab5b5b52180260325aff38e189e51d6d4 WatchSource:0}: Error finding container 718af2d1bbfb654b4a4a0ebcc7fef07ab5b5b52180260325aff38e189e51d6d4: Status 404 returned error can't find the container with id 718af2d1bbfb654b4a4a0ebcc7fef07ab5b5b52180260325aff38e189e51d6d4
Oct 30 22:04:39.569112 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:39.569079    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:04:39.569191 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:39.569147    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:04:39.569191 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:39.569176    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:04:40.053331 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:40.053292    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9" event={"ID":"4e40f78c-3818-40fc-b6c6-f9672b66e2dd","Type":"ContainerStarted","Data":"d9dff843cb77687ed62c7bacb6a4ae06dc647f2b3445e352695a952baefd2001"}
Oct 30 22:04:40.053624 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:40.053604    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9" event={"ID":"4e40f78c-3818-40fc-b6c6-f9672b66e2dd","Type":"ContainerStarted","Data":"718af2d1bbfb654b4a4a0ebcc7fef07ab5b5b52180260325aff38e189e51d6d4"}
Oct 30 22:04:40.134018 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:40.133977    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:40.135511 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:40.135489    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 22:04:40.135573 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:40.135542    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9" podUID="4e40f78c-3818-40fc-b6c6-f9672b66e2dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 22:04:40.240796 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:40.240745    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9" podStartSLOduration=2.240730792 podStartE2EDuration="2.240730792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:04:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:04:40.231722212 +0000 UTC m=+1218.280329908" watchObservedRunningTime="2026-10-30 22:04:40.240730792 +0000 UTC m=+1218.289338486"
Oct 30 22:04:41.133806 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:41.133773    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 22:04:41.134219 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:41.133827    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9" podUID="4e40f78c-3818-40fc-b6c6-f9672b66e2dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 22:04:41.227524 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:41.227484    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:42.134056 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:42.134015    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 22:04:42.134443 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:42.134083    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9" podUID="4e40f78c-3818-40fc-b6c6-f9672b66e2dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 22:04:43.134580 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:43.134548    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 22:04:43.134985 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:43.134613    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9" podUID="4e40f78c-3818-40fc-b6c6-f9672b66e2dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 22:04:43.322311 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:43.322273    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:44.134772 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:44.134736    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 22:04:44.135166 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:44.134788    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9" podUID="4e40f78c-3818-40fc-b6c6-f9672b66e2dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 22:04:44.967044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:44.967009    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"]
Oct 30 22:04:44.970575 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:44.970554    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.033629 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.033598    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"]
Oct 30 22:04:45.070269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.070233    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.070456 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.070290    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.070456 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.070442    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.070622 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.070602    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.070717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.070636    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.070717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.070673    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nch2\" (UniqueName: \"kubernetes.io/projected/2eb6b33c-2a62-4cc6-8190-f920964955b0-kube-api-access-4nch2\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.070874 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.070830    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.070933 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.070920    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.070968 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.070954    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eb6b33c-2a62-4cc6-8190-f920964955b0-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.134799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.134749    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 22:04:45.135195 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.134849    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9" podUID="4e40f78c-3818-40fc-b6c6-f9672b66e2dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 22:04:45.171609 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.171580    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.171780 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.171620    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.171780 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.171652    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.171780 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.171762    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.171984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.171960    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.172045 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.172023    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nch2\" (UniqueName: \"kubernetes.io/projected/2eb6b33c-2a62-4cc6-8190-f920964955b0-kube-api-access-4nch2\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.172099 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.172058    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.172168 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.172145    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.172278 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.172205    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eb6b33c-2a62-4cc6-8190-f920964955b0-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.172278 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.172150    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.172402 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.172381    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.172498 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.172476    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.172807 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.172778    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.172989 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.172969    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eb6b33c-2a62-4cc6-8190-f920964955b0-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.174772 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.174736    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.175132 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.175109    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.232971 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.232876    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.233116 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.232976    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nch2\" (UniqueName: \"kubernetes.io/projected/2eb6b33c-2a62-4cc6-8190-f920964955b0-kube-api-access-4nch2\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.283051 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.283020    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:45.801033 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.792889    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"]
Oct 30 22:04:45.827998 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.817224    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:04:45.827998 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.817346    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:04:45.827998 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:45.817391    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:04:46.090815 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:46.089331    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk" event={"ID":"2eb6b33c-2a62-4cc6-8190-f920964955b0","Type":"ContainerStarted","Data":"8ed0b7864a7932580bf8ab1e55700900fd8b1da8d3a4a69fa2afc18335d15157"}
Oct 30 22:04:46.090815 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:46.089401    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk" event={"ID":"2eb6b33c-2a62-4cc6-8190-f920964955b0","Type":"ContainerStarted","Data":"04c322a620ad537f2a4e7501a618e72aa20c142bfdd234a5a9aa06dadb6806c1"}
Oct 30 22:04:46.133973 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:46.133939    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Oct 30 22:04:46.134149 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:46.134000    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9" podUID="4e40f78c-3818-40fc-b6c6-f9672b66e2dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Oct 30 22:04:46.244707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:46.244557    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:46.287296 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:46.287265    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:46.288316 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:46.288292    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:04:46.288540 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:46.288516    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk" podUID="2eb6b33c-2a62-4cc6-8190-f920964955b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 22:04:46.556145 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:46.556099    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:47.283759 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:47.283728    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:04:47.284160 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:47.283777    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk" podUID="2eb6b33c-2a62-4cc6-8190-f920964955b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 22:04:47.345489 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:47.345458    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:47.346240 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:47.346205    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:47.347227 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:47.347208    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:04:47.513266 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:47.513171    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk" podStartSLOduration=3.513150381 podStartE2EDuration="3.513150381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:04:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:04:46.214574269 +0000 UTC m=+1224.263181960" watchObservedRunningTime="2026-10-30 22:04:47.513150381 +0000 UTC m=+1225.561758079"
Oct 30 22:04:48.257462 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:48.257425    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:48.283593 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:48.283559    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:04:48.283765 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:48.283628    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk" podUID="2eb6b33c-2a62-4cc6-8190-f920964955b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 22:04:49.283756 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:49.283720    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:04:49.284165 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:49.283774    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk" podUID="2eb6b33c-2a62-4cc6-8190-f920964955b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 22:04:50.283994 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:50.283964    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:04:50.284374 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:50.284022    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk" podUID="2eb6b33c-2a62-4cc6-8190-f920964955b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 22:04:51.284319 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:51.284284    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:04:51.284764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:51.284334    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk" podUID="2eb6b33c-2a62-4cc6-8190-f920964955b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 22:04:52.283818 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:52.283782    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Oct 30 22:04:52.284017 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:52.283845    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk" podUID="2eb6b33c-2a62-4cc6-8190-f920964955b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Oct 30 22:04:53.131789 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:53.131747    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:53.288721 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:53.288674    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:53.289018 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:53.288994    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:53.289740 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:53.289724    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:04:57.282858 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:57.282820    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:58.046039 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:04:58.045994    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:02.158553 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:05:02.158514    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:05:02.172396 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:02.172331    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:03.957364 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:03.957319    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:08.042840 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:08.042808    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:12.948603 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:12.948560    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:17.740005 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:17.739962    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:19.179694 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:19.179638    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:19.532245 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:19.532157    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:22.533971 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:22.533929    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:26.316427 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.316390    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"]
Oct 30 22:05:26.322893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.322868    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.423590 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.423557    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"]
Oct 30 22:05:26.424984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.424276    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.424984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.424324    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js5hq\" (UniqueName: \"kubernetes.io/projected/0a926b1b-b3d0-4e0b-9198-e5479766f1db-kube-api-access-js5hq\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.424984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.424398    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.424984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.424427    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.424984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.424552    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.424984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.424581    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.424984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.424645    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.424984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.424706    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.424984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.424735    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.558706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.533283    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.622787 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.559200    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.628350 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.628315    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.628668 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.628646    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.629380 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.629349    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.630107 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.630086    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.632870 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.632539    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.640505 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.640475    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.640917 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.640894    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.648834 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.648749    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js5hq\" (UniqueName: \"kubernetes.io/projected/0a926b1b-b3d0-4e0b-9198-e5479766f1db-kube-api-access-js5hq\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.649070 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.649051    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.671068 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.671035    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.671376 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.662201    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.671504 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.649668    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.671987 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.671964    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.684757 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.684134    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.715929 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.715870    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.757394 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.756706    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js5hq\" (UniqueName: \"kubernetes.io/projected/0a926b1b-b3d0-4e0b-9198-e5479766f1db-kube-api-access-js5hq\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-jfl8h\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:26.940902 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:26.940860    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:27.389034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:27.388944    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"]
Oct 30 22:05:27.416120 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:27.416087    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:05:27.416264 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:27.416156    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:05:27.416264 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:27.416193    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:05:27.454525 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:27.454493    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:28.381331 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:28.381298    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h" event={"ID":"0a926b1b-b3d0-4e0b-9198-e5479766f1db","Type":"ContainerStarted","Data":"a3e5b4d38cd481314ee8003ac60d050b0d739f64549045b27759bd41dfc83b35"}
Oct 30 22:05:28.381485 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:28.381351    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h" event={"ID":"0a926b1b-b3d0-4e0b-9198-e5479766f1db","Type":"ContainerStarted","Data":"c077b0790cb0f84d44d39b10f174096ae0d6a20bf5a272deba20b51bdeea7d6e"}
Oct 30 22:05:28.612713 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:28.610077    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h" podStartSLOduration=2.610053539 podStartE2EDuration="2.610053539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:28.554826283 +0000 UTC m=+1266.603433977" watchObservedRunningTime="2026-10-30 22:05:28.610053539 +0000 UTC m=+1266.658661237"
Oct 30 22:05:28.941161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:28.941125    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:28.942898 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:28.942877    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:05:28.942973 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:28.942936    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h" podUID="0a926b1b-b3d0-4e0b-9198-e5479766f1db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 22:05:29.941945 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:29.941910    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:05:29.942378 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:29.941980    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h" podUID="0a926b1b-b3d0-4e0b-9198-e5479766f1db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 22:05:30.621092 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:30.621056    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"]
Oct 30 22:05:30.621585 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:30.621553    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln" podUID="8432ea7a-2ead-4570-b028-260fb1361662" containerName="istio-proxy" containerID="cri-o://3aa45f72ef0c80eb7ea2e1438d1ea4b8d13ffbde6be958484cda4e06fedea0e1" gracePeriod=30
Oct 30 22:05:30.942251 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:30.942214    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:05:30.943128 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:30.943086    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h" podUID="0a926b1b-b3d0-4e0b-9198-e5479766f1db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 22:05:31.006710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:30.992830    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:31.941449 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:31.941416    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:05:31.941668 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:31.941469    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h" podUID="0a926b1b-b3d0-4e0b-9198-e5479766f1db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 22:05:32.189939 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:05:32.189897    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:05:32.373196 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:32.373100    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:32.941859 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:32.941825    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:05:32.942041 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:32.941878    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h" podUID="0a926b1b-b3d0-4e0b-9198-e5479766f1db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 22:05:33.941243 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:33.941203    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 30 22:05:33.941651 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:33.941275    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h" podUID="0a926b1b-b3d0-4e0b-9198-e5479766f1db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 30 22:05:34.946093 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:34.946028    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:34.946628 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:34.946528    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:34.947278 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:34.947254    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:05:35.884302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:35.884272    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 22:05:36.032203 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.032176    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-workload-socket\") pod \"8432ea7a-2ead-4570-b028-260fb1361662\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") "
Oct 30 22:05:36.032712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.032219    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8432ea7a-2ead-4570-b028-260fb1361662-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8432ea7a-2ead-4570-b028-260fb1361662-istio-podinfo\") pod \"8432ea7a-2ead-4570-b028-260fb1361662\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") "
Oct 30 22:05:36.032712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.032244    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8432ea7a-2ead-4570-b028-260fb1361662-istio-token\" (UniqueName: \"kubernetes.io/projected/8432ea7a-2ead-4570-b028-260fb1361662-istio-token\") pod \"8432ea7a-2ead-4570-b028-260fb1361662\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") "
Oct 30 22:05:36.032712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.032286    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-istio-data\") pod \"8432ea7a-2ead-4570-b028-260fb1361662\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") "
Oct 30 22:05:36.032712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.032326    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-credential-socket\") pod \"8432ea7a-2ead-4570-b028-260fb1361662\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") "
Oct 30 22:05:36.032712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.032385    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8432ea7a-2ead-4570-b028-260fb1361662-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8432ea7a-2ead-4570-b028-260fb1361662-istiod-ca-cert\") pod \"8432ea7a-2ead-4570-b028-260fb1361662\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") "
Oct 30 22:05:36.032712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.032503    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-workload-socket" pod "8432ea7a-2ead-4570-b028-260fb1361662" (UID: "8432ea7a-2ead-4570-b028-260fb1361662"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:36.032712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.032551    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-workload-certs\") pod \"8432ea7a-2ead-4570-b028-260fb1361662\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") "
Oct 30 22:05:36.032712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.032592    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8432ea7a-2ead-4570-b028-260fb1361662-kube-api-access-7ns29\" (UniqueName: \"kubernetes.io/projected/8432ea7a-2ead-4570-b028-260fb1361662-kube-api-access-7ns29\") pod \"8432ea7a-2ead-4570-b028-260fb1361662\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") "
Oct 30 22:05:36.032712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.032650    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-istio-envoy\") pod \"8432ea7a-2ead-4570-b028-260fb1361662\" (UID: \"8432ea7a-2ead-4570-b028-260fb1361662\") "
Oct 30 22:05:36.032712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.032713    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-istio-data" pod "8432ea7a-2ead-4570-b028-260fb1361662" (UID: "8432ea7a-2ead-4570-b028-260fb1361662"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:36.033435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.032802    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-credential-socket" pod "8432ea7a-2ead-4570-b028-260fb1361662" (UID: "8432ea7a-2ead-4570-b028-260fb1361662"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:36.033435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.033007    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8432ea7a-2ead-4570-b028-260fb1361662-istiod-ca-cert" pod "8432ea7a-2ead-4570-b028-260fb1361662" (UID: "8432ea7a-2ead-4570-b028-260fb1361662"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:05:36.033435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.033185    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:36.033435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.033207    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:36.033435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.033221    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:36.033435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.033235    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8432ea7a-2ead-4570-b028-260fb1361662-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:36.033435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.033287    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-workload-certs" pod "8432ea7a-2ead-4570-b028-260fb1361662" (UID: "8432ea7a-2ead-4570-b028-260fb1361662"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:36.034827 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.034803    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8432ea7a-2ead-4570-b028-260fb1361662-istio-token" pod "8432ea7a-2ead-4570-b028-260fb1361662" (UID: "8432ea7a-2ead-4570-b028-260fb1361662"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:05:36.034970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.034871    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8432ea7a-2ead-4570-b028-260fb1361662-istio-podinfo" pod "8432ea7a-2ead-4570-b028-260fb1361662" (UID: "8432ea7a-2ead-4570-b028-260fb1361662"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:05:36.035400 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.035373    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8432ea7a-2ead-4570-b028-260fb1361662-kube-api-access-7ns29" pod "8432ea7a-2ead-4570-b028-260fb1361662" (UID: "8432ea7a-2ead-4570-b028-260fb1361662"). InnerVolumeSpecName "kube-api-access-7ns29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:05:36.035489 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.035377    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-istio-envoy" pod "8432ea7a-2ead-4570-b028-260fb1361662" (UID: "8432ea7a-2ead-4570-b028-260fb1361662"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:36.134527 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.134497    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8432ea7a-2ead-4570-b028-260fb1361662-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:36.134527 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.134526    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8432ea7a-2ead-4570-b028-260fb1361662-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:36.134674 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.134536    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:36.134674 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.134545    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ns29\" (UniqueName: \"kubernetes.io/projected/8432ea7a-2ead-4570-b028-260fb1361662-kube-api-access-7ns29\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:36.134674 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.134555    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8432ea7a-2ead-4570-b028-260fb1361662-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:36.456031 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.455992    4918 generic.go:356] "Generic (PLEG): container finished" podID="8432ea7a-2ead-4570-b028-260fb1361662" containerID="3aa45f72ef0c80eb7ea2e1438d1ea4b8d13ffbde6be958484cda4e06fedea0e1" exitCode=0
Oct 30 22:05:36.456208 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.456047    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"
Oct 30 22:05:36.456208 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.456075    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln" event={"ID":"8432ea7a-2ead-4570-b028-260fb1361662","Type":"ContainerDied","Data":"3aa45f72ef0c80eb7ea2e1438d1ea4b8d13ffbde6be958484cda4e06fedea0e1"}
Oct 30 22:05:36.456208 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.456141    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln" event={"ID":"8432ea7a-2ead-4570-b028-260fb1361662","Type":"ContainerDied","Data":"3ae12826af4a4d01f74bafb9b1ab2835c3a828a66379c3e3716f70979896098e"}
Oct 30 22:05:36.456208 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.456164    4918 scope.go:122] "RemoveContainer" containerID="3aa45f72ef0c80eb7ea2e1438d1ea4b8d13ffbde6be958484cda4e06fedea0e1"
Oct 30 22:05:36.466249 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.466231    4918 scope.go:122] "RemoveContainer" containerID="3aa45f72ef0c80eb7ea2e1438d1ea4b8d13ffbde6be958484cda4e06fedea0e1"
Oct 30 22:05:36.466515 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:05:36.466494    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aa45f72ef0c80eb7ea2e1438d1ea4b8d13ffbde6be958484cda4e06fedea0e1\": container with ID starting with 3aa45f72ef0c80eb7ea2e1438d1ea4b8d13ffbde6be958484cda4e06fedea0e1 not found: ID does not exist" containerID="3aa45f72ef0c80eb7ea2e1438d1ea4b8d13ffbde6be958484cda4e06fedea0e1"
Oct 30 22:05:36.466585 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.466527    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aa45f72ef0c80eb7ea2e1438d1ea4b8d13ffbde6be958484cda4e06fedea0e1"} err="failed to get container status \"3aa45f72ef0c80eb7ea2e1438d1ea4b8d13ffbde6be958484cda4e06fedea0e1\": rpc error: code = NotFound desc = could not find container \"3aa45f72ef0c80eb7ea2e1438d1ea4b8d13ffbde6be958484cda4e06fedea0e1\": container with ID starting with 3aa45f72ef0c80eb7ea2e1438d1ea4b8d13ffbde6be958484cda4e06fedea0e1 not found: ID does not exist"
Oct 30 22:05:36.519801 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.519775    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"]
Oct 30 22:05:36.520302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.520284    4918 cpu_manager.go:414] "containerMap: removing container" podUID="8432ea7a-2ead-4570-b028-260fb1361662" containerName="istio-proxy"
Oct 30 22:05:36.520387 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.520306    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8432ea7a-2ead-4570-b028-260fb1361662" containerName="istio-proxy"
Oct 30 22:05:36.520477 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.520464    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="8432ea7a-2ead-4570-b028-260fb1361662" containerName="istio-proxy"
Oct 30 22:05:36.524840 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.524824    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.579653 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.579580    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-b2f165\"/\"openshift-service-ca.crt\""
Oct 30 22:05:36.579840 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.579662    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-b2f165\"/\"kube-root-ca.crt\""
Oct 30 22:05:36.579840 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.579783    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b2f165\"/\"distinct-w2-b2f165-kserve-self-signed-certs\""
Oct 30 22:05:36.610980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.610950    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b2f165\"/\"default-dockercfg-dprf7\""
Oct 30 22:05:36.613390 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.613372    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"]
Oct 30 22:05:36.623725 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.623702    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"]
Oct 30 22:05:36.631102 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.631082    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln"]
Oct 30 22:05:36.639515 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.639496    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a80dc71-49e6-42ad-b090-25bb7bcb324f-tls-certs\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.639597 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.639538    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-home\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.639597 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.639562    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xbkm\" (UniqueName: \"kubernetes.io/projected/8a80dc71-49e6-42ad-b090-25bb7bcb324f-kube-api-access-8xbkm\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.639734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.639718    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-tmp-dir\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.639869 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.639851    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-model-cache\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.639958 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.639942    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-dshm\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.740803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.740713    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-model-cache\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.740978 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.740803    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-dshm\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.740978 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.740854    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a80dc71-49e6-42ad-b090-25bb7bcb324f-tls-certs\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.740978 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.740907    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-home\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.740978 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.740942    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xbkm\" (UniqueName: \"kubernetes.io/projected/8a80dc71-49e6-42ad-b090-25bb7bcb324f-kube-api-access-8xbkm\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.741192 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.741012    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-tmp-dir\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.741192 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.741135    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-model-cache\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.741345 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.741316    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-home\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.741462 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.741386    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-tmp-dir\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.743271 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.743247    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-dshm\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.743557 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.743540    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a80dc71-49e6-42ad-b090-25bb7bcb324f-tls-certs\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.788873 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.788840    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:36.801926 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.801899    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xbkm\" (UniqueName: \"kubernetes.io/projected/8a80dc71-49e6-42ad-b090-25bb7bcb324f-kube-api-access-8xbkm\") pod \"distinct-w2-b2f165-kserve-86695fb7dc-nffb7\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.836792 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.836768    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:36.838785 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.838763    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-qclln container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:05:36.838856 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:36.838829    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-qclln" podUID="8432ea7a-2ead-4570-b028-260fb1361662" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:05:37.264325 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:37.264298    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"]
Oct 30 22:05:37.267295 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:05:37.267270    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a80dc71_49e6_42ad_b090_25bb7bcb324f.slice/crio-72d3877f45a9f7e6b790320a86dc5822d1cf81aed1d30bf7e311ceae8f9f6eae WatchSource:0}: Error finding container 72d3877f45a9f7e6b790320a86dc5822d1cf81aed1d30bf7e311ceae8f9f6eae: Status 404 returned error can't find the container with id 72d3877f45a9f7e6b790320a86dc5822d1cf81aed1d30bf7e311ceae8f9f6eae
Oct 30 22:05:37.400518 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:37.400479    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:37.463891 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:37.463854    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" event={"ID":"8a80dc71-49e6-42ad-b090-25bb7bcb324f","Type":"ContainerStarted","Data":"1a474d1fe97424828cc2b112e4b93b9265eff440ff24abbf5d7eba619436e043"}
Oct 30 22:05:37.463891 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:37.463892    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" event={"ID":"8a80dc71-49e6-42ad-b090-25bb7bcb324f","Type":"ContainerStarted","Data":"72d3877f45a9f7e6b790320a86dc5822d1cf81aed1d30bf7e311ceae8f9f6eae"}
Oct 30 22:05:37.581949 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:37.581862    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podStartSLOduration=1.581846674 podStartE2EDuration="1.581846674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:37.579915824 +0000 UTC m=+1275.628523518" watchObservedRunningTime="2026-10-30 22:05:37.581846674 +0000 UTC m=+1275.630454369"
Oct 30 22:05:37.836940 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:37.836870    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:38.073397 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:38.073365    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8432ea7a-2ead-4570-b028-260fb1361662" path="/var/lib/kubelet/pods/8432ea7a-2ead-4570-b028-260fb1361662/volumes"
Oct 30 22:05:42.339492 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:42.339458    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:46.837925 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:46.837894    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:46.850504 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:46.850479    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:47.378804 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:47.378767    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:47.536414 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:47.536380    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:05:52.129776 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:52.129728    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:55.629509 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.629474    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"]
Oct 30 22:05:55.634591 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.634572    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.738864 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.738828    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7df73b\"/\"distinct-2-w0-7df73b-kserve-self-signed-certs\""
Oct 30 22:05:55.741124 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.741104    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"]
Oct 30 22:05:55.745453 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.745423    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-tmp-dir\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.745564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.745505    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-model-cache\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.745626 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.745559    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce09f1e8-a736-4d77-be12-5f4a45415859-tls-certs\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.745717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.745666    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-home\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.745782 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.745739    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w8js\" (UniqueName: \"kubernetes.io/projected/ce09f1e8-a736-4d77-be12-5f4a45415859-kube-api-access-4w8js\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.745867 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.745851    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-dshm\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.820172 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.820138    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-w7mgr-lq7jp"]
Oct 30 22:05:55.828589 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.828209    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-w7mgr-lq7jp"
Oct 30 22:05:55.831746 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.831390    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:55.846516 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.846486    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-model-cache\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.846653 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.846532    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce09f1e8-a736-4d77-be12-5f4a45415859-tls-certs\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.846653 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.846574    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-home\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.846653 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.846610    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w8js\" (UniqueName: \"kubernetes.io/projected/ce09f1e8-a736-4d77-be12-5f4a45415859-kube-api-access-4w8js\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.846874 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.846795    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-dshm\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.846928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.846902    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-tmp-dir\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.847346 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.847143    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-model-cache\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.847346 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.847253    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-tmp-dir\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.847481 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.847336    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-home\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.848263 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.848240    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-w7mgr-lq7jp"]
Oct 30 22:05:55.849336 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.849310    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-dshm\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.849887 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.849865    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce09f1e8-a736-4d77-be12-5f4a45415859-tls-certs\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.880628 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.880559    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-f7x6x\""
Oct 30 22:05:55.907745 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.907727    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w8js\" (UniqueName: \"kubernetes.io/projected/ce09f1e8-a736-4d77-be12-5f4a45415859-kube-api-access-4w8js\") pod \"distinct-2-w0-7df73b-kserve-849784d559-6vj42\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") " pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.947134 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.947112    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:55.947652 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.947626    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c797f253-d4c7-4754-95eb-524cd7fc7c35-service-ca-bundle\") pod \"periodic-gathering-w7mgr-lq7jp\" (UID: \"c797f253-d4c7-4754-95eb-524cd7fc7c35\") " pod="openshift-insights/periodic-gathering-w7mgr-lq7jp"
Oct 30 22:05:55.947786 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.947768    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpp2z\" (UniqueName: \"kubernetes.io/projected/c797f253-d4c7-4754-95eb-524cd7fc7c35-kube-api-access-zpp2z\") pod \"periodic-gathering-w7mgr-lq7jp\" (UID: \"c797f253-d4c7-4754-95eb-524cd7fc7c35\") " pod="openshift-insights/periodic-gathering-w7mgr-lq7jp"
Oct 30 22:05:55.947891 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.947875    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c797f253-d4c7-4754-95eb-524cd7fc7c35-trusted-ca-bundle\") pod \"periodic-gathering-w7mgr-lq7jp\" (UID: \"c797f253-d4c7-4754-95eb-524cd7fc7c35\") " pod="openshift-insights/periodic-gathering-w7mgr-lq7jp"
Oct 30 22:05:55.947993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:55.947980    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/c797f253-d4c7-4754-95eb-524cd7fc7c35-archives-path\") pod \"periodic-gathering-w7mgr-lq7jp\" (UID: \"c797f253-d4c7-4754-95eb-524cd7fc7c35\") " pod="openshift-insights/periodic-gathering-w7mgr-lq7jp"
Oct 30 22:05:56.051826 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:56.050421    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpp2z\" (UniqueName: \"kubernetes.io/projected/c797f253-d4c7-4754-95eb-524cd7fc7c35-kube-api-access-zpp2z\") pod \"periodic-gathering-w7mgr-lq7jp\" (UID: \"c797f253-d4c7-4754-95eb-524cd7fc7c35\") " pod="openshift-insights/periodic-gathering-w7mgr-lq7jp"
Oct 30 22:05:56.051826 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:56.050524    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c797f253-d4c7-4754-95eb-524cd7fc7c35-trusted-ca-bundle\") pod \"periodic-gathering-w7mgr-lq7jp\" (UID: \"c797f253-d4c7-4754-95eb-524cd7fc7c35\") " pod="openshift-insights/periodic-gathering-w7mgr-lq7jp"
Oct 30 22:05:56.051826 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:56.050628    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/c797f253-d4c7-4754-95eb-524cd7fc7c35-archives-path\") pod \"periodic-gathering-w7mgr-lq7jp\" (UID: \"c797f253-d4c7-4754-95eb-524cd7fc7c35\") " pod="openshift-insights/periodic-gathering-w7mgr-lq7jp"
Oct 30 22:05:56.051826 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:56.050711    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c797f253-d4c7-4754-95eb-524cd7fc7c35-service-ca-bundle\") pod \"periodic-gathering-w7mgr-lq7jp\" (UID: \"c797f253-d4c7-4754-95eb-524cd7fc7c35\") " pod="openshift-insights/periodic-gathering-w7mgr-lq7jp"
Oct 30 22:05:56.051826 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:56.051454    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c797f253-d4c7-4754-95eb-524cd7fc7c35-service-ca-bundle\") pod \"periodic-gathering-w7mgr-lq7jp\" (UID: \"c797f253-d4c7-4754-95eb-524cd7fc7c35\") " pod="openshift-insights/periodic-gathering-w7mgr-lq7jp"
Oct 30 22:05:56.063866 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:56.060319    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c797f253-d4c7-4754-95eb-524cd7fc7c35-trusted-ca-bundle\") pod \"periodic-gathering-w7mgr-lq7jp\" (UID: \"c797f253-d4c7-4754-95eb-524cd7fc7c35\") " pod="openshift-insights/periodic-gathering-w7mgr-lq7jp"
Oct 30 22:05:56.066606 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:56.064135    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/c797f253-d4c7-4754-95eb-524cd7fc7c35-archives-path\") pod \"periodic-gathering-w7mgr-lq7jp\" (UID: \"c797f253-d4c7-4754-95eb-524cd7fc7c35\") " pod="openshift-insights/periodic-gathering-w7mgr-lq7jp"
Oct 30 22:05:56.143906 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:56.143874    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpp2z\" (UniqueName: \"kubernetes.io/projected/c797f253-d4c7-4754-95eb-524cd7fc7c35-kube-api-access-zpp2z\") pod \"periodic-gathering-w7mgr-lq7jp\" (UID: \"c797f253-d4c7-4754-95eb-524cd7fc7c35\") " pod="openshift-insights/periodic-gathering-w7mgr-lq7jp"
Oct 30 22:05:56.404783 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:56.404760    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"]
Oct 30 22:05:56.406621 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:05:56.406590    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce09f1e8_a736_4d77_be12_5f4a45415859.slice/crio-ab0dde9fc8c4a967bc453ff0d26c2e1cf4862362635373d6da5eac6a1cbed0ec WatchSource:0}: Error finding container ab0dde9fc8c4a967bc453ff0d26c2e1cf4862362635373d6da5eac6a1cbed0ec: Status 404 returned error can't find the container with id ab0dde9fc8c4a967bc453ff0d26c2e1cf4862362635373d6da5eac6a1cbed0ec
Oct 30 22:05:56.442446 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:56.442422    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-w7mgr-lq7jp"
Oct 30 22:05:56.573286 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:56.573248    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" event={"ID":"ce09f1e8-a736-4d77-be12-5f4a45415859","Type":"ContainerStarted","Data":"406da8b09726f77e8ac16a59345145646dd08adf19cbed2147f0173d15377e11"}
Oct 30 22:05:56.573443 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:56.573301    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" event={"ID":"ce09f1e8-a736-4d77-be12-5f4a45415859","Type":"ContainerStarted","Data":"ab0dde9fc8c4a967bc453ff0d26c2e1cf4862362635373d6da5eac6a1cbed0ec"}
Oct 30 22:05:56.689921 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:56.689831    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podStartSLOduration=1.689814519 podStartE2EDuration="1.689814519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:56.688542583 +0000 UTC m=+1294.737150278" watchObservedRunningTime="2026-10-30 22:05:56.689814519 +0000 UTC m=+1294.738422215"
Oct 30 22:05:56.847974 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:56.844494    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-w7mgr-lq7jp"]
Oct 30 22:05:56.854933 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:05:56.854901    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc797f253_d4c7_4754_95eb_524cd7fc7c35.slice/crio-cb75eb80c7060e4dfb6cdb137639e91f1a5950b152fa4a7b7fa2da6f10f0cffb WatchSource:0}: Error finding container cb75eb80c7060e4dfb6cdb137639e91f1a5950b152fa4a7b7fa2da6f10f0cffb: Status 404 returned error can't find the container with id cb75eb80c7060e4dfb6cdb137639e91f1a5950b152fa4a7b7fa2da6f10f0cffb
Oct 30 22:05:56.948229 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:56.948153    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:05:57.033541 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:57.033509    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:57.581406 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:57.581371    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-w7mgr-lq7jp" event={"ID":"c797f253-d4c7-4754-95eb-524cd7fc7c35","Type":"ContainerStarted","Data":"4dbe4cd213f9ae89b2046ea3a4cf80ec83d08bae576685dfe5eb9b66f72321f2"}
Oct 30 22:05:57.581573 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:57.581424    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-w7mgr-lq7jp" event={"ID":"c797f253-d4c7-4754-95eb-524cd7fc7c35","Type":"ContainerStarted","Data":"cb75eb80c7060e4dfb6cdb137639e91f1a5950b152fa4a7b7fa2da6f10f0cffb"}
Oct 30 22:05:57.698156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:05:57.698109    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-w7mgr-lq7jp" podStartSLOduration=2.698095251 podStartE2EDuration="2.698095251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:57.695856335 +0000 UTC m=+1295.744464029" watchObservedRunningTime="2026-10-30 22:05:57.698095251 +0000 UTC m=+1295.746702945"
Oct 30 22:06:01.939363 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:01.939252    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:02.161248 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:06:02.161214    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:06:05.954773 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:05.954362    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:06:05.982337 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:05.982306    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:06:06.649408 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:06.649378    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:06:06.928034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:06.927933    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:07.673150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.673119    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"]
Oct 30 22:06:07.676857 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.676840    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.778990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.778957    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-b9fbe2\"/\"kube-root-ca.crt\""
Oct 30 22:06:07.778990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.778986    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-b9fbe2\"/\"openshift-service-ca.crt\""
Oct 30 22:06:07.779215 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.779079    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-b9fbe2\"/\"distinct-w6-b9fbe2-kserve-self-signed-certs\""
Oct 30 22:06:07.779582 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.779567    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-b9fbe2\"/\"default-dockercfg-l2zhl\""
Oct 30 22:06:07.781822 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.781805    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"]
Oct 30 22:06:07.802119 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.802093    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-home\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.802268 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.802172    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-tmp-dir\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.802315 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.802262    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c965\" (UniqueName: \"kubernetes.io/projected/18bcad2c-343d-490f-9207-fd77e5dfe3aa-kube-api-access-9c965\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.802371 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.802312    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-model-cache\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.802371 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.802339    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-dshm\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.802478 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.802445    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18bcad2c-343d-490f-9207-fd77e5dfe3aa-tls-certs\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.876412 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.876374    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:07.904165 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.904134    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18bcad2c-343d-490f-9207-fd77e5dfe3aa-tls-certs\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.904336 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.904253    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-home\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.904336 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.904296    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-tmp-dir\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.904336 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.904320    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c965\" (UniqueName: \"kubernetes.io/projected/18bcad2c-343d-490f-9207-fd77e5dfe3aa-kube-api-access-9c965\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.904482 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.904357    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-model-cache\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.904482 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.904373    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-dshm\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.904879 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.904854    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-tmp-dir\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.905108 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.905083    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-home\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.905242 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.905211    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-model-cache\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.906880 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.906861    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-dshm\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.907466 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.907445    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18bcad2c-343d-490f-9207-fd77e5dfe3aa-tls-certs\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.966269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.966204    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c965\" (UniqueName: \"kubernetes.io/projected/18bcad2c-343d-490f-9207-fd77e5dfe3aa-kube-api-access-9c965\") pod \"distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") " pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:07.989305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:07.989278    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:08.440064 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:08.440037    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"]
Oct 30 22:06:08.442423 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:06:08.442389    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18bcad2c_343d_490f_9207_fd77e5dfe3aa.slice/crio-66b2c3bc3e02c5ec7325aefc5d148f951714cd411e28eb9a6b26b2b5504368f9 WatchSource:0}: Error finding container 66b2c3bc3e02c5ec7325aefc5d148f951714cd411e28eb9a6b26b2b5504368f9: Status 404 returned error can't find the container with id 66b2c3bc3e02c5ec7325aefc5d148f951714cd411e28eb9a6b26b2b5504368f9
Oct 30 22:06:08.651547 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:08.651507    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" event={"ID":"18bcad2c-343d-490f-9207-fd77e5dfe3aa","Type":"ContainerStarted","Data":"fa2ce088a89a41ac53c9f67e9e1c82410590dfce2b6ed0b5de4c72cf14b8f7c9"}
Oct 30 22:06:08.651732 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:08.651555    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" event={"ID":"18bcad2c-343d-490f-9207-fd77e5dfe3aa","Type":"ContainerStarted","Data":"66b2c3bc3e02c5ec7325aefc5d148f951714cd411e28eb9a6b26b2b5504368f9"}
Oct 30 22:06:08.771381 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:08.771251    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podStartSLOduration=1.771231603 podStartE2EDuration="1.771231603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:06:08.767568883 +0000 UTC m=+1306.816176577" watchObservedRunningTime="2026-10-30 22:06:08.771231603 +0000 UTC m=+1306.819839298"
Oct 30 22:06:08.989865 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:08.989828    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:11.777814 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:11.777780    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:15.911862 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:15.911796    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:16.543201 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:16.543165    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:16.856215 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:16.856125    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:17.989698 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:17.989651    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:18.001972 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:18.001944    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:18.727085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:18.727057    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:06:19.882254 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:19.882221    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:21.731712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:21.731659    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:26.675357 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:26.675321    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:30.163663 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.163613    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"]
Oct 30 22:06:30.169764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.169738    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.281472 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.281424    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"]
Oct 30 22:06:30.379799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.379745    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.379984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.379923    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.379984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.379976    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.380116 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.380004    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3b3fed2-c175-45e5-a36c-a063a3201985-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.380116 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.380030    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfm74\" (UniqueName: \"kubernetes.io/projected/d3b3fed2-c175-45e5-a36c-a063a3201985-kube-api-access-bfm74\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.380116 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.380111    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.380281 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.380141    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.380281 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.380167    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.380387 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.380288    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.463627 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.443132    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"]
Oct 30 22:06:30.468008 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.467977    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.481456 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.481421    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"]
Oct 30 22:06:30.482176 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.482145    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.482308 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.482194    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.482308 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.482223    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.482424 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.482315    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.482424 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.482342    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.482424 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.482367    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.482424 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.482384    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3b3fed2-c175-45e5-a36c-a063a3201985-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.482424 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.482400    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfm74\" (UniqueName: \"kubernetes.io/projected/d3b3fed2-c175-45e5-a36c-a063a3201985-kube-api-access-bfm74\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.482424 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.482422    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.484639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.482455    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.484639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.482484    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.484639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.482530    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.484639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.482791    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-data\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.484639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.482827    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvflj\" (UniqueName: \"kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-kube-api-access-rvflj\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.484639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.483006    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.484639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.483060    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.484639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.483085    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.484639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.483124    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.484639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.483231    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.484639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.483504    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3b3fed2-c175-45e5-a36c-a063a3201985-istiod-ca-cert\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.484639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.483527    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-workload-certs\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.484639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.483556    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-credential-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.484639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.483803    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-workload-socket\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.485472 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.485436    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-envoy\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.485875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.485854    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-podinfo\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.610709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.588931    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-token\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.610709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.589735    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.610709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.589789    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.610709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.589822    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.610709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.589848    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.610709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.589886    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.610709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.589923    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvflj\" (UniqueName: \"kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-kube-api-access-rvflj\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.610709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.589967    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.610709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.590103    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.610709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.590130    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.614058 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.612171    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.614058 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.612622    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.614058 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.612905    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.617122 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.617086    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.617544 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.617520    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.635723 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.635626    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfm74\" (UniqueName: \"kubernetes.io/projected/d3b3fed2-c175-45e5-a36c-a063a3201985-kube-api-access-bfm74\") pod \"e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") " pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.679221 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.673177    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.679221 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.673658    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.684536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.684509    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvflj\" (UniqueName: \"kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-kube-api-access-rvflj\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.686284 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.686258    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:30.785011 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.784934    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:30.813780 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:30.813742    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:31.297400 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:31.297353    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"]
Oct 30 22:06:31.299324 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:06:31.299296    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b3fed2_c175_45e5_a36c_a063a3201985.slice/crio-2129128632cfd922ca591d55fc39dacef56cf18b520b5f8e67d79d89e0a6a54c WatchSource:0}: Error finding container 2129128632cfd922ca591d55fc39dacef56cf18b520b5f8e67d79d89e0a6a54c: Status 404 returned error can't find the container with id 2129128632cfd922ca591d55fc39dacef56cf18b520b5f8e67d79d89e0a6a54c
Oct 30 22:06:31.301725 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:31.301696    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:06:31.301815 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:31.301757    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:06:31.301815 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:31.301788    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:06:31.309738 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:31.309712    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"]
Oct 30 22:06:31.350574 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:06:31.350542    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eee972d_c1a3_4b1b_91b9_94f516ccfa85.slice/crio-ce3667fdbcc515947fbaa8f542073a46d116827c4e532e862d344ee1f36de4d3 WatchSource:0}: Error finding container ce3667fdbcc515947fbaa8f542073a46d116827c4e532e862d344ee1f36de4d3: Status 404 returned error can't find the container with id ce3667fdbcc515947fbaa8f542073a46d116827c4e532e862d344ee1f36de4d3
Oct 30 22:06:31.353446 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:31.353409    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:06:31.353529 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:31.353502    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:06:31.353567 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:31.353553    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:06:31.831640 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:31.831597    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl" event={"ID":"8eee972d-c1a3-4b1b-91b9-94f516ccfa85","Type":"ContainerStarted","Data":"d0a307aeda10127388ef12b065233eaa8dd8d4522ea6ce300512df20eb34748e"}
Oct 30 22:06:31.831900 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:31.831664    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl" event={"ID":"8eee972d-c1a3-4b1b-91b9-94f516ccfa85","Type":"ContainerStarted","Data":"ce3667fdbcc515947fbaa8f542073a46d116827c4e532e862d344ee1f36de4d3"}
Oct 30 22:06:31.833334 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:31.833306    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v" event={"ID":"d3b3fed2-c175-45e5-a36c-a063a3201985","Type":"ContainerStarted","Data":"97473a1b0d1f1d7d723da34ffab774a15483f06e9ba6a6bfda59bb5ff0eab4da"}
Oct 30 22:06:31.833473 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:31.833349    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v" event={"ID":"d3b3fed2-c175-45e5-a36c-a063a3201985","Type":"ContainerStarted","Data":"2129128632cfd922ca591d55fc39dacef56cf18b520b5f8e67d79d89e0a6a54c"}
Oct 30 22:06:31.987946 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:31.987910    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:31.990077 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:31.990023    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl" podStartSLOduration=1.9900045560000001 podStartE2EDuration="1.990004556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:06:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:06:31.971092486 +0000 UTC m=+1330.019700172" watchObservedRunningTime="2026-10-30 22:06:31.990004556 +0000 UTC m=+1330.038612252"
Oct 30 22:06:32.182773 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:06:32.182739    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:06:32.785583 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:32.785551    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:32.787397 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:32.787365    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 22:06:32.787516 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:32.787409    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v" podUID="d3b3fed2-c175-45e5-a36c-a063a3201985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 22:06:32.818707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:32.818070    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:32.847710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:32.836822    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 22:06:32.847710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:32.836890    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl" podUID="8eee972d-c1a3-4b1b-91b9-94f516ccfa85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 22:06:33.786020 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:33.785985    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 22:06:33.786441 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:33.786040    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v" podUID="d3b3fed2-c175-45e5-a36c-a063a3201985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 22:06:33.824709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:33.823742    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 22:06:33.824709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:33.823800    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl" podUID="8eee972d-c1a3-4b1b-91b9-94f516ccfa85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 22:06:34.785857 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:34.785825    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 22:06:34.786033 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:34.785886    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v" podUID="d3b3fed2-c175-45e5-a36c-a063a3201985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 22:06:34.820718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:34.818234    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 22:06:34.820718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:34.818320    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl" podUID="8eee972d-c1a3-4b1b-91b9-94f516ccfa85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 22:06:35.786065 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:35.786035    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 22:06:35.786274 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:35.786090    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v" podUID="d3b3fed2-c175-45e5-a36c-a063a3201985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 22:06:35.815710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:35.815020    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 22:06:35.815710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:35.815082    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl" podUID="8eee972d-c1a3-4b1b-91b9-94f516ccfa85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 22:06:36.785739 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:36.785672    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 22:06:36.786153 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:36.785761    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v" podUID="d3b3fed2-c175-45e5-a36c-a063a3201985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 22:06:36.818709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:36.818058    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 22:06:36.818709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:36.818118    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl" podUID="8eee972d-c1a3-4b1b-91b9-94f516ccfa85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 22:06:37.069494 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:37.069413    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:37.785550 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:37.785518    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Oct 30 22:06:37.785747 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:37.785578    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v" podUID="d3b3fed2-c175-45e5-a36c-a063a3201985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Oct 30 22:06:37.814510 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:37.814478    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Oct 30 22:06:37.814853 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:37.814532    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl" podUID="8eee972d-c1a3-4b1b-91b9-94f516ccfa85" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Oct 30 22:06:38.789465 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:38.789435    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:38.789764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:38.789726    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:38.790450 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:38.790434    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:06:38.817962 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:38.817941    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:38.818320 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:38.818207    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:38.819017 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:38.818996    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:06:38.967580 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:38.967528    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v" podStartSLOduration=8.96751538 podStartE2EDuration="8.96751538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:06:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:06:32.123411787 +0000 UTC m=+1330.172019493" watchObservedRunningTime="2026-10-30 22:06:38.96751538 +0000 UTC m=+1337.016123075"
Oct 30 22:06:41.972157 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:41.972128    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:46.611104 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:46.611070    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:46.970419 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:46.970367    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:51.827464 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:51.827427    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:56.797708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:06:56.797648    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:01.071070 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.071031    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"]
Oct 30 22:07:01.077581 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.077546    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.141856 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.141814    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.142583 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.142557    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a2a9ec5-5965-4729-97de-52256fafc765-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.142857 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.142837    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.143031 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.143014    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.143194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.143178    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.143382 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.143365    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.143531 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.143516    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a2a9ec5-5965-4729-97de-52256fafc765-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.143844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.143824    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a2a9ec5-5965-4729-97de-52256fafc765-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.144387 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.144365    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jlk5\" (UniqueName: \"kubernetes.io/projected/8a2a9ec5-5965-4729-97de-52256fafc765-kube-api-access-7jlk5\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.185138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.185109    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"]
Oct 30 22:07:01.246488 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.246446    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.246884 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.246852    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a2a9ec5-5965-4729-97de-52256fafc765-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.249746 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.249721    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.249939 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.249917    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.250095 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.250070    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.250187 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.249390    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.250291 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.250270    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.250499 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.250481    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.250628 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.250612    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a2a9ec5-5965-4729-97de-52256fafc765-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.250929 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.250910    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a2a9ec5-5965-4729-97de-52256fafc765-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.251137 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.251118    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jlk5\" (UniqueName: \"kubernetes.io/projected/8a2a9ec5-5965-4729-97de-52256fafc765-kube-api-access-7jlk5\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.251305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.251271    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.252373 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.252339    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a2a9ec5-5965-4729-97de-52256fafc765-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.253105 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.253073    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.259633 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.259609    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a2a9ec5-5965-4729-97de-52256fafc765-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.261914 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.261892    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.313897 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.313827    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jlk5\" (UniqueName: \"kubernetes.io/projected/8a2a9ec5-5965-4729-97de-52256fafc765-kube-api-access-7jlk5\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.338758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.334419    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a2a9ec5-5965-4729-97de-52256fafc765-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.397863 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.397813    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:01.700662 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.700349    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:01.721571 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.721524    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"]
Oct 30 22:07:01.738545 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.738502    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.782428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.782394    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"]
Oct 30 22:07:01.876967 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.876926    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-workload-certs\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.877142 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.876980    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9739aa48-8d50-44be-80da-5eb24bed7994-istio-token\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.877142 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.877036    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9739aa48-8d50-44be-80da-5eb24bed7994-istio-podinfo\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.877142 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.877132    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-workload-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.877269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.877232    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n64j4\" (UniqueName: \"kubernetes.io/projected/9739aa48-8d50-44be-80da-5eb24bed7994-kube-api-access-n64j4\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.877269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.877256    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-istio-data\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.877357 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.877343    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-istio-envoy\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.877397 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.877389    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9739aa48-8d50-44be-80da-5eb24bed7994-istiod-ca-cert\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.877507 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.877494    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-credential-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.891319 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.891296    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"]
Oct 30 22:07:01.892949 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:07:01.892915    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a2a9ec5_5965_4729_97de_52256fafc765.slice/crio-fe2e69b3af1a5b77f77119bf2f52d56f5f8aaf1a7886c9eed35f1f72fde48d8b WatchSource:0}: Error finding container fe2e69b3af1a5b77f77119bf2f52d56f5f8aaf1a7886c9eed35f1f72fde48d8b: Status 404 returned error can't find the container with id fe2e69b3af1a5b77f77119bf2f52d56f5f8aaf1a7886c9eed35f1f72fde48d8b
Oct 30 22:07:01.895857 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.895819    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:07:01.895942 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.895912    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:07:01.895980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.895962    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:07:01.978532 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.978503    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n64j4\" (UniqueName: \"kubernetes.io/projected/9739aa48-8d50-44be-80da-5eb24bed7994-kube-api-access-n64j4\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.978674 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.978549    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-istio-data\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.978674 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.978599    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-istio-envoy\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.978674 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.978660    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9739aa48-8d50-44be-80da-5eb24bed7994-istiod-ca-cert\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.978861 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.978796    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-credential-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.978932 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.978904    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-workload-certs\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.978932 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.978941    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9739aa48-8d50-44be-80da-5eb24bed7994-istio-token\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.979125 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.978957    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-istio-data\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.979125 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.978968    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9739aa48-8d50-44be-80da-5eb24bed7994-istio-podinfo\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.979125 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.978995    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-workload-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.979337 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.979281    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-credential-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.979414 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.979375    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-workload-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.979522 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.979487    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-workload-certs\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.979623 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.979598    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9739aa48-8d50-44be-80da-5eb24bed7994-istiod-ca-cert\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.981290 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.981263    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-istio-envoy\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:01.981966 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:01.981946    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9739aa48-8d50-44be-80da-5eb24bed7994-istio-podinfo\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:02.045121 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:02.045076    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9739aa48-8d50-44be-80da-5eb24bed7994-istio-token\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:02.045375 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:02.045352    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n64j4\" (UniqueName: \"kubernetes.io/projected/9739aa48-8d50-44be-80da-5eb24bed7994-kube-api-access-n64j4\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:02.060009 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:02.059981    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:02.083144 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:02.083110    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb" event={"ID":"8a2a9ec5-5965-4729-97de-52256fafc765","Type":"ContainerStarted","Data":"6683a4ec9e10279450dd9f7cae81a03f1dca4e23e1f8797788b503894958c4fb"}
Oct 30 22:07:02.083495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:02.083176    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb" event={"ID":"8a2a9ec5-5965-4729-97de-52256fafc765","Type":"ContainerStarted","Data":"fe2e69b3af1a5b77f77119bf2f52d56f5f8aaf1a7886c9eed35f1f72fde48d8b"}
Oct 30 22:07:02.197875 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:07:02.197828    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:07:02.222007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:02.221906    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb" podStartSLOduration=1.221890393 podStartE2EDuration="1.221890393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:02.219774533 +0000 UTC m=+1360.268382229" watchObservedRunningTime="2026-10-30 22:07:02.221890393 +0000 UTC m=+1360.270498088"
Oct 30 22:07:02.399035 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:02.398987    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:02.400531 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:02.400504    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:07:02.400658 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:02.400562    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb" podUID="8a2a9ec5-5965-4729-97de-52256fafc765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 22:07:02.521294 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:02.520469    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"]
Oct 30 22:07:02.523447 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:07:02.523412    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9739aa48_8d50_44be_80da_5eb24bed7994.slice/crio-75870ea4e22767e17998258aee279a0ec05c3b21620e095e083cf1a49b366ee7 WatchSource:0}: Error finding container 75870ea4e22767e17998258aee279a0ec05c3b21620e095e083cf1a49b366ee7: Status 404 returned error can't find the container with id 75870ea4e22767e17998258aee279a0ec05c3b21620e095e083cf1a49b366ee7
Oct 30 22:07:02.526804 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:02.526764    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:07:02.526914 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:02.526855    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:07:02.526914 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:02.526900    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:07:03.090243 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:03.090205    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7" event={"ID":"9739aa48-8d50-44be-80da-5eb24bed7994","Type":"ContainerStarted","Data":"4988dd7140dbd591090d8204af3a00f1d335b5d05951aee7cdc47367ede961e9"}
Oct 30 22:07:03.090761 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:03.090266    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7" event={"ID":"9739aa48-8d50-44be-80da-5eb24bed7994","Type":"ContainerStarted","Data":"75870ea4e22767e17998258aee279a0ec05c3b21620e095e083cf1a49b366ee7"}
Oct 30 22:07:03.401169 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:03.401127    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:07:03.401463 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:03.401435    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb" podUID="8a2a9ec5-5965-4729-97de-52256fafc765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 22:07:04.060995 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:04.060962    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:04.062944 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:04.062901    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 22:07:04.063077 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:04.062976    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7" podUID="9739aa48-8d50-44be-80da-5eb24bed7994" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 22:07:04.400709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:04.400142    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:07:04.400709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:04.400203    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb" podUID="8a2a9ec5-5965-4729-97de-52256fafc765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 22:07:05.061948 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:05.061906    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 22:07:05.062138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:05.061984    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7" podUID="9739aa48-8d50-44be-80da-5eb24bed7994" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 22:07:05.411710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:05.398419    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:07:05.411710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:05.398479    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb" podUID="8a2a9ec5-5965-4729-97de-52256fafc765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 22:07:06.061079 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:06.061044    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 22:07:06.061292 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:06.061101    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7" podUID="9739aa48-8d50-44be-80da-5eb24bed7994" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 22:07:06.400105 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:06.400063    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:07:06.400412 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:06.400380    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb" podUID="8a2a9ec5-5965-4729-97de-52256fafc765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 22:07:06.724763 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:06.721393    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:07.061377 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:07.061279    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 22:07:07.061630 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:07.061608    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7" podUID="9739aa48-8d50-44be-80da-5eb24bed7994" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 22:07:07.399123 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:07.399087    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:07:07.399401 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:07.399368    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb" podUID="8a2a9ec5-5965-4729-97de-52256fafc765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 22:07:08.060912 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:08.060877    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 22:07:08.061395 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:08.060928    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7" podUID="9739aa48-8d50-44be-80da-5eb24bed7994" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 22:07:08.401708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:08.400108    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 22:07:08.401708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:08.400172    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb" podUID="8a2a9ec5-5965-4729-97de-52256fafc765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 22:07:09.060651 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:09.060612    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 22:07:09.060859 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:09.060702    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7" podUID="9739aa48-8d50-44be-80da-5eb24bed7994" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 22:07:09.403867 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:09.403829    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:09.404366 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:09.404254    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:09.405045 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:09.405024    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:07:09.576018 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:09.575959    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7" podStartSLOduration=8.575943763 podStartE2EDuration="8.575943763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:03.218057883 +0000 UTC m=+1361.266665578" watchObservedRunningTime="2026-10-30 22:07:09.575943763 +0000 UTC m=+1367.624551457"
Oct 30 22:07:10.073123 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:10.073087    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:10.073643 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:10.073611    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:10.074270 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:10.074252    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:07:11.558421 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:11.558377    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:15.809515 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:15.809480    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:16.781554 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:16.781522    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:20.193150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:20.193112    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:20.445263 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:20.445161    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:21.650321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:21.650278    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:26.311854 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.311824    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"]
Oct 30 22:07:26.315949 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.315933    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.448652 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.448584    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.449056 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.449032    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.449348 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.449322    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.449522 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.449505    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvlp5\" (UniqueName: \"kubernetes.io/projected/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-kube-api-access-wvlp5\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.449742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.449721    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.450072 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.450015    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.450460 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.450418    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.450845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.450826    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.453834 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.453813    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.513581 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.513540    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:26.519587 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.519561    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"]
Oct 30 22:07:26.555024 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.554995    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.555213 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.555053    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.555213 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.555077    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.555213 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.555138    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.555213 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.555157    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvlp5\" (UniqueName: \"kubernetes.io/projected/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-kube-api-access-wvlp5\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.555213 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.555186    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.555213 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.555212    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.555540 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.555238    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.555540 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.555269    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.555540 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.555471    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-credential-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.555830 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.555806    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-data\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.555906 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.555855    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-workload-socket\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.556028 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.555976    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istiod-ca-cert\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.556455 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.556428    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-workload-certs\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.558218 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.558171    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-envoy\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.559355 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.559312    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-podinfo\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.616877 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.616824    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-token\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.617062 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.617044    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvlp5\" (UniqueName: \"kubernetes.io/projected/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-kube-api-access-wvlp5\") pod \"e2e-worker-w3-cef074-openshift-default-569676869-xv2xn\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") " pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:26.629068 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:26.629046    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:27.060962 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:27.060935    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"]
Oct 30 22:07:27.063062 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:07:27.063039    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1b6193_937c_4cd5_bc88_a29ed981fbe9.slice/crio-91d2670749b03f2a1f1f8e7851375fff9e2f2ffe947870b8f80e0a230e575aeb WatchSource:0}: Error finding container 91d2670749b03f2a1f1f8e7851375fff9e2f2ffe947870b8f80e0a230e575aeb: Status 404 returned error can't find the container with id 91d2670749b03f2a1f1f8e7851375fff9e2f2ffe947870b8f80e0a230e575aeb
Oct 30 22:07:27.065500 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:27.065468    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:07:27.065594 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:27.065535    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:07:27.065594 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:27.065562    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:07:27.272954 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:27.272918    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn" event={"ID":"4d1b6193-937c-4cd5-bc88-a29ed981fbe9","Type":"ContainerStarted","Data":"ba4ae1d61defa686a2ed67741a805e2319eaa3c310a18071adbda62e22e561c5"}
Oct 30 22:07:27.273153 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:27.272972    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn" event={"ID":"4d1b6193-937c-4cd5-bc88-a29ed981fbe9","Type":"ContainerStarted","Data":"91d2670749b03f2a1f1f8e7851375fff9e2f2ffe947870b8f80e0a230e575aeb"}
Oct 30 22:07:27.394727 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:27.394665    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn" podStartSLOduration=1.394648021 podStartE2EDuration="1.394648021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:27.392083657 +0000 UTC m=+1385.440691354" watchObservedRunningTime="2026-10-30 22:07:27.394648021 +0000 UTC m=+1385.443255717"
Oct 30 22:07:27.630201 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:27.630160    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:28.631822 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:28.631784    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 22:07:28.632205 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:28.631833    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn" podUID="4d1b6193-937c-4cd5-bc88-a29ed981fbe9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 22:07:29.630235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:29.630202    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 22:07:29.630409 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:29.630252    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn" podUID="4d1b6193-937c-4cd5-bc88-a29ed981fbe9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 22:07:30.630305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:30.630233    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 22:07:30.630305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:30.630285    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn" podUID="4d1b6193-937c-4cd5-bc88-a29ed981fbe9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 22:07:31.262344 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:31.262302    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:31.630236 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:31.630149    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 22:07:31.630236 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:31.630204    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn" podUID="4d1b6193-937c-4cd5-bc88-a29ed981fbe9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 22:07:32.158492 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:07:32.158459    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:07:32.331817 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:32.331790    4918 generic.go:356] "Generic (PLEG): container finished" podID="c797f253-d4c7-4754-95eb-524cd7fc7c35" containerID="4dbe4cd213f9ae89b2046ea3a4cf80ec83d08bae576685dfe5eb9b66f72321f2" exitCode=0
Oct 30 22:07:32.331935 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:32.331861    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-w7mgr-lq7jp" event={"ID":"c797f253-d4c7-4754-95eb-524cd7fc7c35","Type":"ContainerDied","Data":"4dbe4cd213f9ae89b2046ea3a4cf80ec83d08bae576685dfe5eb9b66f72321f2"}
Oct 30 22:07:32.630320 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:32.630240    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 22:07:32.630320 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:32.630302    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn" podUID="4d1b6193-937c-4cd5-bc88-a29ed981fbe9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 22:07:33.507273 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:33.507248    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-w7mgr-lq7jp"
Oct 30 22:07:33.566927 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:33.566889    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c797f253-d4c7-4754-95eb-524cd7fc7c35-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c797f253-d4c7-4754-95eb-524cd7fc7c35-service-ca-bundle\") pod \"c797f253-d4c7-4754-95eb-524cd7fc7c35\" (UID: \"c797f253-d4c7-4754-95eb-524cd7fc7c35\") "
Oct 30 22:07:33.567069 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:33.566973    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c797f253-d4c7-4754-95eb-524cd7fc7c35-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/c797f253-d4c7-4754-95eb-524cd7fc7c35-archives-path\") pod \"c797f253-d4c7-4754-95eb-524cd7fc7c35\" (UID: \"c797f253-d4c7-4754-95eb-524cd7fc7c35\") "
Oct 30 22:07:33.567145 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:33.567125    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c797f253-d4c7-4754-95eb-524cd7fc7c35-kube-api-access-zpp2z\" (UniqueName: \"kubernetes.io/projected/c797f253-d4c7-4754-95eb-524cd7fc7c35-kube-api-access-zpp2z\") pod \"c797f253-d4c7-4754-95eb-524cd7fc7c35\" (UID: \"c797f253-d4c7-4754-95eb-524cd7fc7c35\") "
Oct 30 22:07:33.567207 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:33.567165    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c797f253-d4c7-4754-95eb-524cd7fc7c35-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c797f253-d4c7-4754-95eb-524cd7fc7c35-trusted-ca-bundle\") pod \"c797f253-d4c7-4754-95eb-524cd7fc7c35\" (UID: \"c797f253-d4c7-4754-95eb-524cd7fc7c35\") "
Oct 30 22:07:33.567290 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:33.567267    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c797f253-d4c7-4754-95eb-524cd7fc7c35-service-ca-bundle" pod "c797f253-d4c7-4754-95eb-524cd7fc7c35" (UID: "c797f253-d4c7-4754-95eb-524cd7fc7c35"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:07:33.567352 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:33.567294    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c797f253-d4c7-4754-95eb-524cd7fc7c35-archives-path" pod "c797f253-d4c7-4754-95eb-524cd7fc7c35" (UID: "c797f253-d4c7-4754-95eb-524cd7fc7c35"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:07:33.567658 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:33.567633    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c797f253-d4c7-4754-95eb-524cd7fc7c35-trusted-ca-bundle" pod "c797f253-d4c7-4754-95eb-524cd7fc7c35" (UID: "c797f253-d4c7-4754-95eb-524cd7fc7c35"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:07:33.567658 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:33.567647    4918 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c797f253-d4c7-4754-95eb-524cd7fc7c35-service-ca-bundle\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:33.567784 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:33.567716    4918 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/c797f253-d4c7-4754-95eb-524cd7fc7c35-archives-path\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:33.569371 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:33.569352    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c797f253-d4c7-4754-95eb-524cd7fc7c35-kube-api-access-zpp2z" pod "c797f253-d4c7-4754-95eb-524cd7fc7c35" (UID: "c797f253-d4c7-4754-95eb-524cd7fc7c35"). InnerVolumeSpecName "kube-api-access-zpp2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:07:33.629852 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:33.629790    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 22:07:33.629959 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:33.629862    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn" podUID="4d1b6193-937c-4cd5-bc88-a29ed981fbe9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 22:07:33.669202 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:33.669158    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpp2z\" (UniqueName: \"kubernetes.io/projected/c797f253-d4c7-4754-95eb-524cd7fc7c35-kube-api-access-zpp2z\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:33.669202 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:33.669202    4918 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c797f253-d4c7-4754-95eb-524cd7fc7c35-trusted-ca-bundle\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:07:34.345738 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:34.345634    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-w7mgr-lq7jp"
Oct 30 22:07:34.345738 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:34.345670    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-w7mgr-lq7jp" event={"ID":"c797f253-d4c7-4754-95eb-524cd7fc7c35","Type":"ContainerDied","Data":"cb75eb80c7060e4dfb6cdb137639e91f1a5950b152fa4a7b7fa2da6f10f0cffb"}
Oct 30 22:07:34.345738 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:34.345741    4918 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb75eb80c7060e4dfb6cdb137639e91f1a5950b152fa4a7b7fa2da6f10f0cffb"
Oct 30 22:07:34.634544 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:34.634473    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:34.634767 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:34.634749    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:34.635525 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:34.635507    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:07:35.596990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:35.596957    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:35.898121 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:35.898072    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:36.154819 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:36.154724    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:38.126216 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:38.126174    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:41.057006 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:41.056939    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:45.935621 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:45.934507    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:49.242508 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.242466    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"]
Oct 30 22:07:49.243740 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.243712    4918 cpu_manager.go:414] "containerMap: removing container" podUID="c797f253-d4c7-4754-95eb-524cd7fc7c35" containerName="insights-gathering"
Oct 30 22:07:49.243740 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.243738    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c797f253-d4c7-4754-95eb-524cd7fc7c35" containerName="insights-gathering"
Oct 30 22:07:49.244059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.244042    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="c797f253-d4c7-4754-95eb-524cd7fc7c35" containerName="insights-gathering"
Oct 30 22:07:49.247954 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.247928    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.301299 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.301270    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"]
Oct 30 22:07:49.347458 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.347424    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b2f165\"/\"distinct-2-w2-b2f165-kserve-self-signed-certs\""
Oct 30 22:07:49.360059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.360029    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh4h8\" (UniqueName: \"kubernetes.io/projected/1ac33b11-35d1-4f1c-b225-4b2db946df73-kube-api-access-wh4h8\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.360177 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.360064    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-tmp-dir\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.360177 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.360089    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-home\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.360339 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.360318    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac33b11-35d1-4f1c-b225-4b2db946df73-tls-certs\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.360402 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.360385    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-model-cache\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.360534 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.360513    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-dshm\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.442529 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.442494    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:49.468522 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.468415    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-dshm\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.468852 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.468818    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh4h8\" (UniqueName: \"kubernetes.io/projected/1ac33b11-35d1-4f1c-b225-4b2db946df73-kube-api-access-wh4h8\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.468997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.468870    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-tmp-dir\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.468997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.468909    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-home\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.469112 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.469030    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac33b11-35d1-4f1c-b225-4b2db946df73-tls-certs\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.469112 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.469082    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-model-cache\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.474896 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.469745    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-model-cache\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.474896 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.470355    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-tmp-dir\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.474896 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.470973    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-home\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.475410 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.475275    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-dshm\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.477890 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.477867    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac33b11-35d1-4f1c-b225-4b2db946df73-tls-certs\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.531150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.531094    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh4h8\" (UniqueName: \"kubernetes.io/projected/1ac33b11-35d1-4f1c-b225-4b2db946df73-kube-api-access-wh4h8\") pod \"distinct-2-w2-b2f165-kserve-b5b45bf68-d955b\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") " pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.560433 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.560416    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:49.868188 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:49.868111    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:50.029583 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:50.029557    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"]
Oct 30 22:07:50.031216 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:07:50.031197    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ac33b11_35d1_4f1c_b225_4b2db946df73.slice/crio-50c0c6f4b9f2b5a6f9093628a9b58c94c740377d8ee92cf8d493b5a8cfb7cd22 WatchSource:0}: Error finding container 50c0c6f4b9f2b5a6f9093628a9b58c94c740377d8ee92cf8d493b5a8cfb7cd22: Status 404 returned error can't find the container with id 50c0c6f4b9f2b5a6f9093628a9b58c94c740377d8ee92cf8d493b5a8cfb7cd22
Oct 30 22:07:50.117180 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:50.117149    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:50.457956 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:50.457919    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" event={"ID":"1ac33b11-35d1-4f1c-b225-4b2db946df73","Type":"ContainerStarted","Data":"0cd489288f2d3e274444e4be69083032f4edc7625fe869443bad1565f8411fde"}
Oct 30 22:07:50.458345 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:50.457975    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" event={"ID":"1ac33b11-35d1-4f1c-b225-4b2db946df73","Type":"ContainerStarted","Data":"50c0c6f4b9f2b5a6f9093628a9b58c94c740377d8ee92cf8d493b5a8cfb7cd22"}
Oct 30 22:07:50.560731 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:50.560674    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:50.575790 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:50.575743    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podStartSLOduration=1.5757178 podStartE2EDuration="1.5757178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:50.574776839 +0000 UTC m=+1408.623384536" watchObservedRunningTime="2026-10-30 22:07:50.5757178 +0000 UTC m=+1408.624325494"
Oct 30 22:07:50.823470 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:50.819651    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:55.643696 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:55.643637    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:59.560846 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:59.560810    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:07:59.573281 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:07:59.573258    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:08:00.546205 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:00.546156    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:00.555781 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:00.555754    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:08:02.263478 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:08:02.263408    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:08:04.225707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:04.225639    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:08:05.681659 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:05.681617    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:10.564912 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:10.564874    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:13.196808 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:13.196769    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:15.551914 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:15.551873    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:20.466038 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:20.466003    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:20.714935 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:20.714903    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:25.321468 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:25.321418    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:30.229501 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:30.229465    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:31.620811 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.620776    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"]
Oct 30 22:08:31.677037 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.676990    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.771567 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.771538    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"]
Oct 30 22:08:31.802721 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.793139    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.802721 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.793185    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.802721 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.793246    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.802721 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.793333    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.802721 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.793361    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.802721 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.793408    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.802721 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.793479    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22c64c07-65da-4549-b90c-b5c7a01b516e-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.802721 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.793524    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.802721 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.793566    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvk94\" (UniqueName: \"kubernetes.io/projected/22c64c07-65da-4549-b90c-b5c7a01b516e-kube-api-access-cvk94\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.804216 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.804189    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"]
Oct 30 22:08:31.804487 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.804470    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:31.836077 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.835981    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"]
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.902284    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3a89ded-e923-49b1-ba16-08c53edb68be-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.902331    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.902372    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvk94\" (UniqueName: \"kubernetes.io/projected/22c64c07-65da-4549-b90c-b5c7a01b516e-kube-api-access-cvk94\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.902404    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.902435    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.902529    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.902608    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.902644    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.902713    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.902742    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.902809    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsmwb\" (UniqueName: \"kubernetes.io/projected/e3a89ded-e923-49b1-ba16-08c53edb68be-kube-api-access-tsmwb\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.902837    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.902862    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.902903    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.902931    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.902982    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.903053    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22c64c07-65da-4549-b90c-b5c7a01b516e-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.903078    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.904292    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.904885    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.905189    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.907758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.906355    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22c64c07-65da-4549-b90c-b5c7a01b516e-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.931314 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.905674    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.937705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.935274    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.949954 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.948376    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:31.998704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.994920    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvk94\" (UniqueName: \"kubernetes.io/projected/22c64c07-65da-4549-b90c-b5c7a01b516e-kube-api-access-cvk94\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:32.040081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:31.997132    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:32.040081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.005488    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.040081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.012421    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.040081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.012555    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.040081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.012609    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.040081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.012698    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsmwb\" (UniqueName: \"kubernetes.io/projected/e3a89ded-e923-49b1-ba16-08c53edb68be-kube-api-access-tsmwb\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.040081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.012730    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.040081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.012755    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.040081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.012872    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.040081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.012912    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3a89ded-e923-49b1-ba16-08c53edb68be-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.040081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.013642    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3a89ded-e923-49b1-ba16-08c53edb68be-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.040081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.013896    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.040081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.018843    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.040081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.019102    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.040081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.019853    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.051720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.046376    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.052141 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.052081    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.094744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.085618    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsmwb\" (UniqueName: \"kubernetes.io/projected/e3a89ded-e923-49b1-ba16-08c53edb68be-kube-api-access-tsmwb\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.094744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.088487    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:32.129257 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.122216    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.207101 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.206703    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:32.244992 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.231357    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"]
Oct 30 22:08:32.272979 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.272922    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.325950 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.316314    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.325950 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.316362    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-279rv\" (UniqueName: \"kubernetes.io/projected/7fd08bce-f53b-442f-a87d-767757897c86-kube-api-access-279rv\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.325950 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.316430    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.325950 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.316498    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd08bce-f53b-442f-a87d-767757897c86-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.325950 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.316555    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd08bce-f53b-442f-a87d-767757897c86-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.325950 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.316611    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.325950 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.316661    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.325950 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.316749    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.325950 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.316790    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd08bce-f53b-442f-a87d-767757897c86-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.390311 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.390144    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"]
Oct 30 22:08:32.462709 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:08:32.460371    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:08:32.482302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.467772    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.482302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.467817    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-279rv\" (UniqueName: \"kubernetes.io/projected/7fd08bce-f53b-442f-a87d-767757897c86-kube-api-access-279rv\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.482302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.467879    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.482302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.467940    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd08bce-f53b-442f-a87d-767757897c86-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.482302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.467992    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd08bce-f53b-442f-a87d-767757897c86-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.482302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.468041    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.482302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.468090    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.482302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.468146    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.482302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.468180    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd08bce-f53b-442f-a87d-767757897c86-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.482302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.469114    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd08bce-f53b-442f-a87d-767757897c86-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.482302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.481304    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.482302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.481582    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.483615 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.483319    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.483615 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.483574    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.543707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.543148    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.614129 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.613758    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd08bce-f53b-442f-a87d-767757897c86-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.634763 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.634732    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd08bce-f53b-442f-a87d-767757897c86-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.678856 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.678662    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-279rv\" (UniqueName: \"kubernetes.io/projected/7fd08bce-f53b-442f-a87d-767757897c86-kube-api-access-279rv\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.680946 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.680202    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:32.942034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.939359    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"]
Oct 30 22:08:32.954312 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.954273    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:08:32.954622 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.954597    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:08:32.954871 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:32.954830    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:08:33.060774 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:33.058011    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"]
Oct 30 22:08:33.069578 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:33.069454    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:08:33.070654 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:33.070581    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:08:33.070654 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:33.070642    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:08:33.220961 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:33.220470    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"]
Oct 30 22:08:33.222356 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:08:33.222323    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd08bce_f53b_442f_a87d_767757897c86.slice/crio-45839cc39c4b3006d4d71287be154c2b62931981f892cd1dc1a96f443ec67ed6 WatchSource:0}: Error finding container 45839cc39c4b3006d4d71287be154c2b62931981f892cd1dc1a96f443ec67ed6: Status 404 returned error can't find the container with id 45839cc39c4b3006d4d71287be154c2b62931981f892cd1dc1a96f443ec67ed6
Oct 30 22:08:33.226813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:33.225614    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:08:33.226813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:33.225723    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:08:33.226813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:33.225770    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:08:33.905708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:33.905206    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk" event={"ID":"e3a89ded-e923-49b1-ba16-08c53edb68be","Type":"ContainerStarted","Data":"fa7703710b4a12ccace02b41d791188dd1f58e876993acc598f44b755602b714"}
Oct 30 22:08:33.905708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:33.905279    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk" event={"ID":"e3a89ded-e923-49b1-ba16-08c53edb68be","Type":"ContainerStarted","Data":"83bbbb45ab58b38f113f6ca5673cdfcf17caeb2bfd6dc8e260864de3aaa0351a"}
Oct 30 22:08:33.913705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:33.913146    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj" event={"ID":"22c64c07-65da-4549-b90c-b5c7a01b516e","Type":"ContainerStarted","Data":"04e72b2c08c691660968833fdbe7f15543506bea3e375ea18149fb56dad834cb"}
Oct 30 22:08:33.913705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:33.913209    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj" event={"ID":"22c64c07-65da-4549-b90c-b5c7a01b516e","Type":"ContainerStarted","Data":"3132701ca88c9969cc788adfd2869ce8e30fb8d34771be000c0ddd6ce9ade34f"}
Oct 30 22:08:33.924668 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:33.924631    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6" event={"ID":"7fd08bce-f53b-442f-a87d-767757897c86","Type":"ContainerStarted","Data":"5fb15b36ae32d48b1408913a75c1bd430b2edac19b299137c7f6653d6057ea21"}
Oct 30 22:08:33.924942 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:33.924922    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6" event={"ID":"7fd08bce-f53b-442f-a87d-767757897c86","Type":"ContainerStarted","Data":"45839cc39c4b3006d4d71287be154c2b62931981f892cd1dc1a96f443ec67ed6"}
Oct 30 22:08:34.073479 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:34.073418    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk" podStartSLOduration=3.073396963 podStartE2EDuration="3.073396963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:34.073051739 +0000 UTC m=+1452.121659436" watchObservedRunningTime="2026-10-30 22:08:34.073396963 +0000 UTC m=+1452.122004659"
Oct 30 22:08:34.090043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:34.090017    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:34.091221 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:34.091199    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:08:34.091327 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:34.091242    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj" podUID="22c64c07-65da-4549-b90c-b5c7a01b516e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 22:08:34.247086 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:34.244120    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:34.247086 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:34.246112    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:08:34.247086 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:34.246168    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk" podUID="e3a89ded-e923-49b1-ba16-08c53edb68be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 22:08:34.362707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:34.359379    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj" podStartSLOduration=3.359359409 podStartE2EDuration="3.359359409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:34.358080957 +0000 UTC m=+1452.406688652" watchObservedRunningTime="2026-10-30 22:08:34.359359409 +0000 UTC m=+1452.407967105"
Oct 30 22:08:34.362707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:34.361056    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6" podStartSLOduration=2.361038073 podStartE2EDuration="2.361038073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:34.203395487 +0000 UTC m=+1452.252003186" watchObservedRunningTime="2026-10-30 22:08:34.361038073 +0000 UTC m=+1452.409645770"
Oct 30 22:08:34.681334 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:34.681294    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:34.682533 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:34.682507    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 22:08:34.682660 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:34.682556    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6" podUID="7fd08bce-f53b-442f-a87d-767757897c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 22:08:35.090802 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:35.090725    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:08:35.090802 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:35.090771    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj" podUID="22c64c07-65da-4549-b90c-b5c7a01b516e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 22:08:35.264809 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:35.258067    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:08:35.264809 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:35.258128    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk" podUID="e3a89ded-e923-49b1-ba16-08c53edb68be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 22:08:35.681868 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:35.681830    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 22:08:35.682091 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:35.681892    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6" podUID="7fd08bce-f53b-442f-a87d-767757897c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 22:08:36.081738 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:36.081621    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:36.295710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:36.291557    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:08:36.295710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:36.291620    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj" podUID="22c64c07-65da-4549-b90c-b5c7a01b516e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 22:08:36.358764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:36.334567    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:08:36.359040 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:36.359001    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk" podUID="e3a89ded-e923-49b1-ba16-08c53edb68be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 22:08:36.686719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:36.685705    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 22:08:36.686719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:36.685764    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6" podUID="7fd08bce-f53b-442f-a87d-767757897c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 22:08:37.090935 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:37.090850    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:08:37.090935 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:37.090911    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj" podUID="22c64c07-65da-4549-b90c-b5c7a01b516e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 22:08:37.245716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:37.244755    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:08:37.245716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:37.244832    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk" podUID="e3a89ded-e923-49b1-ba16-08c53edb68be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 22:08:37.681788 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:37.681753    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 22:08:37.682223 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:37.681808    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6" podUID="7fd08bce-f53b-442f-a87d-767757897c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 22:08:38.090444 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:38.090364    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:08:38.090444 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:38.090410    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj" podUID="22c64c07-65da-4549-b90c-b5c7a01b516e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 22:08:38.243105 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:38.243064    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:08:38.243348 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:38.243322    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk" podUID="e3a89ded-e923-49b1-ba16-08c53edb68be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 22:08:38.681613 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:38.681578    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 22:08:38.681791 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:38.681638    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6" podUID="7fd08bce-f53b-442f-a87d-767757897c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 22:08:39.090344 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:39.090261    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:08:39.090344 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:39.090312    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj" podUID="22c64c07-65da-4549-b90c-b5c7a01b516e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 22:08:39.263708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:39.262308    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:08:39.263708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:39.262366    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk" podUID="e3a89ded-e923-49b1-ba16-08c53edb68be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 22:08:39.682301 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:39.682264    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 22:08:39.682483 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:39.682335    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6" podUID="7fd08bce-f53b-442f-a87d-767757897c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 22:08:40.090587 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:40.090497    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:08:40.090587 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:40.090551    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj" podUID="22c64c07-65da-4549-b90c-b5c7a01b516e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 22:08:40.243424 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:40.243392    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 22:08:40.243602 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:40.243453    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk" podUID="e3a89ded-e923-49b1-ba16-08c53edb68be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 22:08:41.094508 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:41.094478    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:41.095031 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:41.094880    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:41.095618 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:41.095599    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:08:41.176908 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:41.176866    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:41.177343 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:41.177320    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:41.178410 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:41.178385    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:08:41.247729 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:41.247702    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:41.248113 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:41.248094    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:41.248942 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:41.248921    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:08:41.989607 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:41.989574    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:46.947243 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:46.947205    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:51.876568 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:51.876517    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:54.445216 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:54.445177    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:55.889708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:55.886308    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"]
Oct 30 22:08:55.921227 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:55.921195    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.044742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.030110    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.044742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.030170    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8cvw\" (UniqueName: \"kubernetes.io/projected/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-kube-api-access-j8cvw\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.044742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.030244    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.044742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.030311    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.044742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.030370    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.044742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.030394    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.044742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.030469    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.044742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.030505    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.044742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.030548    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.162799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.134713    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.162799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.134870    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.162799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.134907    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8cvw\" (UniqueName: \"kubernetes.io/projected/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-kube-api-access-j8cvw\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.162799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.134975    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.162799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.135039    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.162799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.135094    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.162799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.135119    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.162799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.135189    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.162799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.135226    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.162799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.135817    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.162799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.136469    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.162799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.136755    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.162799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.137488    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.294515 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.276314    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.314728 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.300357    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.387951 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.372391    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"]
Oct 30 22:08:56.445187 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.445075    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8cvw\" (UniqueName: \"kubernetes.io/projected/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-kube-api-access-j8cvw\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.470707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.450778    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.520735 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.519990    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.597507 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.597448    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:08:56.602964 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.602934    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:56.647615 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.639811    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:08:56.740713 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.723783    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 22:08:56.893849 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.893782    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:08:56.970147 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:56.962854    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:08:57.158053 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.153816    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:08:57.158053 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.153873    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj" podUID="22c64c07-65da-4549-b90c-b5c7a01b516e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:08:57.229756 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.228762    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:08:57.401703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.359038    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": context deadline exceeded"
Oct 30 22:08:57.401703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.392785    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:08:57.401703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.392844    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk" podUID="e3a89ded-e923-49b1-ba16-08c53edb68be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:08:57.767615 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.767569    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:08:57.768150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.768031    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:08:57.770131 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.770100    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:08:57.904260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.876604    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"]
Oct 30 22:08:57.904260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.898966    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": context deadline exceeded"
Oct 30 22:08:57.904260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.903838    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:08:57.939747 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.924050    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:08:57.967120 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.964943    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:08:57.967120 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.805430    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 22:08:57.967120 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.965263    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:08:57.967120 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:57.965326    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:08:58.025882 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:58.025849    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:58.139754 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:58.116698    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:08:58.144539 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:58.144501    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:08:58.235742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:58.234243    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:08:59.036728 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:59.036653    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl" event={"ID":"d8c8c11e-594d-444e-a5f5-1ac207dc74cb","Type":"ContainerStarted","Data":"52540e6ed4dbb50d7d6cadc6570b72d4f2a46be0d321a15e614fb4cbc47395b3"}
Oct 30 22:08:59.037143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:59.036768    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl" event={"ID":"d8c8c11e-594d-444e-a5f5-1ac207dc74cb","Type":"ContainerStarted","Data":"35a8842c68c9535a46d5274c3dab87d3f57310cb7b98c0fbf2c57eddc73cb2a1"}
Oct 30 22:08:59.159529 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:59.159473    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl" podStartSLOduration=4.15945917 podStartE2EDuration="4.15945917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:59.15600969 +0000 UTC m=+1477.204617385" watchObservedRunningTime="2026-10-30 22:08:59.15945917 +0000 UTC m=+1477.208066864"
Oct 30 22:08:59.615239 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:59.615202    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:08:59.615608 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:59.615582    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:08:59.615802 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:08:59.615776    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl" podUID="d8c8c11e-594d-444e-a5f5-1ac207dc74cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 22:09:00.608900 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:00.608802    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:09:00.609469 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:00.609437    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl" podUID="d8c8c11e-594d-444e-a5f5-1ac207dc74cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 22:09:01.611714 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:01.606029    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:09:01.611714 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:01.606094    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl" podUID="d8c8c11e-594d-444e-a5f5-1ac207dc74cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 22:09:02.163924 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:09:02.163882    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:09:02.516765 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.511706    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:02.605706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.604049    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:09:02.605706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.604113    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl" podUID="d8c8c11e-594d-444e-a5f5-1ac207dc74cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 22:09:02.720991 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.720953    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"]
Oct 30 22:09:02.726550 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.726525    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.826282 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.825779    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-data\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.826282 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.825860    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-podinfo\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.826282 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.825915    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-credential-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.826282 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.825941    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-workload-certs\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.826282 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.825992    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-envoy\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.826282 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.826186    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-workload-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.826282 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.826228    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2tz9\" (UniqueName: \"kubernetes.io/projected/18416329-7c7b-48b1-bdcd-29f66e19e88b-kube-api-access-x2tz9\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.826759 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.826394    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18416329-7c7b-48b1-bdcd-29f66e19e88b-istiod-ca-cert\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.826759 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.826445    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-token\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.832178 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.832136    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"]
Oct 30 22:09:02.927621 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.927592    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-envoy\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.927859 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.927659    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-workload-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.927859 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.927764    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2tz9\" (UniqueName: \"kubernetes.io/projected/18416329-7c7b-48b1-bdcd-29f66e19e88b-kube-api-access-x2tz9\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.927991 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.927881    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18416329-7c7b-48b1-bdcd-29f66e19e88b-istiod-ca-cert\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.927991 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.927925    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-token\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.928119 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.928097    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-data\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.928179 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.928145    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-podinfo\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.928179 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.928157    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-workload-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.928285 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.928190    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-credential-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.928285 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.928207    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-workload-certs\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.928514 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.928497    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-credential-socket\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.928603 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.928583    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-workload-certs\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.928663 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.928649    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18416329-7c7b-48b1-bdcd-29f66e19e88b-istiod-ca-cert\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.928737 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.928657    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-data\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.930220 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.930196    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-envoy\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.930897 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.930876    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-podinfo\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.988988 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.988954    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-token\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:02.989143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:02.988960    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2tz9\" (UniqueName: \"kubernetes.io/projected/18416329-7c7b-48b1-bdcd-29f66e19e88b-kube-api-access-x2tz9\") pod \"e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") " pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:03.040708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:03.040431    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:03.522444 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:09:03.522404    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18416329_7c7b_48b1_bdcd_29f66e19e88b.slice/crio-9b49e7edff4079a93b8246920336279f3ae38474fb95f22324dc06d43d81b574 WatchSource:0}: Error finding container 9b49e7edff4079a93b8246920336279f3ae38474fb95f22324dc06d43d81b574: Status 404 returned error can't find the container with id 9b49e7edff4079a93b8246920336279f3ae38474fb95f22324dc06d43d81b574
Oct 30 22:09:03.523005 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:03.522982    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"]
Oct 30 22:09:03.525043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:03.525016    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:09:03.525144 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:03.525130    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:09:03.525192 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:03.525180    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:09:03.606706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:03.606040    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:09:03.606706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:03.606099    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl" podUID="d8c8c11e-594d-444e-a5f5-1ac207dc74cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 22:09:04.075955 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:04.075921    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr" event={"ID":"18416329-7c7b-48b1-bdcd-29f66e19e88b","Type":"ContainerStarted","Data":"fbffbb87781ce3392ad5b5c3ec59bc7e4d315ffae75d5af9706010b847015c55"}
Oct 30 22:09:04.076339 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:04.075974    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr" event={"ID":"18416329-7c7b-48b1-bdcd-29f66e19e88b","Type":"ContainerStarted","Data":"9b49e7edff4079a93b8246920336279f3ae38474fb95f22324dc06d43d81b574"}
Oct 30 22:09:04.607707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:04.603639    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 30 22:09:04.607707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:04.603730    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl" podUID="d8c8c11e-594d-444e-a5f5-1ac207dc74cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 30 22:09:05.041367 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:05.041329    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:05.043169 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:05.043142    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:09:05.043292 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:05.043192    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr" podUID="18416329-7c7b-48b1-bdcd-29f66e19e88b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 22:09:05.226705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:05.226551    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:05.935522 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:05.935475    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:09:05.936033 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:05.936000    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:09:05.936937 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:05.936920    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:09:06.042037 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:06.042006    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:09:06.042212 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:06.042053    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr" podUID="18416329-7c7b-48b1-bdcd-29f66e19e88b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 22:09:06.096952 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:06.096862    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr" podStartSLOduration=4.096842624 podStartE2EDuration="4.096842624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:09:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:09:04.209007063 +0000 UTC m=+1482.257614758" watchObservedRunningTime="2026-10-30 22:09:06.096842624 +0000 UTC m=+1484.145450320"
Oct 30 22:09:07.041933 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:07.041897    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:09:07.042342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:07.041951    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr" podUID="18416329-7c7b-48b1-bdcd-29f66e19e88b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 22:09:07.687722 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:07.685336    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:08.041392 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:08.041313    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:09:08.041392 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:08.041363    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr" podUID="18416329-7c7b-48b1-bdcd-29f66e19e88b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 22:09:09.042146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:09.042115    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:09:09.042561 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:09.042172    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr" podUID="18416329-7c7b-48b1-bdcd-29f66e19e88b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 22:09:10.041857 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:10.041821    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 30 22:09:10.042049 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:10.041878    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr" podUID="18416329-7c7b-48b1-bdcd-29f66e19e88b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 30 22:09:11.000771 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.000731    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"]
Oct 30 22:09:11.007385 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.007353    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.092715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.092480    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"]
Oct 30 22:09:11.111080 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.111049    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.111255 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.111097    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.111333 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.111305    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.111395 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.111377    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.111471 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.111420    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r85s\" (UniqueName: \"kubernetes.io/projected/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-kube-api-access-7r85s\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.111505 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.111478    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.111538 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.111514    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.111741 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.111724    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.111784 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.111769    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.172199 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.172167    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:11.174224 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.174199    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:11.175012 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.174993    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:09:11.213232 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.213195    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.213410 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.213268    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.213410 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.213308    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r85s\" (UniqueName: \"kubernetes.io/projected/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-kube-api-access-7r85s\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.213410 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.213361    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.213410 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.213396    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.213619 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.213597    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.213722 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.213637    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.213722 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.213716    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.213855 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.213750    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.213855 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.213790    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.213948 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.213875    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.214058 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.214040    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.214115 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.214084    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.214169 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.214141    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.216179 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.216152    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.216951 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.216936    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.274447 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.274359    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.274595 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.274475    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r85s\" (UniqueName: \"kubernetes.io/projected/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-kube-api-access-7r85s\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.341089 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.341052    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:11.783883 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.783855    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"]
Oct 30 22:09:11.786154 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:09:11.786125    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b9e8b3_12d1_4bd7_b896_ba7d0afe7828.slice/crio-9e446f0baa0e43c1c2487c5f4066f1340222aef890e74d55379f47824869809c WatchSource:0}: Error finding container 9e446f0baa0e43c1c2487c5f4066f1340222aef890e74d55379f47824869809c: Status 404 returned error can't find the container with id 9e446f0baa0e43c1c2487c5f4066f1340222aef890e74d55379f47824869809c
Oct 30 22:09:11.788776 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.788747    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:09:11.788840 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.788815    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:09:11.788872 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:11.788843    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:09:12.161792 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:12.161756    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc" event={"ID":"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828","Type":"ContainerStarted","Data":"f4790ab9e2db55ea0be2e7b1e9e7a2e3e862c5496d06988c0e8de7a70ffeacac"}
Oct 30 22:09:12.162305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:12.161816    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc" event={"ID":"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828","Type":"ContainerStarted","Data":"9e446f0baa0e43c1c2487c5f4066f1340222aef890e74d55379f47824869809c"}
Oct 30 22:09:12.293293 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:12.293220    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc" podStartSLOduration=2.293197634 podStartE2EDuration="2.293197634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:09:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:09:12.287198457 +0000 UTC m=+1490.335806163" watchObservedRunningTime="2026-10-30 22:09:12.293197634 +0000 UTC m=+1490.341805329"
Oct 30 22:09:12.342063 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:12.342021    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:12.343936 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:12.343912    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:09:12.344035 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:12.343961    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc" podUID="11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 22:09:12.667731 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:12.663476    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:13.342493 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:13.342459    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:09:13.342934 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:13.342527    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc" podUID="11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 22:09:14.342325 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:14.342291    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:09:14.342547 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:14.342348    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc" podUID="11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 22:09:15.343013 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:15.342928    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:09:15.343013 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:15.342983    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc" podUID="11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 22:09:16.341982 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:16.341935    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:09:16.342190 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:16.342003    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc" podUID="11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 22:09:16.965989 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:16.965948    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:17.342676 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:17.342589    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:09:17.342873 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:17.342669    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc" podUID="11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 22:09:17.598413 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:17.598326    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:18.342334 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:18.342294    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 22:09:18.342754 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:18.342353    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc" podUID="11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 22:09:19.346168 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:19.346138    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:19.346595 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:19.346428    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:19.347124 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:19.347105    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:09:20.941233 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:20.941198    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:22.201896 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:22.201854    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:09:22.223967 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:22.223938    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:09:22.452760 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:22.450497    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:27.443341 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:27.443301    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:31.546710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:31.543787    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:31.546710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:31.545995    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:32.256125 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:32.256079    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 22:09:32.261859 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:32.261825    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": context deadline exceeded"
Oct 30 22:09:32.550764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:32.548073    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:09:32.550764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:32.548789    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:32.550764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:32.549263    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:09:32.550764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:32.549329    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:09:32.904768 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:09:32.892812    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:09:33.121709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:33.096297    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:33.248703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:33.156751    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:33.268104 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:33.268063    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 22:09:33.300126 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:33.282762    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:33.300696 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:33.300651    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:09:33.300887 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:33.300872    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:09:33.607938 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:33.607820    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:09:33.608858 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:33.608828    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 22:09:33.622783 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:33.622748    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:09:33.623029 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:33.623000    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9" podUID="4e40f78c-3818-40fc-b6c6-f9672b66e2dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:34.258793 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:34.258744    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:09:34.260148 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:34.259578    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:34.317238 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:34.317193    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:34.319912 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:34.319518    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:34.343069 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:34.343040    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:09:34.368787 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:34.368759    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:09:34.618942 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:34.618829    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:34.649709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:34.627137    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:09:35.248803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:35.248762    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:35.265695 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:35.265624    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:35.270703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:35.267371    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:35.346708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:35.331610    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:35.360708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:35.341152    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": context deadline exceeded"
Oct 30 22:09:35.408716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:35.407854    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:09:35.408716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:35.407959    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc" podUID="11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:35.635774 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:35.631899    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:35.661708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:35.650482    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:35.692590 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:35.692550    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:09:35.692900 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:35.692867    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn" podUID="4d1b6193-937c-4cd5-bc88-a29ed981fbe9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:36.191712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:36.120178    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:09:36.191712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:36.120256    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h" podUID="0a926b1b-b3d0-4e0b-9198-e5479766f1db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:36.310712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:36.309019    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:36.310712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:36.309721    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:09:36.398089 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:36.398033    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:36.464768 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:36.461329    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:36.756085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:36.717991    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:36.756085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:36.734049    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 22:09:36.756085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:36.742858    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:09:36.897709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:36.872317    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng" podUID="0856582a-2e5e-4d49-9f58-9cf10c008b41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:37.123785 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:37.122106    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:37.274027 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:37.273954    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:37.315010 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:37.314957    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 22:09:37.330970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:37.330912    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:09:37.414978 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:37.414917    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:37.459603 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:09:37.459572    4918 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.379s"
Oct 30 22:09:37.513102 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:37.511512    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:37.723875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:37.723768    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:37.737239 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:37.737191    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:38.118766 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:38.112762    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:38.334708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:38.330812    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 22:09:38.334708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:38.332114    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:38.416121 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:38.415316    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:38.503754 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:38.501422    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:09:38.513358 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:38.511951    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:09:38.513358 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:38.512671    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": context deadline exceeded"
Oct 30 22:09:38.554856 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:38.554581    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:09:38.578209 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:38.578184    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:09:38.617704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:38.616737    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:09:38.620738 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:38.620713    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:09:43.202930 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:43.202891    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:48.201881 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:48.201840    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:53.110170 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:53.110134    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:56.323888 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.323856    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"]
Oct 30 22:09:56.328778 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.328757    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.411894 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.411858    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.412056 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.411918    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.412056 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.411980    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.415541 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.412055    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.415541 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.412096    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.415541 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.412222    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jnf2\" (UniqueName: \"kubernetes.io/projected/55d4a550-e7d1-4464-98a8-e7b8204aea78-kube-api-access-6jnf2\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.415541 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.412256    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55d4a550-e7d1-4464-98a8-e7b8204aea78-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.415541 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.412335    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.415541 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.412382    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.416772 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.416749    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"]
Oct 30 22:09:56.513255 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.513219    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jnf2\" (UniqueName: \"kubernetes.io/projected/55d4a550-e7d1-4464-98a8-e7b8204aea78-kube-api-access-6jnf2\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.513404 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.513274    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55d4a550-e7d1-4464-98a8-e7b8204aea78-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.513404 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.513344    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.513404 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.513391    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.513558 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.513462    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.513558 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.513493    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.513558 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.513545    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.513745 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.513617    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.513745 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.513655    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.513952 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.513926    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-workload-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.514302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.514215    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-workload-certs\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.514302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.514250    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55d4a550-e7d1-4464-98a8-e7b8204aea78-istiod-ca-cert\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.514302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.514257    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-credential-socket\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.514302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.514269    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-data\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.516471 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.516447    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-envoy\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.516577 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.516548    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-podinfo\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.573848 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.573819    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-token\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.574039 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.573884    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jnf2\" (UniqueName: \"kubernetes.io/projected/55d4a550-e7d1-4464-98a8-e7b8204aea78-kube-api-access-6jnf2\") pod \"e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") " pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:56.643897 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:56.643867    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:57.076434 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:57.076403    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"]
Oct 30 22:09:57.077225 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:09:57.077193    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d4a550_e7d1_4464_98a8_e7b8204aea78.slice/crio-f536e0dc1c011792ef1df385c9ecb2fa66263d3f1f012a5c3db216f8dec02f94 WatchSource:0}: Error finding container f536e0dc1c011792ef1df385c9ecb2fa66263d3f1f012a5c3db216f8dec02f94: Status 404 returned error can't find the container with id f536e0dc1c011792ef1df385c9ecb2fa66263d3f1f012a5c3db216f8dec02f94
Oct 30 22:09:57.079738 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:57.079706    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:09:57.079821 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:57.079779    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:09:57.079821 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:57.079812    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:09:57.637744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:57.637699    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5" event={"ID":"55d4a550-e7d1-4464-98a8-e7b8204aea78","Type":"ContainerStarted","Data":"aaa5b65ac4d6e18bf96598f1afd5cf680cc014171f1bf447efcb791733576bc6"}
Oct 30 22:09:57.638155 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:57.637757    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5" event={"ID":"55d4a550-e7d1-4464-98a8-e7b8204aea78","Type":"ContainerStarted","Data":"f536e0dc1c011792ef1df385c9ecb2fa66263d3f1f012a5c3db216f8dec02f94"}
Oct 30 22:09:57.643970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:57.643951    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:09:57.758274 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:57.758211    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5" podStartSLOduration=1.75819329 podStartE2EDuration="1.75819329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:09:57.757069809 +0000 UTC m=+1535.805677504" watchObservedRunningTime="2026-10-30 22:09:57.75819329 +0000 UTC m=+1535.806800986"
Oct 30 22:09:57.935555 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:57.935500    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:58.645953 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:58.645924    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:09:58.646342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:58.645978    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5" podUID="55d4a550-e7d1-4464-98a8-e7b8204aea78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 22:09:59.518456 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:59.518417    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:09:59.644392 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:59.644353    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:09:59.644543 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:59.644405    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5" podUID="55d4a550-e7d1-4464-98a8-e7b8204aea78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 22:09:59.818720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:09:59.818604    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:00.644388 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:00.644353    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:10:00.644567 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:00.644404    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5" podUID="55d4a550-e7d1-4464-98a8-e7b8204aea78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 22:10:01.644859 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:01.644823    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:10:01.645280 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:01.644883    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5" podUID="55d4a550-e7d1-4464-98a8-e7b8204aea78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 22:10:02.160697 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:10:02.160640    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:10:02.523751 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.523648    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"]
Oct 30 22:10:02.528117 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.528095    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.624321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.624264    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"]
Oct 30 22:10:02.635813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.634119    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.635813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.634174    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd2hv\" (UniqueName: \"kubernetes.io/projected/e8048205-f020-49db-90e0-2c581f8cbc3f-kube-api-access-vd2hv\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.635813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.634210    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.635813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.634235    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.635813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.634273    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8048205-f020-49db-90e0-2c581f8cbc3f-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.635813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.634313    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.635813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.634402    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.635813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.634657    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.635813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.634722    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.644868 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.644833    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:10:02.645319 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.644895    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5" podUID="55d4a550-e7d1-4464-98a8-e7b8204aea78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 22:10:02.736477 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.736446    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.736728 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.736709    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.736820 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.736761    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.736820 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.736813    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.736935 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.736832    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-workload-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.736935 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.736849    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd2hv\" (UniqueName: \"kubernetes.io/projected/e8048205-f020-49db-90e0-2c581f8cbc3f-kube-api-access-vd2hv\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.736935 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.736910    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.737085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.736937    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.737085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.736977    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8048205-f020-49db-90e0-2c581f8cbc3f-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.737085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.736991    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-workload-certs\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.737085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.737020    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.737249 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.737216    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-data\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.737376 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.737354    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-credential-socket\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.737633 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.737616    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8048205-f020-49db-90e0-2c581f8cbc3f-istiod-ca-cert\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.739192 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.739165    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-envoy\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.739470 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.739454    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-podinfo\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.821273 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.821196    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd2hv\" (UniqueName: \"kubernetes.io/projected/e8048205-f020-49db-90e0-2c581f8cbc3f-kube-api-access-vd2hv\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.821273 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.821206    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-token\") pod \"e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") " pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.842579 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.842550    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:02.938301 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:02.938249    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"]
Oct 30 22:10:03.049607 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.049409    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:03.147096 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.147062    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"]
Oct 30 22:10:03.149427 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.149368    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.154210 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.152866    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.157133 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.155032    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"]
Oct 30 22:10:03.162043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.160745    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"]
Oct 30 22:10:03.255716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.255651    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.255716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.255705    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.255911 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.255888    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.255967 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.255924    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.255967 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.255945    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.256092 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.255991    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.256092 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.256047    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djfmc\" (UniqueName: \"kubernetes.io/projected/a0d3af2f-d2e7-4368-86c1-0b99005186e8-kube-api-access-djfmc\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.256168 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.256138    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.256395 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.256190    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.256395 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.256249    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.256395 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.256311    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9h4b\" (UniqueName: \"kubernetes.io/projected/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-kube-api-access-p9h4b\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.256395 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.256379    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.256571 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.256408    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.256616 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.256568    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.256716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.256663    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.256778 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.256722    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.256837 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.256818    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.256874 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.256860    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.358452 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.358415    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.358646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.358466    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.358646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.358501    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9h4b\" (UniqueName: \"kubernetes.io/projected/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-kube-api-access-p9h4b\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.358646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.358543    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.358646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.358563    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.358646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.358609    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.359034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.358655    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.359034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.358701    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.359034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.358737    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.359034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.358766    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.359034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.358803    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.359034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.358847    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.359034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.358987    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.359034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.359027    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.359587 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.359054    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.359587 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.359083    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.359587 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.359085    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.359587 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.359101    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.359587 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.359116    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djfmc\" (UniqueName: \"kubernetes.io/projected/a0d3af2f-d2e7-4368-86c1-0b99005186e8-kube-api-access-djfmc\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.359587 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.359126    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.359587 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.359129    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.359587 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.359189    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.359587 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.359413    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-data\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.360078 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.359605    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-credential-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.360078 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.359674    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.360078 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.359957    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-workload-certs\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.360078 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.360069    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istiod-ca-cert\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.360281 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.360187    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-workload-socket\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.361499 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.361480    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.361609 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.361497    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.361883 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.361865    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-envoy\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.362061 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.362043    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-podinfo\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.419643 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.419550    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.419825 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.419753    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djfmc\" (UniqueName: \"kubernetes.io/projected/a0d3af2f-d2e7-4368-86c1-0b99005186e8-kube-api-access-djfmc\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.419878 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.419848    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9h4b\" (UniqueName: \"kubernetes.io/projected/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-kube-api-access-p9h4b\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.453483 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.453441    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-token\") pod \"e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") " pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.470434 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.470401    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:03.478851 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.478786    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:03.517058 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.515566    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"]
Oct 30 22:10:03.518005 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:10:03.517963    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8048205_f020_49db_90e0_2c581f8cbc3f.slice/crio-6896e3b4477ac239bf7e1a6b1e5fb1f975d30d9209e3fa6754314332082a1c1f WatchSource:0}: Error finding container 6896e3b4477ac239bf7e1a6b1e5fb1f975d30d9209e3fa6754314332082a1c1f: Status 404 returned error can't find the container with id 6896e3b4477ac239bf7e1a6b1e5fb1f975d30d9209e3fa6754314332082a1c1f
Oct 30 22:10:03.521746 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.521512    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:10:03.521746 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.521596    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:10:03.521746 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.521633    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:10:03.644928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.644888    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 22:10:03.645586 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.645526    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5" podUID="55d4a550-e7d1-4464-98a8-e7b8204aea78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 22:10:03.690662 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.690424    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" event={"ID":"e8048205-f020-49db-90e0-2c581f8cbc3f","Type":"ContainerStarted","Data":"8b66ea26f8e72abbcd0d67d901b57e5cb724f454f17cb1a6f7e6730b9b3fdd4c"}
Oct 30 22:10:03.690662 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.690493    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" event={"ID":"e8048205-f020-49db-90e0-2c581f8cbc3f","Type":"ContainerStarted","Data":"6896e3b4477ac239bf7e1a6b1e5fb1f975d30d9209e3fa6754314332082a1c1f"}
Oct 30 22:10:03.817536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.817483    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podStartSLOduration=1.8174678549999999 podStartE2EDuration="1.817467855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:03.813828817 +0000 UTC m=+1541.862436509" watchObservedRunningTime="2026-10-30 22:10:03.817467855 +0000 UTC m=+1541.866075551"
Oct 30 22:10:03.842773 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.842742    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:03.868318 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.868286    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"]
Oct 30 22:10:03.870564 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:10:03.870541    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d3af2f_d2e7_4368_86c1_0b99005186e8.slice/crio-2ce4a270332cba2a69e69c60a1d095e230a0d8923e113a28e65758f77f4bae9d WatchSource:0}: Error finding container 2ce4a270332cba2a69e69c60a1d095e230a0d8923e113a28e65758f77f4bae9d: Status 404 returned error can't find the container with id 2ce4a270332cba2a69e69c60a1d095e230a0d8923e113a28e65758f77f4bae9d
Oct 30 22:10:03.873636 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.873586    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:10:03.873735 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.873669    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:10:03.873774 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.873737    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:10:03.918473 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.918446    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"]
Oct 30 22:10:03.926694 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:10:03.926518    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf9fa16_1134_4be4_a24a_97e9e6b2d567.slice/crio-5c8848d7934a11c3e7ada680c6ca72e8bdedeaf6c8fc1b17d009c69647bc7dbe WatchSource:0}: Error finding container 5c8848d7934a11c3e7ada680c6ca72e8bdedeaf6c8fc1b17d009c69647bc7dbe: Status 404 returned error can't find the container with id 5c8848d7934a11c3e7ada680c6ca72e8bdedeaf6c8fc1b17d009c69647bc7dbe
Oct 30 22:10:03.929976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.929927    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:10:03.930128 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.930038    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:10:03.930128 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:03.930096    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:10:04.746803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:04.746748    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" event={"ID":"8cf9fa16-1134-4be4-a24a-97e9e6b2d567","Type":"ContainerStarted","Data":"5c17ed72dfa9e39ff11cda368357499448a55c8deb8efbd185bc9c5bb59ca476"}
Oct 30 22:10:04.747304 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:04.746843    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" event={"ID":"8cf9fa16-1134-4be4-a24a-97e9e6b2d567","Type":"ContainerStarted","Data":"5c8848d7934a11c3e7ada680c6ca72e8bdedeaf6c8fc1b17d009c69647bc7dbe"}
Oct 30 22:10:04.748831 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:04.748804    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" event={"ID":"a0d3af2f-d2e7-4368-86c1-0b99005186e8","Type":"ContainerStarted","Data":"e6c2aa2f0dfc2016db533c75cff81fe49c5c49caf61a0badb3f73ebfe600db60"}
Oct 30 22:10:04.748970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:04.748874    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" event={"ID":"a0d3af2f-d2e7-4368-86c1-0b99005186e8","Type":"ContainerStarted","Data":"2ce4a270332cba2a69e69c60a1d095e230a0d8923e113a28e65758f77f4bae9d"}
Oct 30 22:10:04.845940 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:04.845895    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:10:04.846152 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:04.845977    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:10:04.877713 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:04.876097    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" podStartSLOduration=2.876077183 podStartE2EDuration="2.876077183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:04.871859011 +0000 UTC m=+1542.920466709" watchObservedRunningTime="2026-10-30 22:10:04.876077183 +0000 UTC m=+1542.924684878"
Oct 30 22:10:05.019764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:05.016060    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:10:05.019764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:05.017485    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:10:05.019764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:05.019030    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:10:05.172017 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:05.171825    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" podStartSLOduration=3.171804065 podStartE2EDuration="3.171804065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:05.017965026 +0000 UTC m=+1543.066572718" watchObservedRunningTime="2026-10-30 22:10:05.171804065 +0000 UTC m=+1543.220411762"
Oct 30 22:10:05.484219 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:05.481039    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:05.513717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:05.508764    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:05.548709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:05.539240    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:10:05.548709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:05.539305    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 22:10:05.548709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:05.539626    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:10:05.548709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:05.539668    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 22:10:05.875764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:05.874848    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:10:05.875764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:05.874914    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:10:06.471220 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:06.471174    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:10:06.471405 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:06.471241    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 22:10:06.479968 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:06.479940    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:10:06.480114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:06.479984    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 22:10:06.853200 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:06.853105    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:10:06.855809 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:06.855766    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:10:07.478518 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:07.478483    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:10:07.565916 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:07.565876    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 22:10:07.566226 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:07.498830    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:10:07.582188 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:07.582127    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 22:10:07.876761 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:07.861639    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:10:07.876761 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:07.861720    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:10:08.157765 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:08.135585    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:08.297708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:08.297017    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:08.367103 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:08.367041    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:08.486763 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:08.391858    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:08.633710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:08.495638    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:10:08.633710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:08.518022    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 22:10:08.633710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:08.495920    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:10:08.633710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:08.518119    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 22:10:08.633710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:08.528258    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:08.633710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:08.615789    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:08.633710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:08.632088    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 22:10:08.845509 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:08.845410    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:10:08.845859 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:08.845766    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:10:08.991836 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:08.991788    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:09.298380 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.298334    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:09.335581 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.298994    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:10:09.449708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.445231    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 22:10:09.449708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.446108    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:10:09.485141 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.485107    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:10:09.486106 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.486069    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 22:10:09.486368 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.485386    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:10:09.501828 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.501773    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 22:10:09.518832 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.518781    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:09.519517 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.519491    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:10:09.584762 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.580589    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": context deadline exceeded"
Oct 30 22:10:09.584762 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.581041    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:10:09.835772 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.810297    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:10:09.923843 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.824839    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:09.924461 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.924432    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:10:09.924664 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.924649    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:10:09.925281 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.902755    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:10:09.925445 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:09.925419    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:10:10.163817 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:10.160067    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:10.370713 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:10.370561    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:10.458346 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:10.455801    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:10.460212 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:10.460121    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:10.494764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:10.494728    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:10:10.495066 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:10.495025    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 22:10:10.495236 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:10.495174    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:10:10.548847 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:10.521786    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 22:10:10.549799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:10.549761    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 22:10:10.581578 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:10.581532    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:10.605093 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:10.605033    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": context deadline exceeded"
Oct 30 22:10:10.957747 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:10.925174    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:10.974198 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:10.973938    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:10:10.977717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:10.974872    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:10:10.977717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:10.974922    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:10:11.014703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:11.013047    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:11.410770 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:11.371425    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:10:11.456205 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:11.456157    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:11.481837 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:11.481799    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:10:11.485812 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:11.485767    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 22:10:11.528714 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:11.509812    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:10:11.529046 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:11.529004    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 22:10:11.562235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:11.562188    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 22:10:11.614710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:11.589226    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:11.884770 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:11.850360    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:10:11.897716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:11.893811    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:10:12.002748 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:11.997742    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 22:10:12.002748 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:11.998516    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:10:12.010479 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:12.010438    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:12.399715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:12.380810    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:10:12.399715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:12.380882    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk" podUID="e3a89ded-e923-49b1-ba16-08c53edb68be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:12.456840 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:12.456789    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:12.509346 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:12.479072    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:10:12.509573 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:12.509540    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 22:10:12.509709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:12.482100    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:12.625561 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:12.615803    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:10:12.708868 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:12.708780    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 22:10:12.786710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:12.657804    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 22:10:12.835714 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:12.657870    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": context deadline exceeded"
Oct 30 22:10:12.880413 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:12.879822    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:10:12.880413 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:12.879894    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:10:13.121387 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:13.121265    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:10:13.158919 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:13.138045    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 22:10:13.521708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:13.486431    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:10:13.529853 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:13.529804    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 22:10:13.533849 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:13.513882    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 22:10:13.561226 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:13.513838    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:13.565702 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:13.488391    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:10:13.618969 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:10:13.538243    4918 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.263s"
Oct 30 22:10:13.625446 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:13.488750    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:10:13.625740 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:13.625705    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 22:10:13.627994 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:13.627938    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq" podUID="6ab4caf4-843c-46ef-a936-a8eb42f5053f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:13.844882 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:13.844775    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 22:10:13.847824 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:13.847786    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": context deadline exceeded"
Oct 30 22:10:13.868710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:13.859801    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:10:13.868710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:13.859864    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:10:14.129893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:14.129779    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:14.146725 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:14.140279    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:14.499717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:14.499031    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:10:14.499717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:14.499093    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 22:10:14.499717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:14.499410    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:10:14.499717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:14.499441    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 22:10:14.571809 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:14.571763    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:14.746794 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:14.639614    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:14.858407 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:14.858296    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:14.859248 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:14.859213    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:14.886047 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:14.877792    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:10:14.886047 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:14.877854    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:10:15.133875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:15.133766    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:15.142799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:15.142753    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:15.473437 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:15.473385    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:10:15.473781 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:15.473748    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 22:10:15.483164 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:15.483129    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:10:15.483392 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:15.483367    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 22:10:15.596894 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:15.596838    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:15.763900 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:15.763784    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:16.027764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:16.027125    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:10:16.027764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:16.027184    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:10:16.027764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:16.027254    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:16.027764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:16.027398    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 22:10:16.147420 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:16.147372    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:16.215332 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:16.214786    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:16.225717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:16.224559    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:16.554871 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:16.542808    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:10:16.554871 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:16.542867    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 22:10:16.554871 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:16.542954    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:10:16.554871 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:16.542978    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 22:10:16.611168 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:16.610855    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:16.765863 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:16.765789    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:16.873248 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:16.873161    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:10:16.873498 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:16.873470    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:10:16.990841 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:16.990795    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/health\": context deadline exceeded"
Oct 30 22:10:17.094248 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.088897    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:17.094248 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.091589    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:17.240329 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.240285    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:17.241249 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.241216    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 22:10:17.241768 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.241737    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:10:17.407040 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.407007    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:10:17.501289 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.499805    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:10:17.501289 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.499862    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 22:10:17.509953 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.509827    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:10:17.509953 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.509887    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 22:10:17.675526 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.675495    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:10:17.677272 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.677234    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:10:17.678698 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.678661    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:10:17.777650 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.777566    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:10:17.856552 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.856524    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:17.857515 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.857489    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 22:10:17.857714 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.857671    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 22:10:17.966094 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:17.966068    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:10:18.365910 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:18.365876    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:18.471517 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:18.471475    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:18.476609 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:18.476577    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 22:10:18.476799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:18.476640    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 22:10:18.479915 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:18.479887    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:18.480488 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:18.480461    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 30 22:10:18.480577 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:18.480531    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 30 22:10:18.662810 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:18.662771    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:19.380763 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:19.380730    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:19.383016 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:19.382992    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:10:19.545814 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:19.545778    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:19.547533 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:19.547507    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:10:19.715396 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:19.715363    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:19.716893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:19.716867    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:10:20.877462 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:20.877426    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:21.354747 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:21.354709    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:25.787709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:25.786458    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:27.576956 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:27.576921    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:28.025224 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.025186    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"]
Oct 30 22:10:28.031767 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.031743    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.084131 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.084092    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2678f4e1-openshift-default-dockercfg-qcrr6\""
Oct 30 22:10:28.138480 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.138448    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"]
Oct 30 22:10:28.157576 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.157545    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-data\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.157933 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.157909    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d2a049e-fc85-430d-858e-d63cf8a1de72-istiod-ca-cert\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.158193 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.158173    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-credential-socket\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.158593 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.158408    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-workload-socket\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.171149 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.171098    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-token\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.171391 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.171370    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-podinfo\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.171632 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.171612    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klq2v\" (UniqueName: \"kubernetes.io/projected/7d2a049e-fc85-430d-858e-d63cf8a1de72-kube-api-access-klq2v\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.171867 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.171848    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-workload-certs\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.172311 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.172269    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-envoy\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.258576 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.258537    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:28.488128 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.373845    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-envoy\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.488437 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.442194    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-envoy\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.499473 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.498934    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-data\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.499756 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.499731    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d2a049e-fc85-430d-858e-d63cf8a1de72-istiod-ca-cert\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.514093 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.499395    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-data\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.522809 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.513968    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d2a049e-fc85-430d-858e-d63cf8a1de72-istiod-ca-cert\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.538700 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.533079    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-credential-socket\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.538700 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.533444    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-credential-socket\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.538700 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.533594    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-workload-socket\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.538700 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.533623    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-token\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.538700 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.533887    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-podinfo\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.538700 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.533966    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klq2v\" (UniqueName: \"kubernetes.io/projected/7d2a049e-fc85-430d-858e-d63cf8a1de72-kube-api-access-klq2v\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.538700 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.534000    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-workload-certs\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.538700 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.534010    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-workload-socket\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.538700 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.534543    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-workload-certs\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.567216 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.560167    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-podinfo\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.596122 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.596091    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-token\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.596480 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.596383    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klq2v\" (UniqueName: \"kubernetes.io/projected/7d2a049e-fc85-430d-858e-d63cf8a1de72-kube-api-access-klq2v\") pod \"e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") " pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.645976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.645938    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:28.696818 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:28.696712    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:29.011492 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:29.011114    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:29.265326 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:29.265254    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:29.307225 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:29.307188    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"]
Oct 30 22:10:29.308329 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:10:29.308303    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2a049e_fc85_430d_858e_d63cf8a1de72.slice/crio-5e6f8a953990f55ebb802d5cd62b1d7cf716013e28b71c151723ab866b12c844 WatchSource:0}: Error finding container 5e6f8a953990f55ebb802d5cd62b1d7cf716013e28b71c151723ab866b12c844: Status 404 returned error can't find the container with id 5e6f8a953990f55ebb802d5cd62b1d7cf716013e28b71c151723ab866b12c844
Oct 30 22:10:29.310865 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:29.310834    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:10:29.310950 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:29.310902    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:10:29.310950 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:29.310944    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:10:29.487015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:29.483498    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m" event={"ID":"7d2a049e-fc85-430d-858e-d63cf8a1de72","Type":"ContainerStarted","Data":"5e6f8a953990f55ebb802d5cd62b1d7cf716013e28b71c151723ab866b12c844"}
Oct 30 22:10:29.714707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:29.714048    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:29.998920 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:29.988759    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:30.490983 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:30.490949    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m" event={"ID":"7d2a049e-fc85-430d-858e-d63cf8a1de72","Type":"ContainerStarted","Data":"64074f2f27bc9e928440ff0f907bec11fb23999d0bd7a95438a0654cc6d39e98"}
Oct 30 22:10:30.646283 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:30.646252    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:30.651526 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:30.651494    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:30.661869 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:30.661821    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m" podStartSLOduration=3.6618078 podStartE2EDuration="3.6618078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:30.659589305 +0000 UTC m=+1568.708196999" watchObservedRunningTime="2026-10-30 22:10:30.6618078 +0000 UTC m=+1568.710415531"
Oct 30 22:10:30.851759 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:30.837711    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:31.497934 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:31.497904    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:31.498771 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:31.498752    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:10:32.158092 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:10:32.158048    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:10:32.847652 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:32.847615    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:33.147642 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:33.147600    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:36.100995 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:36.100953    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:36.407082 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:36.407049    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:36.698098 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:36.697936    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:36.953392 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:36.953307    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:39.078435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:39.078394    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:39.346813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:39.346739    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:39.354596 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:39.354528    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"]
Oct 30 22:10:39.401404 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:39.401376    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"
Oct 30 22:10:39.425138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:39.425109    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"]
Oct 30 22:10:39.481940 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:39.481906    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-92ce375b\""
Oct 30 22:10:39.482384 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:39.482362    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-92ce375b-dockercfg-c7gmd\""
Oct 30 22:10:39.766770 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:39.762357    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77dac338-8f4e-4d2b-9977-bd989554fb67-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p\" (UID: \"77dac338-8f4e-4d2b-9977-bd989554fb67\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"
Oct 30 22:10:39.766770 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:39.762528    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8f84\" (UniqueName: \"kubernetes.io/projected/77dac338-8f4e-4d2b-9977-bd989554fb67-kube-api-access-t8f84\") pod \"payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p\" (UID: \"77dac338-8f4e-4d2b-9977-bd989554fb67\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"
Oct 30 22:10:39.874643 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:39.865975    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8f84\" (UniqueName: \"kubernetes.io/projected/77dac338-8f4e-4d2b-9977-bd989554fb67-kube-api-access-t8f84\") pod \"payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p\" (UID: \"77dac338-8f4e-4d2b-9977-bd989554fb67\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"
Oct 30 22:10:39.874643 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:39.866290    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77dac338-8f4e-4d2b-9977-bd989554fb67-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p\" (UID: \"77dac338-8f4e-4d2b-9977-bd989554fb67\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"
Oct 30 22:10:39.896391 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:39.896354    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77dac338-8f4e-4d2b-9977-bd989554fb67-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p\" (UID: \"77dac338-8f4e-4d2b-9977-bd989554fb67\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"
Oct 30 22:10:39.930694 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:39.930643    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8f84\" (UniqueName: \"kubernetes.io/projected/77dac338-8f4e-4d2b-9977-bd989554fb67-kube-api-access-t8f84\") pod \"payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p\" (UID: \"77dac338-8f4e-4d2b-9977-bd989554fb67\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"
Oct 30 22:10:40.035165 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:40.035098    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"
Oct 30 22:10:40.417434 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:40.417403    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"]
Oct 30 22:10:40.418637 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:10:40.418613    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77dac338_8f4e_4d2b_9977_bd989554fb67.slice/crio-37b48040e844c02eeb71578750884c5982e1e3350015ecac63734fd79966140e WatchSource:0}: Error finding container 37b48040e844c02eeb71578750884c5982e1e3350015ecac63734fd79966140e: Status 404 returned error can't find the container with id 37b48040e844c02eeb71578750884c5982e1e3350015ecac63734fd79966140e
Oct 30 22:10:40.843590 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:40.843497    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p" event={"ID":"77dac338-8f4e-4d2b-9977-bd989554fb67","Type":"ContainerStarted","Data":"44729489cd6af8d2ea970a1cf94babcc733126912ee1dfbab243b0f29d0fc01c"}
Oct 30 22:10:40.843590 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:40.843547    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p" event={"ID":"77dac338-8f4e-4d2b-9977-bd989554fb67","Type":"ContainerStarted","Data":"37b48040e844c02eeb71578750884c5982e1e3350015ecac63734fd79966140e"}
Oct 30 22:10:40.843869 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:40.843641    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"
Oct 30 22:10:40.959413 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:40.959363    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p" podStartSLOduration=1.959348952 podStartE2EDuration="1.959348952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:40.9578359 +0000 UTC m=+1579.006443595" watchObservedRunningTime="2026-10-30 22:10:40.959348952 +0000 UTC m=+1579.007956646"
Oct 30 22:10:41.523135 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:41.523103    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:42.028005 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:42.027977    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:42.308369 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:42.308266    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:43.220611 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:43.220581    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-6963-9ffabf"]
Oct 30 22:10:43.224946 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:43.224929    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6963-9ffabf"
Oct 30 22:10:43.277921 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:43.277897    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-6963-9ffabf"]
Oct 30 22:10:43.314636 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:43.314605    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5bql\" (UniqueName: \"kubernetes.io/projected/4da118b7-fe2c-4b21-a758-e5be3c329ebf-kube-api-access-x5bql\") pod \"test-curl-6963-9ffabf\" (UID: \"4da118b7-fe2c-4b21-a758-e5be3c329ebf\") " pod="opendatahub/test-curl-6963-9ffabf"
Oct 30 22:10:43.323341 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:43.323321    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-z48h6\""
Oct 30 22:10:43.415760 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:43.415724    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5bql\" (UniqueName: \"kubernetes.io/projected/4da118b7-fe2c-4b21-a758-e5be3c329ebf-kube-api-access-x5bql\") pod \"test-curl-6963-9ffabf\" (UID: \"4da118b7-fe2c-4b21-a758-e5be3c329ebf\") " pod="opendatahub/test-curl-6963-9ffabf"
Oct 30 22:10:43.476541 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:43.476475    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5bql\" (UniqueName: \"kubernetes.io/projected/4da118b7-fe2c-4b21-a758-e5be3c329ebf-kube-api-access-x5bql\") pod \"test-curl-6963-9ffabf\" (UID: \"4da118b7-fe2c-4b21-a758-e5be3c329ebf\") " pod="opendatahub/test-curl-6963-9ffabf"
Oct 30 22:10:43.536733 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:43.536714    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6963-9ffabf"
Oct 30 22:10:43.917327 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:43.917300    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-6963-9ffabf"]
Oct 30 22:10:43.918570 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:10:43.918540    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4da118b7_fe2c_4b21_a758_e5be3c329ebf.slice/crio-77c824c783c670fb4076e695a6b52e7dfeb3cb22a0393d1bc7d681da4d83b3a9 WatchSource:0}: Error finding container 77c824c783c670fb4076e695a6b52e7dfeb3cb22a0393d1bc7d681da4d83b3a9: Status 404 returned error can't find the container with id 77c824c783c670fb4076e695a6b52e7dfeb3cb22a0393d1bc7d681da4d83b3a9
Oct 30 22:10:43.920675 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:43.920656    4918 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:10:44.007899 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:44.007871    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:44.724718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:44.723359    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:44.940546 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:44.940509    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-6963-9ffabf" event={"ID":"4da118b7-fe2c-4b21-a758-e5be3c329ebf","Type":"ContainerStarted","Data":"77c824c783c670fb4076e695a6b52e7dfeb3cb22a0393d1bc7d681da4d83b3a9"}
Oct 30 22:10:45.058763 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:45.053727    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:46.468709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:46.457843    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:46.554839 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:46.554794    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 22:10:46.568574 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:46.568529    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:46.598821 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:46.598772    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": context deadline exceeded"
Oct 30 22:10:46.995706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:46.965788    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:46.995706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:46.966522    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/health\": context deadline exceeded"
Oct 30 22:10:46.999706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:46.999647    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:47.370769 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:47.022474    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:10:47.370769 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:47.370445    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj" podUID="1fec41f1-9d5d-410f-99ac-299ee5385f24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:47.536718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:47.463415    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:47.609706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:47.581446    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:47.630445 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:47.630356    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:10:47.631695 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:47.604846    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:47.631959 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:47.587453    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:47.632376 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:47.631701    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:10:47.633243 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:47.633206    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:10:47.633352 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:47.633303    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:10:47.851030 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:47.850948    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:47.910627 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:47.910570    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": context deadline exceeded"
Oct 30 22:10:47.970711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:47.968106    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:47.979779 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:47.977065    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:10:48.096733 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:48.096673    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:48.379763 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:48.373837    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:48.379763 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:48.375583    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:10:48.627713 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:48.612279    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:48.762876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:48.661462    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:48.762876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:48.710976    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": context deadline exceeded"
Oct 30 22:10:48.762876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:48.711623    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:10:48.996765 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:48.972116    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:49.031074 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:49.031023    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:49.376467 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:49.376369    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:10:49.906708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:49.893023    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:49.906708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:49.901329    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:49.915869 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:49.908009    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:50.067781 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:49.908097    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 22:10:50.097578 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:49.972536    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:50.430231 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:50.430188    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:10:50.506900 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:50.506841    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:10:50.507245 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:50.507192    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:50.594138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:50.594086    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:50.665174 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:50.665133    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:10:50.694766 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:50.693922    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc" podUID="11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:50.785040 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:50.784998    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:10:50.785331 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:50.785297    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn" podUID="4d1b6193-937c-4cd5-bc88-a29ed981fbe9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:50.897354 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:50.896255    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:10:50.929752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:50.907656    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:51.017148 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:51.000860    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:10:51.017148 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:51.000930    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n" podUID="05857f11-e5bc-4236-8811-0b43c6661c1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:51.110718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:51.106913    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 22:10:51.110718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:51.108643    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": context deadline exceeded"
Oct 30 22:10:51.110718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:51.109095    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:10:51.110718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:51.109134    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h" podUID="0a926b1b-b3d0-4e0b-9198-e5479766f1db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:51.153707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:51.111198    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:51.155996 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:51.155844    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:10:51.155996 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:51.155906    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5" podUID="55d4a550-e7d1-4464-98a8-e7b8204aea78" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:51.553707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:51.525384    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:10:51.886507 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:51.877672    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:51.896884 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:51.896825    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:52.084942 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:51.964914    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 22:10:52.088131 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:52.008865    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"
Oct 30 22:10:52.121818 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:52.121768    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 22:10:52.791708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:52.192599    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 22:10:52.816704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:52.245747    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:52.816704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:52.692182    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:10:52.987406 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:52.987358    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-ksqwd" podUID="1150673c-da76-4039-a140-830fcd2b5673" containerName="main" probeResult="failure" output="Get \"https://10.132.0.36:8000/ready\": context deadline exceeded"
Oct 30 22:10:52.988044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:52.988011    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-dlqgz" podUID="f2f7fac5-efa4-4b44-a61c-a707942ed520" containerName="main" probeResult="failure" output="Get \"https://10.132.0.37:8000/health\": context deadline exceeded"
Oct 30 22:10:53.149766 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:53.148733    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd" podUID="028c3206-7879-46be-a78b-5e5b1ad9086f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.38:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:53.150715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:53.150655    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:10:53.151891 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:53.151860    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:10:53.428735 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:53.428644    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:10:53.429798 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:53.429771    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:10:53.433413 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:53.433090    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:10:53.433413 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:53.433143    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:10:53.433571 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:53.433498    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:10:53.435479 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:53.434926    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:10:54.922342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:54.922249    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:55.242758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:55.239382    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:55.717997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:55.717953    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-6963-9ffabf" event={"ID":"4da118b7-fe2c-4b21-a758-e5be3c329ebf","Type":"ContainerStarted","Data":"bcc8323f71bc0e596f8dc2507296c9834b5cefd2d94f5989e3fd9d67287437c0"}
Oct 30 22:10:55.832434 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:55.832386    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-6963-9ffabf" podStartSLOduration=1.719938682 podStartE2EDuration="12.832371787s" totalImagesPullingTime="11.112433105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:55.830667446 +0000 UTC m=+1593.879275144" watchObservedRunningTime="2026-10-30 22:10:55.832371787 +0000 UTC m=+1593.880979481"
Oct 30 22:10:57.303143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:57.303111    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-6963-9ffabf"]
Oct 30 22:10:57.306979 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:57.306952    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-6963-9ffabf"]
Oct 30 22:10:57.458038 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:57.457999    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:57.720250 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:57.720217    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:57.731437 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:57.731401    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-6963-9ffabf" podUID="4da118b7-fe2c-4b21-a758-e5be3c329ebf" containerName="test-curl-6963-9ffabf" containerID="cri-o://bcc8323f71bc0e596f8dc2507296c9834b5cefd2d94f5989e3fd9d67287437c0" gracePeriod=2
Oct 30 22:10:57.781984 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:10:57.781946    4918 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-6963-9ffabf\" is forbidden: User \"system:node:ip-10-0-142-154.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-154.us-west-1.compute.internal' and this object" podUID="4da118b7-fe2c-4b21-a758-e5be3c329ebf" pod="opendatahub/test-curl-6963-9ffabf"
Oct 30 22:10:58.105787 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.105659    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:58.476192 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.476041    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:58.591717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.590917    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"]
Oct 30 22:10:58.592714 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.592048    4918 cpu_manager.go:414] "containerMap: removing container" podUID="4da118b7-fe2c-4b21-a758-e5be3c329ebf" containerName="test-curl-6963-9ffabf"
Oct 30 22:10:58.592714 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.592073    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4da118b7-fe2c-4b21-a758-e5be3c329ebf" containerName="test-curl-6963-9ffabf"
Oct 30 22:10:58.592714 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.592278    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="4da118b7-fe2c-4b21-a758-e5be3c329ebf" containerName="test-curl-6963-9ffabf"
Oct 30 22:10:58.644744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.636447    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"]
Oct 30 22:10:58.650058 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.636463    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"
Oct 30 22:10:58.720527 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.720496    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-b8490f04\""
Oct 30 22:10:58.767034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.767002    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"]
Oct 30 22:10:58.771784 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.771739    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45e194f0-6310-42a5-9a5b-3b119015bca6-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5\" (UID: \"45e194f0-6310-42a5-9a5b-3b119015bca6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"
Oct 30 22:10:58.772292 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.772268    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcksc\" (UniqueName: \"kubernetes.io/projected/45e194f0-6310-42a5-9a5b-3b119015bca6-kube-api-access-bcksc\") pod \"payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5\" (UID: \"45e194f0-6310-42a5-9a5b-3b119015bca6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"
Oct 30 22:10:58.784719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.783956    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-b8490f04-dockercfg-f4b7v\""
Oct 30 22:10:58.810567 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.809715    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:58.876237 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.876200    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45e194f0-6310-42a5-9a5b-3b119015bca6-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5\" (UID: \"45e194f0-6310-42a5-9a5b-3b119015bca6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"
Oct 30 22:10:58.876441 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.876420    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcksc\" (UniqueName: \"kubernetes.io/projected/45e194f0-6310-42a5-9a5b-3b119015bca6-kube-api-access-bcksc\") pod \"payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5\" (UID: \"45e194f0-6310-42a5-9a5b-3b119015bca6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"
Oct 30 22:10:58.877884 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.877863    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"]
Oct 30 22:10:58.878176 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.878154    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"
Oct 30 22:10:58.882528 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.882501    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45e194f0-6310-42a5-9a5b-3b119015bca6-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5\" (UID: \"45e194f0-6310-42a5-9a5b-3b119015bca6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"
Oct 30 22:10:58.941382 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:58.941346    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcksc\" (UniqueName: \"kubernetes.io/projected/45e194f0-6310-42a5-9a5b-3b119015bca6-kube-api-access-bcksc\") pod \"payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5\" (UID: \"45e194f0-6310-42a5-9a5b-3b119015bca6\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"
Oct 30 22:10:59.016844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:59.012759    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqb5g\" (UniqueName: \"kubernetes.io/projected/318fcd2e-7f9e-471b-84d5-ac7abd6b5624-kube-api-access-dqb5g\") pod \"payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q\" (UID: \"318fcd2e-7f9e-471b-84d5-ac7abd6b5624\") " pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"
Oct 30 22:10:59.020703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:59.017173    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/318fcd2e-7f9e-471b-84d5-ac7abd6b5624-plugins-config-volume\") pod \"payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q\" (UID: \"318fcd2e-7f9e-471b-84d5-ac7abd6b5624\") " pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"
Oct 30 22:10:59.080711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:59.078968    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"
Oct 30 22:10:59.095814 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:59.084769    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:59.149726 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:59.148465    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/318fcd2e-7f9e-471b-84d5-ac7abd6b5624-plugins-config-volume\") pod \"payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q\" (UID: \"318fcd2e-7f9e-471b-84d5-ac7abd6b5624\") " pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"
Oct 30 22:10:59.149726 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:59.148913    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqb5g\" (UniqueName: \"kubernetes.io/projected/318fcd2e-7f9e-471b-84d5-ac7abd6b5624-kube-api-access-dqb5g\") pod \"payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q\" (UID: \"318fcd2e-7f9e-471b-84d5-ac7abd6b5624\") " pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"
Oct 30 22:10:59.153878 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:59.150167    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/318fcd2e-7f9e-471b-84d5-ac7abd6b5624-plugins-config-volume\") pod \"payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q\" (UID: \"318fcd2e-7f9e-471b-84d5-ac7abd6b5624\") " pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"
Oct 30 22:10:59.216722 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:59.216656    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqb5g\" (UniqueName: \"kubernetes.io/projected/318fcd2e-7f9e-471b-84d5-ac7abd6b5624-kube-api-access-dqb5g\") pod \"payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q\" (UID: \"318fcd2e-7f9e-471b-84d5-ac7abd6b5624\") " pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"
Oct 30 22:10:59.420500 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:59.420469    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:59.507796 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:59.507765    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"
Oct 30 22:10:59.639725 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:59.639697    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"]
Oct 30 22:10:59.640937 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:10:59.640914    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e194f0_6310_42a5_9a5b_3b119015bca6.slice/crio-26a5480dce4040404990ea46ce4e142f0a2425c1da00907a29e8bd1091c7bc2c WatchSource:0}: Error finding container 26a5480dce4040404990ea46ce4e142f0a2425c1da00907a29e8bd1091c7bc2c: Status 404 returned error can't find the container with id 26a5480dce4040404990ea46ce4e142f0a2425c1da00907a29e8bd1091c7bc2c
Oct 30 22:10:59.770973 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:59.770943    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5" event={"ID":"45e194f0-6310-42a5-9a5b-3b119015bca6","Type":"ContainerStarted","Data":"b26143c6e6089e42107549e606201c803a25c8ed7cea1fb9ba9c810544c2cebb"}
Oct 30 22:10:59.771096 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:59.771002    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5" event={"ID":"45e194f0-6310-42a5-9a5b-3b119015bca6","Type":"ContainerStarted","Data":"26a5480dce4040404990ea46ce4e142f0a2425c1da00907a29e8bd1091c7bc2c"}
Oct 30 22:10:59.771096 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:59.771030    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"
Oct 30 22:10:59.894136 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:59.894071    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5" podStartSLOduration=1.8940520360000002 podStartE2EDuration="1.894052036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:10:59.885342611 +0000 UTC m=+1597.933950307" watchObservedRunningTime="2026-10-30 22:10:59.894052036 +0000 UTC m=+1597.942659731"
Oct 30 22:10:59.901236 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:10:59.901198    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod318fcd2e_7f9e_471b_84d5_ac7abd6b5624.slice/crio-b4752180600f60a948b10e274c3c9f3795bea962bef5a8c20a5e658143006c54 WatchSource:0}: Error finding container b4752180600f60a948b10e274c3c9f3795bea962bef5a8c20a5e658143006c54: Status 404 returned error can't find the container with id b4752180600f60a948b10e274c3c9f3795bea962bef5a8c20a5e658143006c54
Oct 30 22:10:59.903138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:10:59.903113    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"]
Oct 30 22:11:00.154930 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:00.154907    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6963-9ffabf"
Oct 30 22:11:00.283266 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:00.283231    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4da118b7-fe2c-4b21-a758-e5be3c329ebf-kube-api-access-x5bql\" (UniqueName: \"kubernetes.io/projected/4da118b7-fe2c-4b21-a758-e5be3c329ebf-kube-api-access-x5bql\") pod \"4da118b7-fe2c-4b21-a758-e5be3c329ebf\" (UID: \"4da118b7-fe2c-4b21-a758-e5be3c329ebf\") "
Oct 30 22:11:00.285754 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:00.285727    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4da118b7-fe2c-4b21-a758-e5be3c329ebf-kube-api-access-x5bql" pod "4da118b7-fe2c-4b21-a758-e5be3c329ebf" (UID: "4da118b7-fe2c-4b21-a758-e5be3c329ebf"). InnerVolumeSpecName "kube-api-access-x5bql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:11:00.405237 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:00.404953    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5bql\" (UniqueName: \"kubernetes.io/projected/4da118b7-fe2c-4b21-a758-e5be3c329ebf-kube-api-access-x5bql\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:11:00.455967 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:00.454748    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:00.780464 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:00.780366    4918 generic.go:356] "Generic (PLEG): container finished" podID="4da118b7-fe2c-4b21-a758-e5be3c329ebf" containerID="bcc8323f71bc0e596f8dc2507296c9834b5cefd2d94f5989e3fd9d67287437c0" exitCode=137
Oct 30 22:11:00.780464 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:00.780423    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6963-9ffabf"
Oct 30 22:11:00.780464 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:00.780437    4918 scope.go:122] "RemoveContainer" containerID="bcc8323f71bc0e596f8dc2507296c9834b5cefd2d94f5989e3fd9d67287437c0"
Oct 30 22:11:00.782544 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:00.782515    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q" event={"ID":"318fcd2e-7f9e-471b-84d5-ac7abd6b5624","Type":"ContainerStarted","Data":"b178621171221671c13d22cf44e1b519cc9c212700761fe1e66ec562e855beae"}
Oct 30 22:11:00.782700 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:00.782570    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q" event={"ID":"318fcd2e-7f9e-471b-84d5-ac7abd6b5624","Type":"ContainerStarted","Data":"b4752180600f60a948b10e274c3c9f3795bea962bef5a8c20a5e658143006c54"}
Oct 30 22:11:00.782847 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:00.782825    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"
Oct 30 22:11:00.795376 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:00.795360    4918 scope.go:122] "RemoveContainer" containerID="bcc8323f71bc0e596f8dc2507296c9834b5cefd2d94f5989e3fd9d67287437c0"
Oct 30 22:11:00.795665 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:11:00.795644    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcc8323f71bc0e596f8dc2507296c9834b5cefd2d94f5989e3fd9d67287437c0\": container with ID starting with bcc8323f71bc0e596f8dc2507296c9834b5cefd2d94f5989e3fd9d67287437c0 not found: ID does not exist" containerID="bcc8323f71bc0e596f8dc2507296c9834b5cefd2d94f5989e3fd9d67287437c0"
Oct 30 22:11:00.795784 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:00.795675    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcc8323f71bc0e596f8dc2507296c9834b5cefd2d94f5989e3fd9d67287437c0"} err="failed to get container status \"bcc8323f71bc0e596f8dc2507296c9834b5cefd2d94f5989e3fd9d67287437c0\": rpc error: code = NotFound desc = could not find container \"bcc8323f71bc0e596f8dc2507296c9834b5cefd2d94f5989e3fd9d67287437c0\": container with ID starting with bcc8323f71bc0e596f8dc2507296c9834b5cefd2d94f5989e3fd9d67287437c0 not found: ID does not exist"
Oct 30 22:11:00.900697 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:00.900628    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q" podStartSLOduration=2.900609672 podStartE2EDuration="2.900609672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:10:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:11:00.897601839 +0000 UTC m=+1598.946209533" watchObservedRunningTime="2026-10-30 22:11:00.900609672 +0000 UTC m=+1598.949217410"
Oct 30 22:11:00.948289 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:11:00.948249    4918 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-6963-9ffabf\" is forbidden: User \"system:node:ip-10-0-142-154.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-154.us-west-1.compute.internal' and this object" podUID="4da118b7-fe2c-4b21-a758-e5be3c329ebf" pod="opendatahub/test-curl-6963-9ffabf"
Oct 30 22:11:02.075588 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:02.075552    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4da118b7-fe2c-4b21-a758-e5be3c329ebf" path="/var/lib/kubelet/pods/4da118b7-fe2c-4b21-a758-e5be3c329ebf/volumes"
Oct 30 22:11:02.119595 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:11:02.119556    4918 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-6963-9ffabf\" is forbidden: User \"system:node:ip-10-0-142-154.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-154.us-west-1.compute.internal' and this object" podUID="4da118b7-fe2c-4b21-a758-e5be3c329ebf" pod="opendatahub/test-curl-6963-9ffabf"
Oct 30 22:11:02.160960 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:11:02.160921    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:11:05.239957 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:05.239923    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:05.544889 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:05.544799    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:05.902393 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:05.902357    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:10.221613 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:10.221577    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:10.786398 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:10.786370    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"
Oct 30 22:11:11.793631 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:11.793599    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"
Oct 30 22:11:12.285294 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:12.285248    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:12.585724 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:12.585616    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:15.127567 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:15.127529    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:17.181312 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:17.181271    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:19.536172 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:19.536125    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"]
Oct 30 22:11:19.543429 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:19.543410    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:19.595654 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:19.595624    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-2678f4e1-serving-cert\""
Oct 30 22:11:19.600554 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:19.600526    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"]
Oct 30 22:11:19.630096 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:19.630068    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj4nc\" (UniqueName: \"kubernetes.io/projected/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-kube-api-access-kj4nc\") pod \"maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:19.630222 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:19.630107    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-metrics-certs\") pod \"maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:19.630289 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:19.630252    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-openshift-service-ca\") pod \"maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:19.630338 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:19.630305    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-maas-api-tls\") pod \"maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:19.731722 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:19.731672    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj4nc\" (UniqueName: \"kubernetes.io/projected/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-kube-api-access-kj4nc\") pod \"maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:19.731872 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:19.731733    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-metrics-certs\") pod \"maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:19.731872 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:19.731838    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-openshift-service-ca\") pod \"maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:19.731949 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:19.731900    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-maas-api-tls\") pod \"maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:19.732071 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:11:19.732054    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-serving-cert: secret "maas-api-e2e-ait-2678f4e1-serving-cert" not found
Oct 30 22:11:19.732131 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:11:19.732113    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-maas-api-tls podName:b0de5eef-cdaa-41be-9a96-0c95c62c0cf6 nodeName:}" failed. No retries permitted until 2026-10-30 22:11:20.232099568 +0000 UTC m=+1618.280707241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-maas-api-tls") pod "maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d" (UID: "b0de5eef-cdaa-41be-9a96-0c95c62c0cf6") : secret "maas-api-e2e-ait-2678f4e1-serving-cert" not found
Oct 30 22:11:19.732471 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:19.732454    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-openshift-service-ca\") pod \"maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:19.734411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:19.734386    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-metrics-certs\") pod \"maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:19.838762 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:19.837008    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj4nc\" (UniqueName: \"kubernetes.io/projected/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-kube-api-access-kj4nc\") pod \"maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:19.838937 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:19.838778    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:20.104537 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:20.104369    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:20.247535 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:20.247494    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-maas-api-tls\") pod \"maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:20.249881 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:20.249856    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-maas-api-tls\") pod \"maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:20.458194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:20.458168    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:20.840338 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:20.840308    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"]
Oct 30 22:11:20.841103 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:11:20.841076    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0de5eef_cdaa_41be_9a96_0c95c62c0cf6.slice/crio-7609b2ea99636ef0a782d1f5566f19aa00f4da241ea34381cc2ac8aae5d07e61 WatchSource:0}: Error finding container 7609b2ea99636ef0a782d1f5566f19aa00f4da241ea34381cc2ac8aae5d07e61: Status 404 returned error can't find the container with id 7609b2ea99636ef0a782d1f5566f19aa00f4da241ea34381cc2ac8aae5d07e61
Oct 30 22:11:20.940720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:20.940672    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d" event={"ID":"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6","Type":"ContainerStarted","Data":"7609b2ea99636ef0a782d1f5566f19aa00f4da241ea34381cc2ac8aae5d07e61"}
Oct 30 22:11:21.425740 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:21.425708    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:21.795742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:21.795608    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:21.948667 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:21.948632    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d" event={"ID":"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6","Type":"ContainerStarted","Data":"daa2881f2581f8c8bceacc71efde022e751fea3ec652b5d282c5b648d61eca2b"}
Oct 30 22:11:21.949057 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:21.948762    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:22.292339 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:22.292269    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d" podStartSLOduration=2.407618783 podStartE2EDuration="3.292249314s" totalImagesPullingTime="884.630531ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:11:22.154574984 +0000 UTC m=+1620.203182681" watchObservedRunningTime="2026-10-30 22:11:22.292249314 +0000 UTC m=+1620.340857010"
Oct 30 22:11:22.432946 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:22.432910    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:22.737531 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:22.737498    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:23.863219 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:23.863170    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:25.374174 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.366499    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"]
Oct 30 22:11:25.389283 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.389252    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:25.421493 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.421412    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"]
Oct 30 22:11:25.483709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.477827    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-92ce375b-serving-cert\""
Oct 30 22:11:25.569716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.568696    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-maas-api-tls\") pod \"maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:25.569716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.568814    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-openshift-service-ca\") pod \"maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:25.569716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.568963    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbltd\" (UniqueName: \"kubernetes.io/projected/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-kube-api-access-jbltd\") pod \"maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:25.569716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.569026    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-metrics-certs\") pod \"maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:25.661250 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.661216    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:25.692730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.673281    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-openshift-service-ca\") pod \"maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:25.692730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.673460    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbltd\" (UniqueName: \"kubernetes.io/projected/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-kube-api-access-jbltd\") pod \"maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:25.692730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.673529    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-metrics-certs\") pod \"maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:25.692730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.673727    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-maas-api-tls\") pod \"maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:25.692730 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:11:25.673891    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-serving-cert: secret "maas-api-e2e-migrate-92ce375b-serving-cert" not found
Oct 30 22:11:25.692730 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:11:25.673959    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-maas-api-tls podName:6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27 nodeName:}" failed. No retries permitted until 2026-10-30 22:11:26.173936704 +0000 UTC m=+1624.222544399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-maas-api-tls") pod "maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs" (UID: "6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27") : secret "maas-api-e2e-migrate-92ce375b-serving-cert" not found
Oct 30 22:11:25.700785 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.697534    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-openshift-service-ca\") pod \"maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:25.771137 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.748328    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 22:11:25.771137 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.748670    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:11:25.952765 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.948864    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:11:25.986545 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:25.986510    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:26.157473 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:26.111507    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 22:11:26.211802 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:26.192631    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-metrics-certs\") pod \"maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:26.280737 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:26.279394    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbltd\" (UniqueName: \"kubernetes.io/projected/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-kube-api-access-jbltd\") pod \"maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:26.293931 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:26.281355    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:26.293931 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:26.282501    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-maas-api-tls\") pod \"maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:26.385709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:26.384898    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-maas-api-tls\") pod \"maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:26.412916 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:26.412858    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:11:26.643498 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:26.643459    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:26.752818 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:26.752774    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 22:11:26.755818 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:26.755790    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:11:26.756942 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:26.752774    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:11:26.757858 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:26.752816    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:11:26.758261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:26.758244    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:11:27.004940 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:26.984532    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:11:27.106707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:27.077825    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:11:27.106707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:27.079239    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:11:27.138127 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:27.138097    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:11:27.245959 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:27.243029    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:11:27.419055 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:27.419006    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:11:27.481726 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:27.467335    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:11:27.503235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:27.503205    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:11:27.766528 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:27.763048    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:11:27.766528 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:27.765052    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:11:27.955281 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:27.936067    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/health\": context deadline exceeded"
Oct 30 22:11:27.956488 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:27.956452    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:28.190619 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:28.190574    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:11:28.190846 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:28.190639    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:11:28.190926 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:28.190858    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:11:28.190980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:28.190927    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:11:28.201557 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:28.201519    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"]
Oct 30 22:11:28.270286 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:28.270249    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:28.469233 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:28.469141    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs" event={"ID":"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27","Type":"ContainerStarted","Data":"0c5b2723bb7de888aea0b646b86e6b5ab803f623987af1953ea139e3871becc9"}
Oct 30 22:11:29.476600 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:29.476560    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs" event={"ID":"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27","Type":"ContainerStarted","Data":"efe39adebd5b011914472569736af63c704132324530a8f9779bf85f25674c7e"}
Oct 30 22:11:29.477041 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:29.476751    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:29.598295 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:29.598229    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs" podStartSLOduration=3.613091961 podStartE2EDuration="4.598208415s" totalImagesPullingTime="985.116454ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:11:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:11:29.59338933 +0000 UTC m=+1627.641997026" watchObservedRunningTime="2026-10-30 22:11:29.598208415 +0000 UTC m=+1627.646816112"
Oct 30 22:11:30.974725 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:30.969459    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:31.264523 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:31.264410    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:31.569085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:31.569002    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:32.161329 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:11:32.161294    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:11:35.490299 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:35.490273    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:11:36.129481 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:36.129399    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:40.923441 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:40.923405    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:45.378492 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.378453    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"]
Oct 30 22:11:45.383183 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.383159    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:45.437406 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.437382    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-b8490f04-serving-cert\""
Oct 30 22:11:45.476523 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.476494    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-metrics-certs\") pod \"maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:45.476653 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.476539    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6n7l\" (UniqueName: \"kubernetes.io/projected/3ced892b-6a91-43f1-b44d-62857db6004a-kube-api-access-d6n7l\") pod \"maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:45.476844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.476822    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-maas-api-tls\") pod \"maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:45.477012 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.476987    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ced892b-6a91-43f1-b44d-62857db6004a-openshift-service-ca\") pod \"maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:45.490748 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.490726    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"]
Oct 30 22:11:45.578141 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.578105    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-maas-api-tls\") pod \"maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:45.578301 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:11:45.578246    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-serving-cert: secret "maas-api-e2e-derive-b8490f04-serving-cert" not found
Oct 30 22:11:45.578369 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.578249    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ced892b-6a91-43f1-b44d-62857db6004a-openshift-service-ca\") pod \"maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:45.578369 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:11:45.578311    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-maas-api-tls podName:3ced892b-6a91-43f1-b44d-62857db6004a nodeName:}" failed. No retries permitted until 2026-10-30 22:11:46.078295591 +0000 UTC m=+1644.126903295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-maas-api-tls") pod "maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk" (UID: "3ced892b-6a91-43f1-b44d-62857db6004a") : secret "maas-api-e2e-derive-b8490f04-serving-cert" not found
Oct 30 22:11:45.578497 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.578400    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-metrics-certs\") pod \"maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:45.578497 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.578430    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6n7l\" (UniqueName: \"kubernetes.io/projected/3ced892b-6a91-43f1-b44d-62857db6004a-kube-api-access-d6n7l\") pod \"maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:45.578922 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.578901    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ced892b-6a91-43f1-b44d-62857db6004a-openshift-service-ca\") pod \"maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:45.580923 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.580902    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-metrics-certs\") pod \"maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:45.665711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.659468    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6n7l\" (UniqueName: \"kubernetes.io/projected/3ced892b-6a91-43f1-b44d-62857db6004a-kube-api-access-d6n7l\") pod \"maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:45.732710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.728120    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:45.985106 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:45.985023    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:46.087273 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:46.087244    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-maas-api-tls\") pod \"maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:46.089850 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:46.089821    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-maas-api-tls\") pod \"maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:46.297520 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:46.297436    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:46.679762 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:46.679735    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"]
Oct 30 22:11:46.680694 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:11:46.680650    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ced892b_6a91_43f1_b44d_62857db6004a.slice/crio-32722f91f8f8601d3738778ba07eb60b371de33e7bf4debcf6a9f9562535463a WatchSource:0}: Error finding container 32722f91f8f8601d3738778ba07eb60b371de33e7bf4debcf6a9f9562535463a: Status 404 returned error can't find the container with id 32722f91f8f8601d3738778ba07eb60b371de33e7bf4debcf6a9f9562535463a
Oct 30 22:11:46.731020 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:46.730995    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk" event={"ID":"3ced892b-6a91-43f1-b44d-62857db6004a","Type":"ContainerStarted","Data":"32722f91f8f8601d3738778ba07eb60b371de33e7bf4debcf6a9f9562535463a"}
Oct 30 22:11:47.739807 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:47.739716    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk" event={"ID":"3ced892b-6a91-43f1-b44d-62857db6004a","Type":"ContainerStarted","Data":"66ae76f4ae2a885d458a8b5ece773d2ab287ab567d4ff64229393881fe67ec46"}
Oct 30 22:11:47.739807 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:47.739784    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:47.859091 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:47.859027    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk" podStartSLOduration=2.079455014 podStartE2EDuration="2.859011156s" totalImagesPullingTime="779.556142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:11:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:11:47.857261676 +0000 UTC m=+1645.905869371" watchObservedRunningTime="2026-10-30 22:11:47.859011156 +0000 UTC m=+1645.907618852"
Oct 30 22:11:48.675262 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.672472    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"]
Oct 30 22:11:48.678578 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.678552    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.733030 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.732973    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"]
Oct 30 22:11:48.737817 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.737793    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.738162 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.738142    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"]
Oct 30 22:11:48.761509 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.761483    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-v5mg8\""
Oct 30 22:11:48.784286 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.784256    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"]
Oct 30 22:11:48.835938 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.835902    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.836097 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.835955    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.836097 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.836016    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.836097 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.836064    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.836288 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.836099    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.836288 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.836139    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.836288 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.836179    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.836288 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.836208    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.836288 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.836244    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.836619 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.836348    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.836619 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.836408    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.836619 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.836554    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.836811 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.836726    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.836811 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.836752    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.836811 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.836780    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9fm8\" (UniqueName: \"kubernetes.io/projected/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-kube-api-access-q9fm8\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.836973 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.836841    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.837097 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.837077    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.837167 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.837107    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwjpz\" (UniqueName: \"kubernetes.io/projected/dc87536c-72a7-4afb-9a5b-28d69ef186ab-kube-api-access-kwjpz\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.938511 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.938450    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.938511 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.938498    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.938661 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.938535    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9fm8\" (UniqueName: \"kubernetes.io/projected/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-kube-api-access-q9fm8\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.938661 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.938564    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.938661 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.938621    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.938661 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.938641    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwjpz\" (UniqueName: \"kubernetes.io/projected/dc87536c-72a7-4afb-9a5b-28d69ef186ab-kube-api-access-kwjpz\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.938877 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.938674    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.938931 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.938903    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.938931 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.938924    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.939040 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.938948    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.939040 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.938968    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.939040 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.938984    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.939040 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.938988    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.939244 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.939209    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.939343 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.939319    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.939415 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.939385    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.939528 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.939509    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.939864 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.939842    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.939960 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.939536    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.939960 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.939872    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.939960 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.939940    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.940072 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.940004    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.940072 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.940035    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.940151 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.940116    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.940206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.940195    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.940542 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.940306    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.940542 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.940334    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.940542 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.940503    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.941383 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.941358    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.941623 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.941606    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:48.941747 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.941726    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.942596 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.942580    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.999772 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.999746    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:48.999946 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:48.999926    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwjpz\" (UniqueName: \"kubernetes.io/projected/dc87536c-72a7-4afb-9a5b-28d69ef186ab-kube-api-access-kwjpz\") pod \"maas-default-gateway-openshift-default-6cc458d887-b2m7w\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:49.000052 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.000030    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9fm8\" (UniqueName: \"kubernetes.io/projected/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-kube-api-access-q9fm8\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:49.000637 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.000613    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-tm497\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:49.024377 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.024358    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:49.055906 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.055876    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:49.467651 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:11:49.467622    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc87536c_72a7_4afb_9a5b_28d69ef186ab.slice/crio-3e9fcb1fb731fa64ec0e8d9381167b641a9d621ba42a88005ca0f91676fcc3c7 WatchSource:0}: Error finding container 3e9fcb1fb731fa64ec0e8d9381167b641a9d621ba42a88005ca0f91676fcc3c7: Status 404 returned error can't find the container with id 3e9fcb1fb731fa64ec0e8d9381167b641a9d621ba42a88005ca0f91676fcc3c7
Oct 30 22:11:49.468031 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.468015    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"]
Oct 30 22:11:49.471453 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.471419    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:11:49.471453 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:11:49.471444    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aed0330_8b15_4d4b_ade5_ae5c7a4877e8.slice/crio-959da1906072732ee074dbdb13a7511d3be221047065836bacaf04d32c595273 WatchSource:0}: Error finding container 959da1906072732ee074dbdb13a7511d3be221047065836bacaf04d32c595273: Status 404 returned error can't find the container with id 959da1906072732ee074dbdb13a7511d3be221047065836bacaf04d32c595273
Oct 30 22:11:49.471623 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.471503    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:11:49.471623 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.471552    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:11:49.472175 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.472137    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"]
Oct 30 22:11:49.473980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.473946    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:11:49.474057 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.474012    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:11:49.474057 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.474045    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:11:49.762953 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.762862    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497" event={"ID":"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8","Type":"ContainerStarted","Data":"c41596ee76cb3b26aba0735826c3ad225542f2e0f1a6f0c22d0ed635f5368f87"}
Oct 30 22:11:49.762953 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.762939    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497" event={"ID":"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8","Type":"ContainerStarted","Data":"959da1906072732ee074dbdb13a7511d3be221047065836bacaf04d32c595273"}
Oct 30 22:11:49.764778 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.764750    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w" event={"ID":"dc87536c-72a7-4afb-9a5b-28d69ef186ab","Type":"ContainerStarted","Data":"443116ea21d242d067fe85128ae0f510c8b886299c7d8779487d9dc42d4c0d4f"}
Oct 30 22:11:49.764904 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.764810    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w" event={"ID":"dc87536c-72a7-4afb-9a5b-28d69ef186ab","Type":"ContainerStarted","Data":"3e9fcb1fb731fa64ec0e8d9381167b641a9d621ba42a88005ca0f91676fcc3c7"}
Oct 30 22:11:49.886936 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:49.886882    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497" podStartSLOduration=1.886867904 podStartE2EDuration="1.886867904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:11:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:11:49.882452864 +0000 UTC m=+1647.931060558" watchObservedRunningTime="2026-10-30 22:11:49.886867904 +0000 UTC m=+1647.935475599"
Oct 30 22:11:50.005426 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:50.005374    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w" podStartSLOduration=2.005359384 podStartE2EDuration="2.005359384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:11:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:11:50.002185424 +0000 UTC m=+1648.050793119" watchObservedRunningTime="2026-10-30 22:11:50.005359384 +0000 UTC m=+1648.053967078"
Oct 30 22:11:50.024814 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:50.024738    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:50.026420 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:50.026387    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-b2m7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 22:11:50.026569 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:50.026440    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w" podUID="dc87536c-72a7-4afb-9a5b-28d69ef186ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 22:11:50.057073 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:50.057042    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:50.058870 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:50.058844    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-tm497 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 22:11:50.058993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:50.058903    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497" podUID="3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 22:11:50.885720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:50.885039    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:51.041715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:51.041165    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-b2m7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 22:11:51.041715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:51.041230    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w" podUID="dc87536c-72a7-4afb-9a5b-28d69ef186ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 22:11:51.056491 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:51.056456    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-tm497 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 22:11:51.056644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:51.056507    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497" podUID="3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 22:11:52.038054 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:52.038017    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-b2m7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 22:11:52.038661 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:52.038634    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w" podUID="dc87536c-72a7-4afb-9a5b-28d69ef186ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 22:11:52.057181 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:52.057155    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-tm497 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 22:11:52.057306 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:52.057196    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497" podUID="3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 22:11:53.024700 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:53.024641    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-b2m7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 22:11:53.025023 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:53.024990    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w" podUID="dc87536c-72a7-4afb-9a5b-28d69ef186ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 22:11:53.056843 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:53.056807    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-tm497 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 22:11:53.057193 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:53.056859    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497" podUID="3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 22:11:53.756546 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:53.756515    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:11:54.050230 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:54.027030    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-b2m7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 22:11:54.050230 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:54.027090    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w" podUID="dc87536c-72a7-4afb-9a5b-28d69ef186ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 22:11:54.079235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:54.079201    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-tm497 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 22:11:54.079772 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:54.079744    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497" podUID="3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 22:11:55.031710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:55.029855    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-b2m7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 22:11:55.031710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:55.029912    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w" podUID="dc87536c-72a7-4afb-9a5b-28d69ef186ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 22:11:55.057006 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:55.056975    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-tm497 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 22:11:55.057156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:55.057029    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497" podUID="3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 22:11:55.775815 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:55.775770    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:56.024703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:56.024649    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-b2m7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 22:11:56.024866 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:56.024746    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w" podUID="dc87536c-72a7-4afb-9a5b-28d69ef186ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 22:11:56.056328 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:56.056236    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-tm497 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 22:11:56.056328 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:56.056312    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497" podUID="3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 22:11:57.025511 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:57.025477    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-b2m7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 22:11:57.025913 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:57.025549    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w" podUID="dc87536c-72a7-4afb-9a5b-28d69ef186ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 22:11:57.056882 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:57.056851    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-tm497 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 30 22:11:57.057003 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:57.056912    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497" podUID="3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 30 22:11:58.510750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:58.506109    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:58.510750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:58.506590    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:58.510750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:58.508504    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:11:58.522701 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:58.522659    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:58.523913 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:58.523886    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:11:58.524411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:11:58.524392    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:12:00.602550 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:00.602286    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:02.159942 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:12:02.159908    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:12:05.571711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:05.569461    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:06.511420 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:06.511058    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 22:12:07.036097 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:07.036058    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:12:07.038512 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:07.038477    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d" podUID="ec6596d8-bdf7-40fc-8836-ebc001f5b55c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:12:07.096758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:07.094474    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:12:07.096758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:07.094929    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:12:07.132705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:07.131816    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:12:07.183708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:07.179795    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:12:07.843716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:07.843288    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:12:08.100773 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:08.097903    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:12:08.100773 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:08.099019    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:12:08.120716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:08.120041    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:12:08.120716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:08.120125    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:12:08.132722 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:08.132371    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:12:08.135719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:08.132974    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:12:08.149859 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:08.149808    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:12:08.230722 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:08.229864    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:12:08.230722 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:08.230343    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:12:08.613718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:08.609837    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:12:08.967776 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:08.946543    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:12:08.982155 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:08.980026    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:12:09.087906 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:09.078244    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:12:11.251710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:11.248385    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:16.243521 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:16.243434    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:17.538900 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:17.538809    4918 patch_prober.go:29] interesting pod/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:12:17.538900 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:17.538881    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m" podUID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:12:17.987361 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:17.987332    4918 generic.go:356] "Generic (PLEG): container finished" podID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerID="64074f2f27bc9e928440ff0f907bec11fb23999d0bd7a95438a0654cc6d39e98" exitCode=0
Oct 30 22:12:17.987532 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:17.987399    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m" event={"ID":"7d2a049e-fc85-430d-858e-d63cf8a1de72","Type":"ContainerDied","Data":"64074f2f27bc9e928440ff0f907bec11fb23999d0bd7a95438a0654cc6d39e98"}
Oct 30 22:12:17.987922 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:17.987885    4918 scope.go:122] "RemoveContainer" containerID="64074f2f27bc9e928440ff0f907bec11fb23999d0bd7a95438a0654cc6d39e98"
Oct 30 22:12:17.989663 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:17.989634    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:12:17.989766 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:17.989746    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:12:17.989811 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:17.989782    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:12:18.996414 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:18.996373    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m" event={"ID":"7d2a049e-fc85-430d-858e-d63cf8a1de72","Type":"ContainerStarted","Data":"8a4a6ed80d1d95849a8ab7b9da8de75fb976ec7d4c06aefdc6846b7af0655af5"}
Oct 30 22:12:19.646749 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:19.646719    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:12:19.646925 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:19.646895    4918 patch_prober.go:29] interesting pod/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:12:19.646982 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:19.646942    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m" podUID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 22:12:20.652718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:20.652401    4918 patch_prober.go:29] interesting pod/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:12:20.652718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:20.652459    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m" podUID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 22:12:21.020717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.020612    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"]
Oct 30 22:12:21.025379 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.025354    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:21.070316 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.070289    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"]
Oct 30 22:12:21.074425 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.074399    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-maas-api-tls\") pod \"maas-api-e2e-ait-aa8c82d5-777479679f-29nfq\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:21.074718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.074650    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b22aac2-81a7-4c52-bd29-7424121a2157-openshift-service-ca\") pod \"maas-api-e2e-ait-aa8c82d5-777479679f-29nfq\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:21.074828 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.074813    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-metrics-certs\") pod \"maas-api-e2e-ait-aa8c82d5-777479679f-29nfq\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:21.074868 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.074838    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjkp9\" (UniqueName: \"kubernetes.io/projected/3b22aac2-81a7-4c52-bd29-7424121a2157-kube-api-access-qjkp9\") pod \"maas-api-e2e-ait-aa8c82d5-777479679f-29nfq\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:21.121043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.121012    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-aa8c82d5-serving-cert\""
Oct 30 22:12:21.176589 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.176556    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-maas-api-tls\") pod \"maas-api-e2e-ait-aa8c82d5-777479679f-29nfq\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:21.176755 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:12:21.176734    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-serving-cert: secret "maas-api-e2e-ait-aa8c82d5-serving-cert" not found
Oct 30 22:12:21.176803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.176780    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b22aac2-81a7-4c52-bd29-7424121a2157-openshift-service-ca\") pod \"maas-api-e2e-ait-aa8c82d5-777479679f-29nfq\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:21.176803 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:12:21.176799    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-maas-api-tls podName:3b22aac2-81a7-4c52-bd29-7424121a2157 nodeName:}" failed. No retries permitted until 2026-10-30 22:12:21.676778032 +0000 UTC m=+1679.725385724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-maas-api-tls") pod "maas-api-e2e-ait-aa8c82d5-777479679f-29nfq" (UID: "3b22aac2-81a7-4c52-bd29-7424121a2157") : secret "maas-api-e2e-ait-aa8c82d5-serving-cert" not found
Oct 30 22:12:21.176954 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.176937    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-metrics-certs\") pod \"maas-api-e2e-ait-aa8c82d5-777479679f-29nfq\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:21.177007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.176971    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjkp9\" (UniqueName: \"kubernetes.io/projected/3b22aac2-81a7-4c52-bd29-7424121a2157-kube-api-access-qjkp9\") pod \"maas-api-e2e-ait-aa8c82d5-777479679f-29nfq\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:21.177399 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.177379    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b22aac2-81a7-4c52-bd29-7424121a2157-openshift-service-ca\") pod \"maas-api-e2e-ait-aa8c82d5-777479679f-29nfq\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:21.179507 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.179482    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-metrics-certs\") pod \"maas-api-e2e-ait-aa8c82d5-777479679f-29nfq\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:21.253008 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.252967    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjkp9\" (UniqueName: \"kubernetes.io/projected/3b22aac2-81a7-4c52-bd29-7424121a2157-kube-api-access-qjkp9\") pod \"maas-api-e2e-ait-aa8c82d5-777479679f-29nfq\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:21.420742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.414803    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:21.659708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.651232    4918 patch_prober.go:29] interesting pod/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:12:21.659708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.651315    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m" podUID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 22:12:21.684764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.682336    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:21.737340 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.735084    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-maas-api-tls\") pod \"maas-api-e2e-ait-aa8c82d5-777479679f-29nfq\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:21.766022 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.748275    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-maas-api-tls\") pod \"maas-api-e2e-ait-aa8c82d5-777479679f-29nfq\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:21.940096 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.940013    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:21.953020 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:21.952992    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:22.229855 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:22.229765    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:22.425079 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:12:22.425046    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b22aac2_81a7_4c52_bd29_7424121a2157.slice/crio-5508206841ad4d7ff93b7f4c4676c4044e89b3c5db504be188f6120b22388522 WatchSource:0}: Error finding container 5508206841ad4d7ff93b7f4c4676c4044e89b3c5db504be188f6120b22388522: Status 404 returned error can't find the container with id 5508206841ad4d7ff93b7f4c4676c4044e89b3c5db504be188f6120b22388522
Oct 30 22:12:22.425217 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:22.425154    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"]
Oct 30 22:12:22.646235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:22.646208    4918 patch_prober.go:29] interesting pod/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:12:22.646390 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:22.646267    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m" podUID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 22:12:23.050893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:23.050811    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq" event={"ID":"3b22aac2-81a7-4c52-bd29-7424121a2157","Type":"ContainerStarted","Data":"5508206841ad4d7ff93b7f4c4676c4044e89b3c5db504be188f6120b22388522"}
Oct 30 22:12:23.655644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:23.655164    4918 patch_prober.go:29] interesting pod/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:12:23.655644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:23.655232    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m" podUID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 22:12:24.060083 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:24.060000    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq" event={"ID":"3b22aac2-81a7-4c52-bd29-7424121a2157","Type":"ContainerStarted","Data":"c8c3c73be3177a6bdf71cdac0e71cefeb4dd2d6311cc179e453011487110293c"}
Oct 30 22:12:24.060476 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:24.060187    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:24.185917 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:24.185863    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq" podStartSLOduration=3.342849652 podStartE2EDuration="4.185848926s" totalImagesPullingTime="842.999274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:12:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:12:24.182836209 +0000 UTC m=+1682.231443905" watchObservedRunningTime="2026-10-30 22:12:24.185848926 +0000 UTC m=+1682.234456621"
Oct 30 22:12:24.662706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:24.662647    4918 patch_prober.go:29] interesting pod/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 22:12:24.733710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:24.713788    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m" podUID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 22:12:25.651120 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:25.651088    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:12:25.651523 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:25.651373    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:12:25.652207 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:25.652184    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:12:27.124594 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:27.124568    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:28.675255 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:28.675224    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:28.945311 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:28.945219    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:30.075552 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:30.075527    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:12:31.889111 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:31.889071    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:32.164928 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:12:32.164892    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:12:37.448332 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:37.448294    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:39.604107 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:39.604075    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:42.762750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:42.758766    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:43.792875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:43.792841    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"]
Oct 30 22:12:44.296563 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:44.296521    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:44.559870 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:44.559782    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:47.166571 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:47.165624    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:47.472816 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:47.472728    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:47.783299 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:47.783212    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:48.800875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:48.800772    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p" podUID="77dac338-8f4e-4d2b-9977-bd989554fb67" containerName="payload-pre-processing" containerID="cri-o://44729489cd6af8d2ea970a1cf94babcc733126912ee1dfbab243b0f29d0fc01c" gracePeriod=25
Oct 30 22:12:49.226251 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:49.226226    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"
Oct 30 22:12:49.382819 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:49.382733    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/77dac338-8f4e-4d2b-9977-bd989554fb67-kube-api-access-t8f84\" (UniqueName: \"kubernetes.io/projected/77dac338-8f4e-4d2b-9977-bd989554fb67-kube-api-access-t8f84\") pod \"77dac338-8f4e-4d2b-9977-bd989554fb67\" (UID: \"77dac338-8f4e-4d2b-9977-bd989554fb67\") "
Oct 30 22:12:49.382986 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:49.382910    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/77dac338-8f4e-4d2b-9977-bd989554fb67-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77dac338-8f4e-4d2b-9977-bd989554fb67-plugins-config-volume\") pod \"77dac338-8f4e-4d2b-9977-bd989554fb67\" (UID: \"77dac338-8f4e-4d2b-9977-bd989554fb67\") "
Oct 30 22:12:49.383447 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:49.383407    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77dac338-8f4e-4d2b-9977-bd989554fb67-plugins-config-volume" pod "77dac338-8f4e-4d2b-9977-bd989554fb67" (UID: "77dac338-8f4e-4d2b-9977-bd989554fb67"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:12:49.383601 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:49.383581    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77dac338-8f4e-4d2b-9977-bd989554fb67-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:49.386343 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:49.386316    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77dac338-8f4e-4d2b-9977-bd989554fb67-kube-api-access-t8f84" pod "77dac338-8f4e-4d2b-9977-bd989554fb67" (UID: "77dac338-8f4e-4d2b-9977-bd989554fb67"). InnerVolumeSpecName "kube-api-access-t8f84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:12:49.481872 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:49.481840    4918 generic.go:356] "Generic (PLEG): container finished" podID="77dac338-8f4e-4d2b-9977-bd989554fb67" containerID="44729489cd6af8d2ea970a1cf94babcc733126912ee1dfbab243b0f29d0fc01c" exitCode=0
Oct 30 22:12:49.482042 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:49.481888    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"
Oct 30 22:12:49.482042 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:49.481882    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p" event={"ID":"77dac338-8f4e-4d2b-9977-bd989554fb67","Type":"ContainerDied","Data":"44729489cd6af8d2ea970a1cf94babcc733126912ee1dfbab243b0f29d0fc01c"}
Oct 30 22:12:49.482042 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:49.481959    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p" event={"ID":"77dac338-8f4e-4d2b-9977-bd989554fb67","Type":"ContainerDied","Data":"37b48040e844c02eeb71578750884c5982e1e3350015ecac63734fd79966140e"}
Oct 30 22:12:49.482042 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:49.482000    4918 scope.go:122] "RemoveContainer" containerID="44729489cd6af8d2ea970a1cf94babcc733126912ee1dfbab243b0f29d0fc01c"
Oct 30 22:12:49.485906 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:49.485880    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8f84\" (UniqueName: \"kubernetes.io/projected/77dac338-8f4e-4d2b-9977-bd989554fb67-kube-api-access-t8f84\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:12:49.493404 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:49.493384    4918 scope.go:122] "RemoveContainer" containerID="44729489cd6af8d2ea970a1cf94babcc733126912ee1dfbab243b0f29d0fc01c"
Oct 30 22:12:49.493690 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:12:49.493663    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44729489cd6af8d2ea970a1cf94babcc733126912ee1dfbab243b0f29d0fc01c\": container with ID starting with 44729489cd6af8d2ea970a1cf94babcc733126912ee1dfbab243b0f29d0fc01c not found: ID does not exist" containerID="44729489cd6af8d2ea970a1cf94babcc733126912ee1dfbab243b0f29d0fc01c"
Oct 30 22:12:49.493742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:49.493708    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44729489cd6af8d2ea970a1cf94babcc733126912ee1dfbab243b0f29d0fc01c"} err="failed to get container status \"44729489cd6af8d2ea970a1cf94babcc733126912ee1dfbab243b0f29d0fc01c\": rpc error: code = NotFound desc = could not find container \"44729489cd6af8d2ea970a1cf94babcc733126912ee1dfbab243b0f29d0fc01c\": container with ID starting with 44729489cd6af8d2ea970a1cf94babcc733126912ee1dfbab243b0f29d0fc01c not found: ID does not exist"
Oct 30 22:12:49.647412 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:49.647383    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"]
Oct 30 22:12:49.654354 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:49.654330    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-92ce375b-65776f48f9-bcw5p"]
Oct 30 22:12:50.074617 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:50.074540    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="77dac338-8f4e-4d2b-9977-bd989554fb67" path="/var/lib/kubelet/pods/77dac338-8f4e-4d2b-9977-bd989554fb67/volumes"
Oct 30 22:12:53.049709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:53.041513    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:53.907281 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:53.907244    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:54.160147 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:54.160053    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:58.426486 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:58.425787    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:58.892778 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:12:58.892741    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:02.164226 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:13:02.164189    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:13:03.861790 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:03.861754    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:05.175096 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:05.175060    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:07.951101 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:07.951068    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"]
Oct 30 22:13:07.951852 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:07.951836    4918 cpu_manager.go:414] "containerMap: removing container" podUID="77dac338-8f4e-4d2b-9977-bd989554fb67" containerName="payload-pre-processing"
Oct 30 22:13:07.951925 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:07.951852    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="77dac338-8f4e-4d2b-9977-bd989554fb67" containerName="payload-pre-processing"
Oct 30 22:13:07.951985 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:07.951975    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="77dac338-8f4e-4d2b-9977-bd989554fb67" containerName="payload-pre-processing"
Oct 30 22:13:07.962787 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:07.962759    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.000210 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.000179    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"]
Oct 30 22:13:08.004661 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.004641    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.015911 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.015889    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-aa8c82d5-openshift-default-dockercfg-r2zpw\""
Oct 30 22:13:08.061118 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.061083    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"]
Oct 30 22:13:08.109522 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.109484    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"]
Oct 30 22:13:08.126792 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.126762    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.126950 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.126803    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.126990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.126954    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.127062 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.127048    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.127098 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.127078    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.127137 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.127104    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.127256 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.127229    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.127394 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.127293    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.127463 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.127400    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.127463 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.127438    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d77hs\" (UniqueName: \"kubernetes.io/projected/9b51782b-f6a0-43c8-a8d8-c06c3045f379-kube-api-access-d77hs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.127549 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.127469    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wwpp\" (UniqueName: \"kubernetes.io/projected/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-kube-api-access-7wwpp\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.127616 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.127593    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.127735 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.127717    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.127786 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.127749    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.127786 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.127778    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.127859 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.127848    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.127895 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.127876    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.127928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.127910    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.229246 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229153    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.229246 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229222    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.229498 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229247    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.229498 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229275    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.229498 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229308    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.229498 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229336    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.229498 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229371    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.229498 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229426    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.229498 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229465    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.229875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229515    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.229875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229600    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.229875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229641    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.229875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229701    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.229875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229748    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.229875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229762    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.229875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229790    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.230240 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.229877    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.230240 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.230032    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.230240 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.230065    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.230240 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.230075    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d77hs\" (UniqueName: \"kubernetes.io/projected/9b51782b-f6a0-43c8-a8d8-c06c3045f379-kube-api-access-d77hs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.230240 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.230088    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.230240 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.230114    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wwpp\" (UniqueName: \"kubernetes.io/projected/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-kube-api-access-7wwpp\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.230562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.230376    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.230659 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.230619    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.232094 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.232066    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.233355 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.233276    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.234230 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.234198    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.234456 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.234429    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.234546 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.234464    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.234546 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.234515    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.235156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.235128    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.235650 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.235625    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.293472 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.293435    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.293649 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.293450    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.293771 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.293715    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wwpp\" (UniqueName: \"kubernetes.io/projected/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-kube-api-access-7wwpp\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.293960 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.293943    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d77hs\" (UniqueName: \"kubernetes.io/projected/9b51782b-f6a0-43c8-a8d8-c06c3045f379-kube-api-access-d77hs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.319251 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.319224    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:08.478453 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.478421    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"]
Oct 30 22:13:08.579010 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.578926    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:08.591922 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.591893    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"]
Oct 30 22:13:08.770266 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.770169    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:08.827354 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:13:08.820162    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b51782b_f6a0_43c8_a8d8_c06c3045f379.slice/crio-a2fbf925055ae4c4901fff39cb38754eabe101fe6b75d01f370beb17f5e007cb WatchSource:0}: Error finding container a2fbf925055ae4c4901fff39cb38754eabe101fe6b75d01f370beb17f5e007cb: Status 404 returned error can't find the container with id a2fbf925055ae4c4901fff39cb38754eabe101fe6b75d01f370beb17f5e007cb
Oct 30 22:13:08.848722 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.841653    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:13:08.848722 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.841780    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:13:08.848722 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.841823    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:13:08.882491 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:08.865762    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"]
Oct 30 22:13:09.043949 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:09.034818    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:09.043949 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:09.038446    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"]
Oct 30 22:13:09.321358 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:09.311323    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:13:09.321358 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:09.311407    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:13:09.321358 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:09.311449    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:13:09.392569 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:09.388769    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:09.653144 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:09.653089    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf" event={"ID":"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3","Type":"ContainerStarted","Data":"66e811e67ded3d147e886c54e185831ec2c203f88859a89a9c29d4285176551b"}
Oct 30 22:13:09.653352 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:09.653200    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf" event={"ID":"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3","Type":"ContainerStarted","Data":"cae69fb2e0e793ce3e266765eb02cae9a56cd387fe772e18e727ed6406ca0943"}
Oct 30 22:13:09.655324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:09.655285    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr" event={"ID":"9b51782b-f6a0-43c8-a8d8-c06c3045f379","Type":"ContainerStarted","Data":"c8f1ce9c1c22efd79489f08726ff1ecf83d058e2cfd915899474b973dbbfc22a"}
Oct 30 22:13:09.655451 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:09.655338    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr" event={"ID":"9b51782b-f6a0-43c8-a8d8-c06c3045f379","Type":"ContainerStarted","Data":"a2fbf925055ae4c4901fff39cb38754eabe101fe6b75d01f370beb17f5e007cb"}
Oct 30 22:13:09.774910 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:09.774847    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf" podStartSLOduration=2.774832308 podStartE2EDuration="2.774832308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:13:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:13:09.77258271 +0000 UTC m=+1727.821190406" watchObservedRunningTime="2026-10-30 22:13:09.774832308 +0000 UTC m=+1727.823440002"
Oct 30 22:13:09.894094 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:09.894038    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr" podStartSLOduration=2.894020853 podStartE2EDuration="2.894020853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:13:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:13:09.892747013 +0000 UTC m=+1727.941354713" watchObservedRunningTime="2026-10-30 22:13:09.894020853 +0000 UTC m=+1727.942628607"
Oct 30 22:13:10.325539 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:10.325503    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:10.326219 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:10.326195    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 22:13:10.326385 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:10.326359    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr" podUID="9b51782b-f6a0-43c8-a8d8-c06c3045f379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 22:13:10.586777 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:10.585152    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:10.586777 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:10.585341    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 22:13:10.586777 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:10.585392    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf" podUID="be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 22:13:11.329779 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:11.323092    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 22:13:11.329779 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:11.323159    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr" podUID="9b51782b-f6a0-43c8-a8d8-c06c3045f379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 22:13:11.579411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:11.579372    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 22:13:11.579592 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:11.579434    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf" podUID="be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 22:13:12.324715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:12.323345    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 22:13:12.324715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:12.323403    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr" podUID="9b51782b-f6a0-43c8-a8d8-c06c3045f379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 22:13:12.583146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:12.583063    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 22:13:12.583589 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:12.583562    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf" podUID="be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 22:13:13.336711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:13.334184    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 22:13:13.336711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:13.334245    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr" podUID="9b51782b-f6a0-43c8-a8d8-c06c3045f379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 22:13:13.479406 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:13.479367    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q" podUID="318fcd2e-7f9e-471b-84d5-ac7abd6b5624" containerName="payload-processing" containerID="cri-o://b178621171221671c13d22cf44e1b519cc9c212700761fe1e66ec562e855beae" gracePeriod=25
Oct 30 22:13:13.579492 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:13.579461    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 22:13:13.579725 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:13.579699    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf" podUID="be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 22:13:13.608349 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:13.600754    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5" podUID="45e194f0-6310-42a5-9a5b-3b119015bca6" containerName="payload-pre-processing" containerID="cri-o://b26143c6e6089e42107549e606201c803a25c8ed7cea1fb9ba9c810544c2cebb" gracePeriod=25
Oct 30 22:13:13.761763 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:13.761656    4918 generic.go:356] "Generic (PLEG): container finished" podID="318fcd2e-7f9e-471b-84d5-ac7abd6b5624" containerID="b178621171221671c13d22cf44e1b519cc9c212700761fe1e66ec562e855beae" exitCode=0
Oct 30 22:13:13.761763 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:13.761731    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q" event={"ID":"318fcd2e-7f9e-471b-84d5-ac7abd6b5624","Type":"ContainerDied","Data":"b178621171221671c13d22cf44e1b519cc9c212700761fe1e66ec562e855beae"}
Oct 30 22:13:14.173984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.108194    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:14.280749 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.280718    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"
Oct 30 22:13:14.346884 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.346796    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/318fcd2e-7f9e-471b-84d5-ac7abd6b5624-kube-api-access-dqb5g\" (UniqueName: \"kubernetes.io/projected/318fcd2e-7f9e-471b-84d5-ac7abd6b5624-kube-api-access-dqb5g\") pod \"318fcd2e-7f9e-471b-84d5-ac7abd6b5624\" (UID: \"318fcd2e-7f9e-471b-84d5-ac7abd6b5624\") "
Oct 30 22:13:14.347637 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.347613    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/318fcd2e-7f9e-471b-84d5-ac7abd6b5624-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/318fcd2e-7f9e-471b-84d5-ac7abd6b5624-plugins-config-volume\") pod \"318fcd2e-7f9e-471b-84d5-ac7abd6b5624\" (UID: \"318fcd2e-7f9e-471b-84d5-ac7abd6b5624\") "
Oct 30 22:13:14.348327 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.348125    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/318fcd2e-7f9e-471b-84d5-ac7abd6b5624-plugins-config-volume" pod "318fcd2e-7f9e-471b-84d5-ac7abd6b5624" (UID: "318fcd2e-7f9e-471b-84d5-ac7abd6b5624"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:13:14.349174 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.349150    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/318fcd2e-7f9e-471b-84d5-ac7abd6b5624-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:14.353812 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.353788    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 22:13:14.354008 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.353983    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr" podUID="9b51782b-f6a0-43c8-a8d8-c06c3045f379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 22:13:14.355279 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.355252    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/318fcd2e-7f9e-471b-84d5-ac7abd6b5624-kube-api-access-dqb5g" pod "318fcd2e-7f9e-471b-84d5-ac7abd6b5624" (UID: "318fcd2e-7f9e-471b-84d5-ac7abd6b5624"). InnerVolumeSpecName "kube-api-access-dqb5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:14.450906 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.450872    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"
Oct 30 22:13:14.453254 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.453217    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqb5g\" (UniqueName: \"kubernetes.io/projected/318fcd2e-7f9e-471b-84d5-ac7abd6b5624-kube-api-access-dqb5g\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:14.553895 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.553866    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/45e194f0-6310-42a5-9a5b-3b119015bca6-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45e194f0-6310-42a5-9a5b-3b119015bca6-plugins-config-volume\") pod \"45e194f0-6310-42a5-9a5b-3b119015bca6\" (UID: \"45e194f0-6310-42a5-9a5b-3b119015bca6\") "
Oct 30 22:13:14.554205 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.554192    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45e194f0-6310-42a5-9a5b-3b119015bca6-kube-api-access-bcksc\" (UniqueName: \"kubernetes.io/projected/45e194f0-6310-42a5-9a5b-3b119015bca6-kube-api-access-bcksc\") pod \"45e194f0-6310-42a5-9a5b-3b119015bca6\" (UID: \"45e194f0-6310-42a5-9a5b-3b119015bca6\") "
Oct 30 22:13:14.554502 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.554478    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45e194f0-6310-42a5-9a5b-3b119015bca6-plugins-config-volume" pod "45e194f0-6310-42a5-9a5b-3b119015bca6" (UID: "45e194f0-6310-42a5-9a5b-3b119015bca6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:13:14.554937 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.554920    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45e194f0-6310-42a5-9a5b-3b119015bca6-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:14.556579 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.556560    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e194f0-6310-42a5-9a5b-3b119015bca6-kube-api-access-bcksc" pod "45e194f0-6310-42a5-9a5b-3b119015bca6" (UID: "45e194f0-6310-42a5-9a5b-3b119015bca6"). InnerVolumeSpecName "kube-api-access-bcksc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:14.580516 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.580495    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 22:13:14.580640 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.580620    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf" podUID="be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 22:13:14.656836 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.656797    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcksc\" (UniqueName: \"kubernetes.io/projected/45e194f0-6310-42a5-9a5b-3b119015bca6-kube-api-access-bcksc\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:14.770537 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.770503    4918 generic.go:356] "Generic (PLEG): container finished" podID="45e194f0-6310-42a5-9a5b-3b119015bca6" containerID="b26143c6e6089e42107549e606201c803a25c8ed7cea1fb9ba9c810544c2cebb" exitCode=0
Oct 30 22:13:14.770739 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.770557    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"
Oct 30 22:13:14.770739 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.770593    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5" event={"ID":"45e194f0-6310-42a5-9a5b-3b119015bca6","Type":"ContainerDied","Data":"b26143c6e6089e42107549e606201c803a25c8ed7cea1fb9ba9c810544c2cebb"}
Oct 30 22:13:14.770739 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.770657    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5" event={"ID":"45e194f0-6310-42a5-9a5b-3b119015bca6","Type":"ContainerDied","Data":"26a5480dce4040404990ea46ce4e142f0a2425c1da00907a29e8bd1091c7bc2c"}
Oct 30 22:13:14.770739 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.770717    4918 scope.go:122] "RemoveContainer" containerID="b26143c6e6089e42107549e606201c803a25c8ed7cea1fb9ba9c810544c2cebb"
Oct 30 22:13:14.772893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.772809    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"
Oct 30 22:13:14.773078 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.772875    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q" event={"ID":"318fcd2e-7f9e-471b-84d5-ac7abd6b5624","Type":"ContainerDied","Data":"b4752180600f60a948b10e274c3c9f3795bea962bef5a8c20a5e658143006c54"}
Oct 30 22:13:14.783466 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.783445    4918 scope.go:122] "RemoveContainer" containerID="b26143c6e6089e42107549e606201c803a25c8ed7cea1fb9ba9c810544c2cebb"
Oct 30 22:13:14.783760 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:13:14.783738    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b26143c6e6089e42107549e606201c803a25c8ed7cea1fb9ba9c810544c2cebb\": container with ID starting with b26143c6e6089e42107549e606201c803a25c8ed7cea1fb9ba9c810544c2cebb not found: ID does not exist" containerID="b26143c6e6089e42107549e606201c803a25c8ed7cea1fb9ba9c810544c2cebb"
Oct 30 22:13:14.783829 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.783773    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b26143c6e6089e42107549e606201c803a25c8ed7cea1fb9ba9c810544c2cebb"} err="failed to get container status \"b26143c6e6089e42107549e606201c803a25c8ed7cea1fb9ba9c810544c2cebb\": rpc error: code = NotFound desc = could not find container \"b26143c6e6089e42107549e606201c803a25c8ed7cea1fb9ba9c810544c2cebb\": container with ID starting with b26143c6e6089e42107549e606201c803a25c8ed7cea1fb9ba9c810544c2cebb not found: ID does not exist"
Oct 30 22:13:14.783829 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.783795    4918 scope.go:122] "RemoveContainer" containerID="b178621171221671c13d22cf44e1b519cc9c212700761fe1e66ec562e855beae"
Oct 30 22:13:14.954944 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.954859    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"]
Oct 30 22:13:14.960754 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:14.960734    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b8490f04-6bc866b9f-mhkc5"]
Oct 30 22:13:15.064047 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:15.064018    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"]
Oct 30 22:13:15.069126 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:15.069096    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b8490f04-866d7c8997-nrp4q"]
Oct 30 22:13:15.325763 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:15.320006    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 22:13:15.325763 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:15.320073    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr" podUID="9b51782b-f6a0-43c8-a8d8-c06c3045f379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 22:13:15.579668 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:15.579588    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 22:13:15.579668 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:15.579638    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf" podUID="be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 22:13:16.089497 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:16.089061    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="318fcd2e-7f9e-471b-84d5-ac7abd6b5624" path="/var/lib/kubelet/pods/318fcd2e-7f9e-471b-84d5-ac7abd6b5624/volumes"
Oct 30 22:13:16.091033 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:16.090510    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45e194f0-6310-42a5-9a5b-3b119015bca6" path="/var/lib/kubelet/pods/45e194f0-6310-42a5-9a5b-3b119015bca6/volumes"
Oct 30 22:13:16.320538 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:16.319887    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 30 22:13:16.320538 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:16.319950    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr" podUID="9b51782b-f6a0-43c8-a8d8-c06c3045f379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 30 22:13:16.584182 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:16.584151    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:16.584862 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:16.584823    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:16.586343 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:16.586078    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:13:17.324927 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:17.324897    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:17.325334 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:17.325295    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:17.326148 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:17.326132    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:13:19.233004 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.232976    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"]
Oct 30 22:13:19.233451 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.233155    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d" podUID="b0de5eef-cdaa-41be-9a96-0c95c62c0cf6" containerName="maas-api" containerID="cri-o://daa2881f2581f8c8bceacc71efde022e751fea3ec652b5d282c5b648d61eca2b" gracePeriod=30
Oct 30 22:13:19.447837 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.447795    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:19.731880 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.721046    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:13:19.793751 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.792023    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-maas-api-tls\") pod \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") "
Oct 30 22:13:19.793751 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.792178    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-metrics-certs\") pod \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") "
Oct 30 22:13:19.793751 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.792246    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-openshift-service-ca\") pod \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") "
Oct 30 22:13:19.793751 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.792311    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-kube-api-access-kj4nc\" (UniqueName: \"kubernetes.io/projected/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-kube-api-access-kj4nc\") pod \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\" (UID: \"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6\") "
Oct 30 22:13:19.797705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.795355    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-openshift-service-ca" pod "b0de5eef-cdaa-41be-9a96-0c95c62c0cf6" (UID: "b0de5eef-cdaa-41be-9a96-0c95c62c0cf6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:13:19.799745 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.798470    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-metrics-certs" pod "b0de5eef-cdaa-41be-9a96-0c95c62c0cf6" (UID: "b0de5eef-cdaa-41be-9a96-0c95c62c0cf6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:13:19.799745 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.798935    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-maas-api-tls" pod "b0de5eef-cdaa-41be-9a96-0c95c62c0cf6" (UID: "b0de5eef-cdaa-41be-9a96-0c95c62c0cf6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:13:19.838998 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.820187    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-kube-api-access-kj4nc" pod "b0de5eef-cdaa-41be-9a96-0c95c62c0cf6" (UID: "b0de5eef-cdaa-41be-9a96-0c95c62c0cf6"). InnerVolumeSpecName "kube-api-access-kj4nc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:19.936242 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.930870    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:19.936242 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.930904    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:19.936242 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.930922    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:19.936242 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.930937    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj4nc\" (UniqueName: \"kubernetes.io/projected/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6-kube-api-access-kj4nc\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:19.956706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.945863    4918 generic.go:356] "Generic (PLEG): container finished" podID="b0de5eef-cdaa-41be-9a96-0c95c62c0cf6" containerID="daa2881f2581f8c8bceacc71efde022e751fea3ec652b5d282c5b648d61eca2b" exitCode=0
Oct 30 22:13:19.956706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.946136    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d" event={"ID":"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6","Type":"ContainerDied","Data":"daa2881f2581f8c8bceacc71efde022e751fea3ec652b5d282c5b648d61eca2b"}
Oct 30 22:13:19.956706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.946192    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d" event={"ID":"b0de5eef-cdaa-41be-9a96-0c95c62c0cf6","Type":"ContainerDied","Data":"7609b2ea99636ef0a782d1f5566f19aa00f4da241ea34381cc2ac8aae5d07e61"}
Oct 30 22:13:19.956706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.946220    4918 scope.go:122] "RemoveContainer" containerID="daa2881f2581f8c8bceacc71efde022e751fea3ec652b5d282c5b648d61eca2b"
Oct 30 22:13:19.956706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:19.946399    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"
Oct 30 22:13:20.025103 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:20.025079    4918 scope.go:122] "RemoveContainer" containerID="daa2881f2581f8c8bceacc71efde022e751fea3ec652b5d282c5b648d61eca2b"
Oct 30 22:13:20.025713 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:13:20.025639    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daa2881f2581f8c8bceacc71efde022e751fea3ec652b5d282c5b648d61eca2b\": container with ID starting with daa2881f2581f8c8bceacc71efde022e751fea3ec652b5d282c5b648d61eca2b not found: ID does not exist" containerID="daa2881f2581f8c8bceacc71efde022e751fea3ec652b5d282c5b648d61eca2b"
Oct 30 22:13:20.025713 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:20.025672    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daa2881f2581f8c8bceacc71efde022e751fea3ec652b5d282c5b648d61eca2b"} err="failed to get container status \"daa2881f2581f8c8bceacc71efde022e751fea3ec652b5d282c5b648d61eca2b\": rpc error: code = NotFound desc = could not find container \"daa2881f2581f8c8bceacc71efde022e751fea3ec652b5d282c5b648d61eca2b\": container with ID starting with daa2881f2581f8c8bceacc71efde022e751fea3ec652b5d282c5b648d61eca2b not found: ID does not exist"
Oct 30 22:13:20.149554 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:20.149524    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"]
Oct 30 22:13:20.153644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:20.153616    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2678f4e1-667d976b78-g8w5d"]
Oct 30 22:13:21.134401 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:21.134368    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:21.399730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:21.397178    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:21.659658 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:21.659567    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:21.790438 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:21.790399    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"]
Oct 30 22:13:21.790676 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:21.790651    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m" podUID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerName="istio-proxy" containerID="cri-o://8a4a6ed80d1d95849a8ab7b9da8de75fb976ec7d4c06aefdc6846b7af0655af5" gracePeriod=30
Oct 30 22:13:21.929521 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:21.929431    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:22.163205 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:22.163166    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b0de5eef-cdaa-41be-9a96-0c95c62c0cf6" path="/var/lib/kubelet/pods/b0de5eef-cdaa-41be-9a96-0c95c62c0cf6/volumes"
Oct 30 22:13:22.608084 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:22.608052    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:22.938430 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:22.938385    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:23.197740 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:23.197626    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:25.653268 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:25.653225    4918 patch_prober.go:29] interesting pod/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:13:25.653696 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:25.653298    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m" podUID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:13:25.865631 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:25.865450    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"]
Oct 30 22:13:25.865849 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:25.865781    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs" podUID="6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27" containerName="maas-api" containerID="cri-o://efe39adebd5b011914472569736af63c704132324530a8f9779bf85f25674c7e" gracePeriod=30
Oct 30 22:13:26.287463 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:26.285831    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:26.560737 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:26.560551    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:26.927155 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:26.927132    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:13:27.065508 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.065479    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:13:27.066015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.065990    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-metrics-certs\") pod \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") "
Oct 30 22:13:27.066114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.066043    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-maas-api-tls\") pod \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") "
Oct 30 22:13:27.066181 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.066142    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-openshift-service-ca\") pod \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") "
Oct 30 22:13:27.066272 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.066254    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-kube-api-access-jbltd\" (UniqueName: \"kubernetes.io/projected/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-kube-api-access-jbltd\") pod \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\" (UID: \"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27\") "
Oct 30 22:13:27.066657 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.066538    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-openshift-service-ca" pod "6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27" (UID: "6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:13:27.067172 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.067146    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:27.068792 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.068641    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-metrics-certs" pod "6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27" (UID: "6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:13:27.068972 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.068944    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-maas-api-tls" pod "6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27" (UID: "6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:13:27.069077 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.069035    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-kube-api-access-jbltd" pod "6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27" (UID: "6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27"). InnerVolumeSpecName "kube-api-access-jbltd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:27.174379 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.173914    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-envoy\") pod \"7d2a049e-fc85-430d-858e-d63cf8a1de72\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") "
Oct 30 22:13:27.174379 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.174040    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-token\" (UniqueName: \"kubernetes.io/projected/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-token\") pod \"7d2a049e-fc85-430d-858e-d63cf8a1de72\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") "
Oct 30 22:13:27.174379 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.174080    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-credential-socket\") pod \"7d2a049e-fc85-430d-858e-d63cf8a1de72\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") "
Oct 30 22:13:27.174379 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.174141    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-data\") pod \"7d2a049e-fc85-430d-858e-d63cf8a1de72\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") "
Oct 30 22:13:27.174379 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.174211    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d2a049e-fc85-430d-858e-d63cf8a1de72-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d2a049e-fc85-430d-858e-d63cf8a1de72-istiod-ca-cert\") pod \"7d2a049e-fc85-430d-858e-d63cf8a1de72\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") "
Oct 30 22:13:27.174379 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.174275    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-workload-certs\") pod \"7d2a049e-fc85-430d-858e-d63cf8a1de72\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") "
Oct 30 22:13:27.174379 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.174348    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-podinfo\") pod \"7d2a049e-fc85-430d-858e-d63cf8a1de72\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") "
Oct 30 22:13:27.174379 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.174382    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d2a049e-fc85-430d-858e-d63cf8a1de72-kube-api-access-klq2v\" (UniqueName: \"kubernetes.io/projected/7d2a049e-fc85-430d-858e-d63cf8a1de72-kube-api-access-klq2v\") pod \"7d2a049e-fc85-430d-858e-d63cf8a1de72\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") "
Oct 30 22:13:27.174987 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.174531    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-workload-socket\") pod \"7d2a049e-fc85-430d-858e-d63cf8a1de72\" (UID: \"7d2a049e-fc85-430d-858e-d63cf8a1de72\") "
Oct 30 22:13:27.174987 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.174780    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-data" pod "7d2a049e-fc85-430d-858e-d63cf8a1de72" (UID: "7d2a049e-fc85-430d-858e-d63cf8a1de72"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:27.175644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.175621    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:27.175799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.175649    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:27.175799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.175664    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbltd\" (UniqueName: \"kubernetes.io/projected/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27-kube-api-access-jbltd\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:27.175799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.175698    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:27.176003 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.175965    4918 generic.go:356] "Generic (PLEG): container finished" podID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerID="8a4a6ed80d1d95849a8ab7b9da8de75fb976ec7d4c06aefdc6846b7af0655af5" exitCode=0
Oct 30 22:13:27.176383 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.176232    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-workload-socket" pod "7d2a049e-fc85-430d-858e-d63cf8a1de72" (UID: "7d2a049e-fc85-430d-858e-d63cf8a1de72"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:27.176383 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.176244    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-workload-certs" pod "7d2a049e-fc85-430d-858e-d63cf8a1de72" (UID: "7d2a049e-fc85-430d-858e-d63cf8a1de72"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:27.176383 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.176212    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-credential-socket" pod "7d2a049e-fc85-430d-858e-d63cf8a1de72" (UID: "7d2a049e-fc85-430d-858e-d63cf8a1de72"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:27.176383 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.176257    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m" event={"ID":"7d2a049e-fc85-430d-858e-d63cf8a1de72","Type":"ContainerDied","Data":"8a4a6ed80d1d95849a8ab7b9da8de75fb976ec7d4c06aefdc6846b7af0655af5"}
Oct 30 22:13:27.176383 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.176318    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m" event={"ID":"7d2a049e-fc85-430d-858e-d63cf8a1de72","Type":"ContainerDied","Data":"5e6f8a953990f55ebb802d5cd62b1d7cf716013e28b71c151723ab866b12c844"}
Oct 30 22:13:27.176383 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.176353    4918 scope.go:122] "RemoveContainer" containerID="8a4a6ed80d1d95849a8ab7b9da8de75fb976ec7d4c06aefdc6846b7af0655af5"
Oct 30 22:13:27.176731 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.176410    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2a049e-fc85-430d-858e-d63cf8a1de72-istiod-ca-cert" pod "7d2a049e-fc85-430d-858e-d63cf8a1de72" (UID: "7d2a049e-fc85-430d-858e-d63cf8a1de72"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:13:27.176731 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.176516    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"
Oct 30 22:13:27.178852 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.178825    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-token" pod "7d2a049e-fc85-430d-858e-d63cf8a1de72" (UID: "7d2a049e-fc85-430d-858e-d63cf8a1de72"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:27.178951 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.178891    4918 generic.go:356] "Generic (PLEG): container finished" podID="6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27" containerID="efe39adebd5b011914472569736af63c704132324530a8f9779bf85f25674c7e" exitCode=0
Oct 30 22:13:27.178951 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.178941    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs" event={"ID":"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27","Type":"ContainerDied","Data":"efe39adebd5b011914472569736af63c704132324530a8f9779bf85f25674c7e"}
Oct 30 22:13:27.179053 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.178953    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"
Oct 30 22:13:27.179053 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.178987    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs" event={"ID":"6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27","Type":"ContainerDied","Data":"0c5b2723bb7de888aea0b646b86e6b5ab803f623987af1953ea139e3871becc9"}
Oct 30 22:13:27.179193 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.179148    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-envoy" pod "7d2a049e-fc85-430d-858e-d63cf8a1de72" (UID: "7d2a049e-fc85-430d-858e-d63cf8a1de72"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:13:27.179365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.179341    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-podinfo" pod "7d2a049e-fc85-430d-858e-d63cf8a1de72" (UID: "7d2a049e-fc85-430d-858e-d63cf8a1de72"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:13:27.179365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.179354    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d2a049e-fc85-430d-858e-d63cf8a1de72-kube-api-access-klq2v" pod "7d2a049e-fc85-430d-858e-d63cf8a1de72" (UID: "7d2a049e-fc85-430d-858e-d63cf8a1de72"). InnerVolumeSpecName "kube-api-access-klq2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:27.219322 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.219297    4918 scope.go:122] "RemoveContainer" containerID="64074f2f27bc9e928440ff0f907bec11fb23999d0bd7a95438a0654cc6d39e98"
Oct 30 22:13:27.235652 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.235634    4918 scope.go:122] "RemoveContainer" containerID="8a4a6ed80d1d95849a8ab7b9da8de75fb976ec7d4c06aefdc6846b7af0655af5"
Oct 30 22:13:27.235996 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:13:27.235973    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a4a6ed80d1d95849a8ab7b9da8de75fb976ec7d4c06aefdc6846b7af0655af5\": container with ID starting with 8a4a6ed80d1d95849a8ab7b9da8de75fb976ec7d4c06aefdc6846b7af0655af5 not found: ID does not exist" containerID="8a4a6ed80d1d95849a8ab7b9da8de75fb976ec7d4c06aefdc6846b7af0655af5"
Oct 30 22:13:27.236085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.236003    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4a6ed80d1d95849a8ab7b9da8de75fb976ec7d4c06aefdc6846b7af0655af5"} err="failed to get container status \"8a4a6ed80d1d95849a8ab7b9da8de75fb976ec7d4c06aefdc6846b7af0655af5\": rpc error: code = NotFound desc = could not find container \"8a4a6ed80d1d95849a8ab7b9da8de75fb976ec7d4c06aefdc6846b7af0655af5\": container with ID starting with 8a4a6ed80d1d95849a8ab7b9da8de75fb976ec7d4c06aefdc6846b7af0655af5 not found: ID does not exist"
Oct 30 22:13:27.236085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.236020    4918 scope.go:122] "RemoveContainer" containerID="64074f2f27bc9e928440ff0f907bec11fb23999d0bd7a95438a0654cc6d39e98"
Oct 30 22:13:27.236345 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:13:27.236319    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64074f2f27bc9e928440ff0f907bec11fb23999d0bd7a95438a0654cc6d39e98\": container with ID starting with 64074f2f27bc9e928440ff0f907bec11fb23999d0bd7a95438a0654cc6d39e98 not found: ID does not exist" containerID="64074f2f27bc9e928440ff0f907bec11fb23999d0bd7a95438a0654cc6d39e98"
Oct 30 22:13:27.236391 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.236352    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64074f2f27bc9e928440ff0f907bec11fb23999d0bd7a95438a0654cc6d39e98"} err="failed to get container status \"64074f2f27bc9e928440ff0f907bec11fb23999d0bd7a95438a0654cc6d39e98\": rpc error: code = NotFound desc = could not find container \"64074f2f27bc9e928440ff0f907bec11fb23999d0bd7a95438a0654cc6d39e98\": container with ID starting with 64074f2f27bc9e928440ff0f907bec11fb23999d0bd7a95438a0654cc6d39e98 not found: ID does not exist"
Oct 30 22:13:27.236391 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.236368    4918 scope.go:122] "RemoveContainer" containerID="efe39adebd5b011914472569736af63c704132324530a8f9779bf85f25674c7e"
Oct 30 22:13:27.245654 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.245637    4918 scope.go:122] "RemoveContainer" containerID="efe39adebd5b011914472569736af63c704132324530a8f9779bf85f25674c7e"
Oct 30 22:13:27.245995 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:13:27.245945    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efe39adebd5b011914472569736af63c704132324530a8f9779bf85f25674c7e\": container with ID starting with efe39adebd5b011914472569736af63c704132324530a8f9779bf85f25674c7e not found: ID does not exist" containerID="efe39adebd5b011914472569736af63c704132324530a8f9779bf85f25674c7e"
Oct 30 22:13:27.246067 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.246004    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efe39adebd5b011914472569736af63c704132324530a8f9779bf85f25674c7e"} err="failed to get container status \"efe39adebd5b011914472569736af63c704132324530a8f9779bf85f25674c7e\": rpc error: code = NotFound desc = could not find container \"efe39adebd5b011914472569736af63c704132324530a8f9779bf85f25674c7e\": container with ID starting with efe39adebd5b011914472569736af63c704132324530a8f9779bf85f25674c7e not found: ID does not exist"
Oct 30 22:13:27.277833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.277810    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:27.277833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.277830    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:27.278007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.277841    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d2a049e-fc85-430d-858e-d63cf8a1de72-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:27.278007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.277850    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:27.278007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.277858    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:27.278007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.277867    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klq2v\" (UniqueName: \"kubernetes.io/projected/7d2a049e-fc85-430d-858e-d63cf8a1de72-kube-api-access-klq2v\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:27.278007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.277875    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:27.278007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.277883    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d2a049e-fc85-430d-858e-d63cf8a1de72-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:27.401996 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.401958    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"]
Oct 30 22:13:27.408398 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.408377    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-92ce375b-7555878cc6-cvwbs"]
Oct 30 22:13:27.599217 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.599189    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"]
Oct 30 22:13:27.604464 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.604437    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2678f4e1-openshift-default-55f846556c-7x46m"]
Oct 30 22:13:27.686864 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.686801    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:27.989938 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:27.989858    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:28.107214 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:28.107036    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27" path="/var/lib/kubelet/pods/6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27/volumes"
Oct 30 22:13:28.108319 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:28.108278    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d2a049e-fc85-430d-858e-d63cf8a1de72" path="/var/lib/kubelet/pods/7d2a049e-fc85-430d-858e-d63cf8a1de72/volumes"
Oct 30 22:13:28.389825 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:28.385504    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:28.695030 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:28.694945    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:29.045089 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.045006    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.566276    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"]
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.567420    4918 cpu_manager.go:414] "containerMap: removing container" podUID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerName="istio-proxy"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.567442    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerName="istio-proxy"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.567492    4918 cpu_manager.go:414] "containerMap: removing container" podUID="45e194f0-6310-42a5-9a5b-3b119015bca6" containerName="payload-pre-processing"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.567500    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45e194f0-6310-42a5-9a5b-3b119015bca6" containerName="payload-pre-processing"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.567527    4918 cpu_manager.go:414] "containerMap: removing container" podUID="318fcd2e-7f9e-471b-84d5-ac7abd6b5624" containerName="payload-processing"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.567534    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="318fcd2e-7f9e-471b-84d5-ac7abd6b5624" containerName="payload-processing"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.567549    4918 cpu_manager.go:414] "containerMap: removing container" podUID="6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27" containerName="maas-api"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.567557    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27" containerName="maas-api"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.567585    4918 cpu_manager.go:414] "containerMap: removing container" podUID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerName="istio-proxy"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.567592    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerName="istio-proxy"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.567610    4918 cpu_manager.go:414] "containerMap: removing container" podUID="b0de5eef-cdaa-41be-9a96-0c95c62c0cf6" containerName="maas-api"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.567617    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0de5eef-cdaa-41be-9a96-0c95c62c0cf6" containerName="maas-api"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.568614    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerName="istio-proxy"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.568635    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="b0de5eef-cdaa-41be-9a96-0c95c62c0cf6" containerName="maas-api"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.568647    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d2a049e-fc85-430d-858e-d63cf8a1de72" containerName="istio-proxy"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.568668    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="45e194f0-6310-42a5-9a5b-3b119015bca6" containerName="payload-pre-processing"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.568704    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="318fcd2e-7f9e-471b-84d5-ac7abd6b5624" containerName="payload-processing"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.568715    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="6cfb33fc-2e1c-4dc3-805b-39bd30aa6c27" containerName="maas-api"
Oct 30 22:13:29.579365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.579124    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.643617 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.642796    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d7b3c557-openshift-default-dockercfg-gk756\""
Oct 30 22:13:29.735168 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.733748    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"]
Oct 30 22:13:29.826434 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.826330    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:29.833495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.827090    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-envoy\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.833495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.827302    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-workload-socket\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.833495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.827354    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-workload-certs\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.833495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.827392    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-credential-socket\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.833495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.827480    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-token\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.833495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.827571    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istiod-ca-cert\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.833495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.827605    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d95rv\" (UniqueName: \"kubernetes.io/projected/61b7bfc4-ac41-46b1-a7f7-952f8745a765-kube-api-access-d95rv\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.833495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.827656    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-podinfo\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.833495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.827776    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-data\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.932211 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.932147    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istiod-ca-cert\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.935833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.935798    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d95rv\" (UniqueName: \"kubernetes.io/projected/61b7bfc4-ac41-46b1-a7f7-952f8745a765-kube-api-access-d95rv\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.936158 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.936131    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-podinfo\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.958738 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.943201    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istiod-ca-cert\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.958738 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.944964    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-data\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.958738 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.936412    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-data\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.974233 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.969776    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-envoy\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.974233 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.970048    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-workload-socket\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.974233 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.970103    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-workload-certs\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.974233 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.970144    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-credential-socket\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.974233 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.970243    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-token\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.974233 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.971053    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-workload-socket\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.974233 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.971330    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-workload-certs\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.974233 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.971578    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-credential-socket\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:29.987432 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:29.985313    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-podinfo\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:30.057716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:30.029697    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d95rv\" (UniqueName: \"kubernetes.io/projected/61b7bfc4-ac41-46b1-a7f7-952f8745a765-kube-api-access-d95rv\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:30.110943 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:30.101023    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-envoy\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:30.110943 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:30.101745    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:30.131709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:30.130942    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-token\") pod \"e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") " pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:30.242401 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:30.242310    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:30.683053 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:30.683019    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"]
Oct 30 22:13:30.719855 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:13:30.719825    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b7bfc4_ac41_46b1_a7f7_952f8745a765.slice/crio-d698b08eb038db1f28f0a613d8b174066bfd7988c90419f4822df87ded0d504c WatchSource:0}: Error finding container d698b08eb038db1f28f0a613d8b174066bfd7988c90419f4822df87ded0d504c: Status 404 returned error can't find the container with id d698b08eb038db1f28f0a613d8b174066bfd7988c90419f4822df87ded0d504c
Oct 30 22:13:30.722879 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:30.722834    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:13:30.722969 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:30.722940    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:13:30.723014 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:30.722986    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:13:31.243023 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:31.242984    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz" event={"ID":"61b7bfc4-ac41-46b1-a7f7-952f8745a765","Type":"ContainerStarted","Data":"026e3031169cc60027f7f8c3265493189fca91b42fa53145156289cc6b0d87d3"}
Oct 30 22:13:31.243418 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:31.243047    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz" event={"ID":"61b7bfc4-ac41-46b1-a7f7-952f8745a765","Type":"ContainerStarted","Data":"d698b08eb038db1f28f0a613d8b174066bfd7988c90419f4822df87ded0d504c"}
Oct 30 22:13:31.365550 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:31.365503    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz" podStartSLOduration=2.365489671 podStartE2EDuration="2.365489671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:13:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:13:31.361989063 +0000 UTC m=+1749.410596758" watchObservedRunningTime="2026-10-30 22:13:31.365489671 +0000 UTC m=+1749.414097433"
Oct 30 22:13:32.163321 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:13:32.163286    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:13:32.242994 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:32.242965    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:32.248433 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:32.248408    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:32.249732 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:32.249715    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:32.250335 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:32.250320    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:13:33.499076 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:33.499041    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:33.801052 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:33.800970    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:36.806707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:36.806247    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:37.085096 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.085022    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:37.176706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.176151    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"]
Oct 30 22:13:37.182945 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.181139    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"
Oct 30 22:13:37.226938 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.226906    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"]
Oct 30 22:13:37.368756 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.364889    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-d7b3c557\""
Oct 30 22:13:37.368756 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.365030    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-d7b3c557-dockercfg-n27j6\""
Oct 30 22:13:37.402708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.398999    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f720a6b-f1b3-4738-9e50-b9c6f5c8e300-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz\" (UID: \"6f720a6b-f1b3-4738-9e50-b9c6f5c8e300\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"
Oct 30 22:13:37.457706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.454400    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl987\" (UniqueName: \"kubernetes.io/projected/6f720a6b-f1b3-4738-9e50-b9c6f5c8e300-kube-api-access-nl987\") pod \"payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz\" (UID: \"6f720a6b-f1b3-4738-9e50-b9c6f5c8e300\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"
Oct 30 22:13:37.457706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.408631    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"]
Oct 30 22:13:37.492371 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.492332    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"]
Oct 30 22:13:37.495485 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.492822    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"
Oct 30 22:13:37.563636 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.563411    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f720a6b-f1b3-4738-9e50-b9c6f5c8e300-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz\" (UID: \"6f720a6b-f1b3-4738-9e50-b9c6f5c8e300\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"
Oct 30 22:13:37.564298 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.564260    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl987\" (UniqueName: \"kubernetes.io/projected/6f720a6b-f1b3-4738-9e50-b9c6f5c8e300-kube-api-access-nl987\") pod \"payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz\" (UID: \"6f720a6b-f1b3-4738-9e50-b9c6f5c8e300\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"
Oct 30 22:13:37.567605 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.567579    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f720a6b-f1b3-4738-9e50-b9c6f5c8e300-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz\" (UID: \"6f720a6b-f1b3-4738-9e50-b9c6f5c8e300\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"
Oct 30 22:13:37.702730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.702674    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl987\" (UniqueName: \"kubernetes.io/projected/6f720a6b-f1b3-4738-9e50-b9c6f5c8e300-kube-api-access-nl987\") pod \"payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz\" (UID: \"6f720a6b-f1b3-4738-9e50-b9c6f5c8e300\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"
Oct 30 22:13:37.722144 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.690327    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d28d1af-b09f-4b11-8590-516816b0d809-plugins-config-volume\") pod \"payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z\" (UID: \"0d28d1af-b09f-4b11-8590-516816b0d809\") " pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"
Oct 30 22:13:37.722144 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.717181    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc5kk\" (UniqueName: \"kubernetes.io/projected/0d28d1af-b09f-4b11-8590-516816b0d809-kube-api-access-rc5kk\") pod \"payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z\" (UID: \"0d28d1af-b09f-4b11-8590-516816b0d809\") " pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"
Oct 30 22:13:37.810612 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.810583    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"
Oct 30 22:13:37.818767 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.818743    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc5kk\" (UniqueName: \"kubernetes.io/projected/0d28d1af-b09f-4b11-8590-516816b0d809-kube-api-access-rc5kk\") pod \"payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z\" (UID: \"0d28d1af-b09f-4b11-8590-516816b0d809\") " pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"
Oct 30 22:13:37.819015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.818993    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d28d1af-b09f-4b11-8590-516816b0d809-plugins-config-volume\") pod \"payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z\" (UID: \"0d28d1af-b09f-4b11-8590-516816b0d809\") " pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"
Oct 30 22:13:37.819658 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.819638    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d28d1af-b09f-4b11-8590-516816b0d809-plugins-config-volume\") pod \"payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z\" (UID: \"0d28d1af-b09f-4b11-8590-516816b0d809\") " pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"
Oct 30 22:13:37.896010 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.889584    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc5kk\" (UniqueName: \"kubernetes.io/projected/0d28d1af-b09f-4b11-8590-516816b0d809-kube-api-access-rc5kk\") pod \"payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z\" (UID: \"0d28d1af-b09f-4b11-8590-516816b0d809\") " pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"
Oct 30 22:13:37.991148 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:37.991076    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"
Oct 30 22:13:38.199046 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:13:38.199013    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f720a6b_f1b3_4738_9e50_b9c6f5c8e300.slice/crio-69426f28b4228be21f3b54616edc142c826543582cf8c5424b80a8042be372c4 WatchSource:0}: Error finding container 69426f28b4228be21f3b54616edc142c826543582cf8c5424b80a8042be372c4: Status 404 returned error can't find the container with id 69426f28b4228be21f3b54616edc142c826543582cf8c5424b80a8042be372c4
Oct 30 22:13:38.199191 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.199043    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"]
Oct 30 22:13:38.238314 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.238289    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"]
Oct 30 22:13:38.244166 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.244115    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.323736 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.321281    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"]
Oct 30 22:13:38.326335 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.326307    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.326457 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.326354    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkkdq\" (UniqueName: \"kubernetes.io/projected/004019a0-a1a4-4042-abb4-d6229795bc35-kube-api-access-qkkdq\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.326576 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.326553    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004019a0-a1a4-4042-abb4-d6229795bc35-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.326732 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.326711    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.326824 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.326804    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.326971 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.326955    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.327040 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.327008    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.327126 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.327113    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004019a0-a1a4-4042-abb4-d6229795bc35-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.327187 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.327151    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004019a0-a1a4-4042-abb4-d6229795bc35-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.387039 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.387017    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"]
Oct 30 22:13:38.389850 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:13:38.389826    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d28d1af_b09f_4b11_8590_516816b0d809.slice/crio-868d91ccf25bba454acc2d99681f738d4a7e1887f3d13f0a3ac24b4b1c35d31c WatchSource:0}: Error finding container 868d91ccf25bba454acc2d99681f738d4a7e1887f3d13f0a3ac24b4b1c35d31c: Status 404 returned error can't find the container with id 868d91ccf25bba454acc2d99681f738d4a7e1887f3d13f0a3ac24b4b1c35d31c
Oct 30 22:13:38.428210 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.428178    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.428316 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.428282    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.428373 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.428355    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.428460 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.428400    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.428500 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.428459    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004019a0-a1a4-4042-abb4-d6229795bc35-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.428500 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.428494    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004019a0-a1a4-4042-abb4-d6229795bc35-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.428574 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.428556    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.428604 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.428584    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkkdq\" (UniqueName: \"kubernetes.io/projected/004019a0-a1a4-4042-abb4-d6229795bc35-kube-api-access-qkkdq\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.428742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.428724    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004019a0-a1a4-4042-abb4-d6229795bc35-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.429744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.429326    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-credential-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.429744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.429446    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004019a0-a1a4-4042-abb4-d6229795bc35-istiod-ca-cert\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.429744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.429595    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-workload-socket\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.429744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.429709    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-istio-data\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.429744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.429621    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-workload-certs\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.430793 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.430768    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-istio-envoy\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.431373 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.431356    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004019a0-a1a4-4042-abb4-d6229795bc35-istio-podinfo\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.490221 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.490201    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004019a0-a1a4-4042-abb4-d6229795bc35-istio-token\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.490665 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.490647    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkkdq\" (UniqueName: \"kubernetes.io/projected/004019a0-a1a4-4042-abb4-d6229795bc35-kube-api-access-qkkdq\") pod \"e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") " pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.510475 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.510417    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z" event={"ID":"0d28d1af-b09f-4b11-8590-516816b0d809","Type":"ContainerStarted","Data":"6fad0c547bf80ada2a53a01df0af9db911c3f690dd2edbc7c81eea37c5e7c244"}
Oct 30 22:13:38.510475 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.510468    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z" event={"ID":"0d28d1af-b09f-4b11-8590-516816b0d809","Type":"ContainerStarted","Data":"868d91ccf25bba454acc2d99681f738d4a7e1887f3d13f0a3ac24b4b1c35d31c"}
Oct 30 22:13:38.510644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.510498    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"
Oct 30 22:13:38.512220 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.512196    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz" event={"ID":"6f720a6b-f1b3-4738-9e50-b9c6f5c8e300","Type":"ContainerStarted","Data":"3529878bc032364ce7d0b4b28cb2cb44ef4b6bd78baf8092775b34832f2f1551"}
Oct 30 22:13:38.512321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.512244    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz" event={"ID":"6f720a6b-f1b3-4738-9e50-b9c6f5c8e300","Type":"ContainerStarted","Data":"69426f28b4228be21f3b54616edc142c826543582cf8c5424b80a8042be372c4"}
Oct 30 22:13:38.512321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.512287    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"
Oct 30 22:13:38.562828 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.562807    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:38.844804 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.840204    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz" podStartSLOduration=1.8401779440000001 podStartE2EDuration="1.840177944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:13:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:13:38.824758657 +0000 UTC m=+1756.873366353" watchObservedRunningTime="2026-10-30 22:13:38.840177944 +0000 UTC m=+1756.888785639"
Oct 30 22:13:38.844804 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:38.840335    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z" podStartSLOduration=1.840329758 podStartE2EDuration="1.840329758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:13:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:13:38.644945267 +0000 UTC m=+1756.693552963" watchObservedRunningTime="2026-10-30 22:13:38.840329758 +0000 UTC m=+1756.888937455"
Oct 30 22:13:39.018811 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:39.012293    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"]
Oct 30 22:13:39.052511 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:39.052467    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:13:39.053269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:39.053246    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:13:39.053455 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:39.053438    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:13:39.305357 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:39.305324    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:39.521290 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:39.521250    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6" event={"ID":"004019a0-a1a4-4042-abb4-d6229795bc35","Type":"ContainerStarted","Data":"cff318c2c3d2519081c7fb9391ba72f0634b21c9c9d4a8f0d8d0b2bdfd2db4f2"}
Oct 30 22:13:39.521481 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:39.521315    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6" event={"ID":"004019a0-a1a4-4042-abb4-d6229795bc35","Type":"ContainerStarted","Data":"138ae220453a64da2143eca89c19095697074e7a7542feb29d1a1112a6e8022c"}
Oct 30 22:13:39.563396 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:39.563368    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:39.654908 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:39.654847    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6" podStartSLOduration=1.6548282730000001 podStartE2EDuration="1.654828273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:13:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:13:39.649546978 +0000 UTC m=+1757.698154697" watchObservedRunningTime="2026-10-30 22:13:39.654828273 +0000 UTC m=+1757.703435969"
Oct 30 22:13:40.565527 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:40.565495    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 22:13:40.565989 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:40.565547    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6" podUID="004019a0-a1a4-4042-abb4-d6229795bc35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 22:13:41.507349 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:41.505847    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:41.603476 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:41.593035    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 22:13:41.625250 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:41.625201    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6" podUID="004019a0-a1a4-4042-abb4-d6229795bc35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 22:13:41.767859 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:41.767769    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:42.614707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:42.613859    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 22:13:42.614707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:42.613914    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6" podUID="004019a0-a1a4-4042-abb4-d6229795bc35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 22:13:43.542893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:43.542862    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"]
Oct 30 22:13:43.543145 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:43.543104    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk" podUID="3ced892b-6a91-43f1-b44d-62857db6004a" containerName="maas-api" containerID="cri-o://66ae76f4ae2a885d458a8b5ece773d2ab287ab567d4ff64229393881fe67ec46" gracePeriod=30
Oct 30 22:13:43.564107 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:43.564085    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 22:13:43.564210 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:43.564136    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6" podUID="004019a0-a1a4-4042-abb4-d6229795bc35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 22:13:43.751616 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:43.751569    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk" podUID="3ced892b-6a91-43f1-b44d-62857db6004a" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.89:8443/health\": dial tcp 10.132.0.89:8443: connect: connection refused"
Oct 30 22:13:43.752725 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:43.752668    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:43.985727 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:43.984226    4918 generic.go:356] "Generic (PLEG): container finished" podID="3ced892b-6a91-43f1-b44d-62857db6004a" containerID="66ae76f4ae2a885d458a8b5ece773d2ab287ab567d4ff64229393881fe67ec46" exitCode=0
Oct 30 22:13:43.985727 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:43.984452    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk" event={"ID":"3ced892b-6a91-43f1-b44d-62857db6004a","Type":"ContainerDied","Data":"66ae76f4ae2a885d458a8b5ece773d2ab287ab567d4ff64229393881fe67ec46"}
Oct 30 22:13:44.426739 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:44.422093    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:13:44.487756 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:44.484537    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-metrics-certs\") pod \"3ced892b-6a91-43f1-b44d-62857db6004a\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") "
Oct 30 22:13:44.487756 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:44.484645    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ced892b-6a91-43f1-b44d-62857db6004a-kube-api-access-d6n7l\" (UniqueName: \"kubernetes.io/projected/3ced892b-6a91-43f1-b44d-62857db6004a-kube-api-access-d6n7l\") pod \"3ced892b-6a91-43f1-b44d-62857db6004a\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") "
Oct 30 22:13:44.487756 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:44.484843    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-maas-api-tls\") pod \"3ced892b-6a91-43f1-b44d-62857db6004a\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") "
Oct 30 22:13:44.487756 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:44.484921    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3ced892b-6a91-43f1-b44d-62857db6004a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ced892b-6a91-43f1-b44d-62857db6004a-openshift-service-ca\") pod \"3ced892b-6a91-43f1-b44d-62857db6004a\" (UID: \"3ced892b-6a91-43f1-b44d-62857db6004a\") "
Oct 30 22:13:44.487756 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:44.486896    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ced892b-6a91-43f1-b44d-62857db6004a-openshift-service-ca" pod "3ced892b-6a91-43f1-b44d-62857db6004a" (UID: "3ced892b-6a91-43f1-b44d-62857db6004a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:13:44.492317 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:44.490668    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-metrics-certs" pod "3ced892b-6a91-43f1-b44d-62857db6004a" (UID: "3ced892b-6a91-43f1-b44d-62857db6004a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:13:44.498944 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:44.498895    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-maas-api-tls" pod "3ced892b-6a91-43f1-b44d-62857db6004a" (UID: "3ced892b-6a91-43f1-b44d-62857db6004a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:13:44.499630 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:44.499587    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ced892b-6a91-43f1-b44d-62857db6004a-kube-api-access-d6n7l" pod "3ced892b-6a91-43f1-b44d-62857db6004a" (UID: "3ced892b-6a91-43f1-b44d-62857db6004a"). InnerVolumeSpecName "kube-api-access-d6n7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:13:44.564731 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:44.564220    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 22:13:44.564731 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:44.564278    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6" podUID="004019a0-a1a4-4042-abb4-d6229795bc35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 22:13:44.590449 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:44.590403    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:44.590449 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:44.590439    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ced892b-6a91-43f1-b44d-62857db6004a-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:44.590651 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:44.590457    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ced892b-6a91-43f1-b44d-62857db6004a-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:44.590651 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:44.590469    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6n7l\" (UniqueName: \"kubernetes.io/projected/3ced892b-6a91-43f1-b44d-62857db6004a-kube-api-access-d6n7l\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:13:45.081007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:45.080976    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"
Oct 30 22:13:45.081496 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:45.081111    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk" event={"ID":"3ced892b-6a91-43f1-b44d-62857db6004a","Type":"ContainerDied","Data":"32722f91f8f8601d3738778ba07eb60b371de33e7bf4debcf6a9f9562535463a"}
Oct 30 22:13:45.081496 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:45.081169    4918 scope.go:122] "RemoveContainer" containerID="66ae76f4ae2a885d458a8b5ece773d2ab287ab567d4ff64229393881fe67ec46"
Oct 30 22:13:45.250860 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:45.250803    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"]
Oct 30 22:13:45.255948 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:45.255922    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b8490f04-9885b74f5-9vfbk"]
Oct 30 22:13:45.406282 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:45.406251    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:45.564155 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:45.564124    4918 patch_prober.go:29] interesting pod/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 22:13:45.564308 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:45.564175    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6" podUID="004019a0-a1a4-4042-abb4-d6229795bc35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 22:13:45.722783 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:45.719674    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:46.013760 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:46.009045    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:46.183374 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:46.171934    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3ced892b-6a91-43f1-b44d-62857db6004a" path="/var/lib/kubelet/pods/3ced892b-6a91-43f1-b44d-62857db6004a/volumes"
Oct 30 22:13:46.302753 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:46.300234    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:46.658611 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:46.658578    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:46.660278 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:46.660252    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:46.661454 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:46.661434    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:13:47.011548 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:47.011470    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:47.343311 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:47.343224    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:49.524424 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:49.524397    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"
Oct 30 22:13:49.524824 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:49.524468    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"
Oct 30 22:13:51.144141 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:51.143359    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:52.418774 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:52.418726    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:52.721733 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:52.721625    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:56.106695 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:13:56.106630    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:00.145420 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:00.145385    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:01.838928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:01.838886    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:02.160998 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:14:02.160961    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:14:05.149195 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:05.149157    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"]
Oct 30 22:14:05.149632 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:05.149413    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7" podUID="9739aa48-8d50-44be-80da-5eb24bed7994" containerName="istio-proxy" containerID="cri-o://4988dd7140dbd591090d8204af3a00f1d335b5d05951aee7cdc47367ede961e9" gracePeriod=30
Oct 30 22:14:05.198349 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:05.198309    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"]
Oct 30 22:14:05.198598 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:05.198568    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr" podUID="18416329-7c7b-48b1-bdcd-29f66e19e88b" containerName="istio-proxy" containerID="cri-o://fbffbb87781ce3392ad5b5c3ec59bc7e4d315ffae75d5af9706010b847015c55" gracePeriod=30
Oct 30 22:14:06.049239 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:06.049200    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:06.326283 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:06.326197    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:10.036392 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.036354    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"]
Oct 30 22:14:10.036927 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.036666    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq" podUID="3b22aac2-81a7-4c52-bd29-7424121a2157" containerName="maas-api" containerID="cri-o://c8c3c73be3177a6bdf71cdac0e71cefeb4dd2d6311cc179e453011487110293c" gracePeriod=30
Oct 30 22:14:10.068881 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.068840    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq" podUID="3b22aac2-81a7-4c52-bd29-7424121a2157" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.92:8443/health\": dial tcp 10.132.0.92:8443: connect: connection refused"
Oct 30 22:14:10.076233 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.076205    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:14:10.076347 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.076250    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7" podUID="9739aa48-8d50-44be-80da-5eb24bed7994" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:14:10.246362 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.243632    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:10.510506 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.510197    4918 generic.go:356] "Generic (PLEG): container finished" podID="3b22aac2-81a7-4c52-bd29-7424121a2157" containerID="c8c3c73be3177a6bdf71cdac0e71cefeb4dd2d6311cc179e453011487110293c" exitCode=0
Oct 30 22:14:10.510506 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.510383    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq" event={"ID":"3b22aac2-81a7-4c52-bd29-7424121a2157","Type":"ContainerDied","Data":"c8c3c73be3177a6bdf71cdac0e71cefeb4dd2d6311cc179e453011487110293c"}
Oct 30 22:14:10.510506 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.510437    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq" event={"ID":"3b22aac2-81a7-4c52-bd29-7424121a2157","Type":"ContainerDied","Data":"5508206841ad4d7ff93b7f4c4676c4044e89b3c5db504be188f6120b22388522"}
Oct 30 22:14:10.510506 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.510461    4918 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5508206841ad4d7ff93b7f4c4676c4044e89b3c5db504be188f6120b22388522"
Oct 30 22:14:10.513342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.513125    4918 generic.go:356] "Generic (PLEG): container finished" podID="18416329-7c7b-48b1-bdcd-29f66e19e88b" containerID="fbffbb87781ce3392ad5b5c3ec59bc7e4d315ffae75d5af9706010b847015c55" exitCode=0
Oct 30 22:14:10.513342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.513266    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr" event={"ID":"18416329-7c7b-48b1-bdcd-29f66e19e88b","Type":"ContainerDied","Data":"fbffbb87781ce3392ad5b5c3ec59bc7e4d315ffae75d5af9706010b847015c55"}
Oct 30 22:14:10.515580 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.515553    4918 generic.go:356] "Generic (PLEG): container finished" podID="9739aa48-8d50-44be-80da-5eb24bed7994" containerID="4988dd7140dbd591090d8204af3a00f1d335b5d05951aee7cdc47367ede961e9" exitCode=0
Oct 30 22:14:10.515990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.515788    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7" event={"ID":"9739aa48-8d50-44be-80da-5eb24bed7994","Type":"ContainerDied","Data":"4988dd7140dbd591090d8204af3a00f1d335b5d05951aee7cdc47367ede961e9"}
Oct 30 22:14:10.525225 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.524870    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:14:10.634047 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.631977    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-maas-api-tls\") pod \"3b22aac2-81a7-4c52-bd29-7424121a2157\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") "
Oct 30 22:14:10.634047 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.632234    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3b22aac2-81a7-4c52-bd29-7424121a2157-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b22aac2-81a7-4c52-bd29-7424121a2157-openshift-service-ca\") pod \"3b22aac2-81a7-4c52-bd29-7424121a2157\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") "
Oct 30 22:14:10.634047 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.632269    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b22aac2-81a7-4c52-bd29-7424121a2157-kube-api-access-qjkp9\" (UniqueName: \"kubernetes.io/projected/3b22aac2-81a7-4c52-bd29-7424121a2157-kube-api-access-qjkp9\") pod \"3b22aac2-81a7-4c52-bd29-7424121a2157\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") "
Oct 30 22:14:10.634047 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.632467    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-metrics-certs\") pod \"3b22aac2-81a7-4c52-bd29-7424121a2157\" (UID: \"3b22aac2-81a7-4c52-bd29-7424121a2157\") "
Oct 30 22:14:10.639720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.638978    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b22aac2-81a7-4c52-bd29-7424121a2157-openshift-service-ca" pod "3b22aac2-81a7-4c52-bd29-7424121a2157" (UID: "3b22aac2-81a7-4c52-bd29-7424121a2157"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:14:10.651531 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.651496    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b22aac2-81a7-4c52-bd29-7424121a2157-kube-api-access-qjkp9" pod "3b22aac2-81a7-4c52-bd29-7424121a2157" (UID: "3b22aac2-81a7-4c52-bd29-7424121a2157"). InnerVolumeSpecName "kube-api-access-qjkp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:10.652016 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.651984    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-maas-api-tls" pod "3b22aac2-81a7-4c52-bd29-7424121a2157" (UID: "3b22aac2-81a7-4c52-bd29-7424121a2157"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:14:10.652852 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.652753    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-metrics-certs" pod "3b22aac2-81a7-4c52-bd29-7424121a2157" (UID: "3b22aac2-81a7-4c52-bd29-7424121a2157"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:14:10.738240 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.738132    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b22aac2-81a7-4c52-bd29-7424121a2157-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:10.738240 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.738186    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjkp9\" (UniqueName: \"kubernetes.io/projected/3b22aac2-81a7-4c52-bd29-7424121a2157-kube-api-access-qjkp9\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:10.738240 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.738229    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:10.738555 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.738244    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b22aac2-81a7-4c52-bd29-7424121a2157-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:10.946575 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.946541    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:14:10.982907 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:10.982872    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:14:11.062450 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.062362    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9739aa48-8d50-44be-80da-5eb24bed7994-istio-token\" (UniqueName: \"kubernetes.io/projected/9739aa48-8d50-44be-80da-5eb24bed7994-istio-token\") pod \"9739aa48-8d50-44be-80da-5eb24bed7994\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") "
Oct 30 22:14:11.063523 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.063498    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-envoy\") pod \"18416329-7c7b-48b1-bdcd-29f66e19e88b\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") "
Oct 30 22:14:11.063744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.063722    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-workload-certs\") pod \"9739aa48-8d50-44be-80da-5eb24bed7994\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") "
Oct 30 22:14:11.063935 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.063916    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9739aa48-8d50-44be-80da-5eb24bed7994-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9739aa48-8d50-44be-80da-5eb24bed7994-istiod-ca-cert\") pod \"9739aa48-8d50-44be-80da-5eb24bed7994\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") "
Oct 30 22:14:11.064091 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.064074    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-istio-data\") pod \"9739aa48-8d50-44be-80da-5eb24bed7994\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") "
Oct 30 22:14:11.064217 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.064201    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-istio-envoy\") pod \"9739aa48-8d50-44be-80da-5eb24bed7994\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") "
Oct 30 22:14:11.064417 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.064394    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-credential-socket\") pod \"9739aa48-8d50-44be-80da-5eb24bed7994\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") "
Oct 30 22:14:11.064619 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.064593    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18416329-7c7b-48b1-bdcd-29f66e19e88b-kube-api-access-x2tz9\" (UniqueName: \"kubernetes.io/projected/18416329-7c7b-48b1-bdcd-29f66e19e88b-kube-api-access-x2tz9\") pod \"18416329-7c7b-48b1-bdcd-29f66e19e88b\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") "
Oct 30 22:14:11.069227 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.068740    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-token\" (UniqueName: \"kubernetes.io/projected/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-token\") pod \"18416329-7c7b-48b1-bdcd-29f66e19e88b\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") "
Oct 30 22:14:11.069227 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.068807    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-workload-socket\") pod \"18416329-7c7b-48b1-bdcd-29f66e19e88b\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") "
Oct 30 22:14:11.069227 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.068854    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-workload-certs\") pod \"18416329-7c7b-48b1-bdcd-29f66e19e88b\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") "
Oct 30 22:14:11.069227 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.068897    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/18416329-7c7b-48b1-bdcd-29f66e19e88b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18416329-7c7b-48b1-bdcd-29f66e19e88b-istiod-ca-cert\") pod \"18416329-7c7b-48b1-bdcd-29f66e19e88b\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") "
Oct 30 22:14:11.069227 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.068930    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9739aa48-8d50-44be-80da-5eb24bed7994-kube-api-access-n64j4\" (UniqueName: \"kubernetes.io/projected/9739aa48-8d50-44be-80da-5eb24bed7994-kube-api-access-n64j4\") pod \"9739aa48-8d50-44be-80da-5eb24bed7994\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") "
Oct 30 22:14:11.069227 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.069012    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-data\") pod \"18416329-7c7b-48b1-bdcd-29f66e19e88b\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") "
Oct 30 22:14:11.069227 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.069080    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-podinfo\") pod \"18416329-7c7b-48b1-bdcd-29f66e19e88b\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") "
Oct 30 22:14:11.069227 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.069206    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9739aa48-8d50-44be-80da-5eb24bed7994-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9739aa48-8d50-44be-80da-5eb24bed7994-istio-podinfo\") pod \"9739aa48-8d50-44be-80da-5eb24bed7994\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") "
Oct 30 22:14:11.069904 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.069285    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-credential-socket\") pod \"18416329-7c7b-48b1-bdcd-29f66e19e88b\" (UID: \"18416329-7c7b-48b1-bdcd-29f66e19e88b\") "
Oct 30 22:14:11.069904 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.069425    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-workload-socket\") pod \"9739aa48-8d50-44be-80da-5eb24bed7994\" (UID: \"9739aa48-8d50-44be-80da-5eb24bed7994\") "
Oct 30 22:14:11.121107 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.068137    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9739aa48-8d50-44be-80da-5eb24bed7994-istiod-ca-cert" pod "9739aa48-8d50-44be-80da-5eb24bed7994" (UID: "9739aa48-8d50-44be-80da-5eb24bed7994"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:14:11.121107 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.080536    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-workload-socket" pod "9739aa48-8d50-44be-80da-5eb24bed7994" (UID: "9739aa48-8d50-44be-80da-5eb24bed7994"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:11.121107 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.083305    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18416329-7c7b-48b1-bdcd-29f66e19e88b-istiod-ca-cert" pod "18416329-7c7b-48b1-bdcd-29f66e19e88b" (UID: "18416329-7c7b-48b1-bdcd-29f66e19e88b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:14:11.121107 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.088807    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-credential-socket" pod "9739aa48-8d50-44be-80da-5eb24bed7994" (UID: "9739aa48-8d50-44be-80da-5eb24bed7994"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:11.121107 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.099853    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-workload-socket" pod "18416329-7c7b-48b1-bdcd-29f66e19e88b" (UID: "18416329-7c7b-48b1-bdcd-29f66e19e88b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:11.121107 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.100030    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-workload-certs" pod "18416329-7c7b-48b1-bdcd-29f66e19e88b" (UID: "18416329-7c7b-48b1-bdcd-29f66e19e88b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:11.121107 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.100207    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-workload-certs" pod "9739aa48-8d50-44be-80da-5eb24bed7994" (UID: "9739aa48-8d50-44be-80da-5eb24bed7994"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:11.121107 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.101315    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-istio-data" pod "9739aa48-8d50-44be-80da-5eb24bed7994" (UID: "9739aa48-8d50-44be-80da-5eb24bed7994"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:11.130147 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.123996    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18416329-7c7b-48b1-bdcd-29f66e19e88b-kube-api-access-x2tz9" pod "18416329-7c7b-48b1-bdcd-29f66e19e88b" (UID: "18416329-7c7b-48b1-bdcd-29f66e19e88b"). InnerVolumeSpecName "kube-api-access-x2tz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:11.130147 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.124409    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-data" pod "18416329-7c7b-48b1-bdcd-29f66e19e88b" (UID: "18416329-7c7b-48b1-bdcd-29f66e19e88b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:11.131238 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.131021    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-credential-socket" pod "18416329-7c7b-48b1-bdcd-29f66e19e88b" (UID: "18416329-7c7b-48b1-bdcd-29f66e19e88b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:11.143121 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.142981    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9739aa48-8d50-44be-80da-5eb24bed7994-kube-api-access-n64j4" pod "9739aa48-8d50-44be-80da-5eb24bed7994" (UID: "9739aa48-8d50-44be-80da-5eb24bed7994"). InnerVolumeSpecName "kube-api-access-n64j4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:11.157794 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.157730    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-token" pod "18416329-7c7b-48b1-bdcd-29f66e19e88b" (UID: "18416329-7c7b-48b1-bdcd-29f66e19e88b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:11.180109 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.158089    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-podinfo" pod "18416329-7c7b-48b1-bdcd-29f66e19e88b" (UID: "18416329-7c7b-48b1-bdcd-29f66e19e88b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:14:11.184425 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.184356    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.184658 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.184635    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.184831 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.184816    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18416329-7c7b-48b1-bdcd-29f66e19e88b-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.184944 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.184927    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n64j4\" (UniqueName: \"kubernetes.io/projected/9739aa48-8d50-44be-80da-5eb24bed7994-kube-api-access-n64j4\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.304394 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.304366    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.317614 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.317535    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.317853 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.317839    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.317962 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.317951    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.318071 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.318061    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.318167 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.318157    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9739aa48-8d50-44be-80da-5eb24bed7994-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.318253 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.318243    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.318333 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.318324    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.318420 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.318410    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2tz9\" (UniqueName: \"kubernetes.io/projected/18416329-7c7b-48b1-bdcd-29f66e19e88b-kube-api-access-x2tz9\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.318506 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.318494    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.318590 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.272423    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-istio-envoy" pod "9739aa48-8d50-44be-80da-5eb24bed7994" (UID: "9739aa48-8d50-44be-80da-5eb24bed7994"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:11.352716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.316597    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-envoy" pod "18416329-7c7b-48b1-bdcd-29f66e19e88b" (UID: "18416329-7c7b-48b1-bdcd-29f66e19e88b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:11.352716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.316829    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9739aa48-8d50-44be-80da-5eb24bed7994-istio-token" pod "9739aa48-8d50-44be-80da-5eb24bed7994" (UID: "9739aa48-8d50-44be-80da-5eb24bed7994"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:11.352716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.319122    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9739aa48-8d50-44be-80da-5eb24bed7994-istio-podinfo" pod "9739aa48-8d50-44be-80da-5eb24bed7994" (UID: "9739aa48-8d50-44be-80da-5eb24bed7994"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:14:11.421214 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.421134    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18416329-7c7b-48b1-bdcd-29f66e19e88b-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.421214 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.421169    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9739aa48-8d50-44be-80da-5eb24bed7994-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.421214 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.421180    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9739aa48-8d50-44be-80da-5eb24bed7994-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.421214 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.421190    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9739aa48-8d50-44be-80da-5eb24bed7994-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:11.527948 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.527920    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"
Oct 30 22:14:11.528120 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.527957    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr" event={"ID":"18416329-7c7b-48b1-bdcd-29f66e19e88b","Type":"ContainerDied","Data":"9b49e7edff4079a93b8246920336279f3ae38474fb95f22324dc06d43d81b574"}
Oct 30 22:14:11.528120 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.528022    4918 scope.go:122] "RemoveContainer" containerID="fbffbb87781ce3392ad5b5c3ec59bc7e4d315ffae75d5af9706010b847015c55"
Oct 30 22:14:11.529660 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.529630    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"
Oct 30 22:14:11.529818 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.529670    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7" event={"ID":"9739aa48-8d50-44be-80da-5eb24bed7994","Type":"ContainerDied","Data":"75870ea4e22767e17998258aee279a0ec05c3b21620e095e083cf1a49b366ee7"}
Oct 30 22:14:11.529881 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.529864    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"
Oct 30 22:14:11.540596 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.540485    4918 scope.go:122] "RemoveContainer" containerID="4988dd7140dbd591090d8204af3a00f1d335b5d05951aee7cdc47367ede961e9"
Oct 30 22:14:11.693790 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.693749    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"]
Oct 30 22:14:11.699945 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.699913    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-aa8c82d5-777479679f-29nfq"]
Oct 30 22:14:11.809152 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.809116    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"]
Oct 30 22:14:11.813137 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.813110    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-qq7lr"]
Oct 30 22:14:11.840995 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.840950    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:11.923843 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.923809    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"]
Oct 30 22:14:11.928772 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:11.928745    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-wssp7"]
Oct 30 22:14:12.112426 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:12.108576    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="18416329-7c7b-48b1-bdcd-29f66e19e88b" path="/var/lib/kubelet/pods/18416329-7c7b-48b1-bdcd-29f66e19e88b/volumes"
Oct 30 22:14:12.112426 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:12.109448    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3b22aac2-81a7-4c52-bd29-7424121a2157" path="/var/lib/kubelet/pods/3b22aac2-81a7-4c52-bd29-7424121a2157/volumes"
Oct 30 22:14:12.112426 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:12.110149    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9739aa48-8d50-44be-80da-5eb24bed7994" path="/var/lib/kubelet/pods/9739aa48-8d50-44be-80da-5eb24bed7994/volumes"
Oct 30 22:14:12.249799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:12.249742    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:12.507554 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:12.507518    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:15.866901 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:15.866870    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:16.319230 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.319196    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"]
Oct 30 22:14:16.320503 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.320075    4918 cpu_manager.go:414] "containerMap: removing container" podUID="18416329-7c7b-48b1-bdcd-29f66e19e88b" containerName="istio-proxy"
Oct 30 22:14:16.320503 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.320098    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18416329-7c7b-48b1-bdcd-29f66e19e88b" containerName="istio-proxy"
Oct 30 22:14:16.320503 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.320118    4918 cpu_manager.go:414] "containerMap: removing container" podUID="9739aa48-8d50-44be-80da-5eb24bed7994" containerName="istio-proxy"
Oct 30 22:14:16.320503 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.320125    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9739aa48-8d50-44be-80da-5eb24bed7994" containerName="istio-proxy"
Oct 30 22:14:16.320503 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.320143    4918 cpu_manager.go:414] "containerMap: removing container" podUID="3ced892b-6a91-43f1-b44d-62857db6004a" containerName="maas-api"
Oct 30 22:14:16.320503 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.320151    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ced892b-6a91-43f1-b44d-62857db6004a" containerName="maas-api"
Oct 30 22:14:16.320503 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.320171    4918 cpu_manager.go:414] "containerMap: removing container" podUID="3b22aac2-81a7-4c52-bd29-7424121a2157" containerName="maas-api"
Oct 30 22:14:16.320503 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.320179    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b22aac2-81a7-4c52-bd29-7424121a2157" containerName="maas-api"
Oct 30 22:14:16.321601 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.320965    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="18416329-7c7b-48b1-bdcd-29f66e19e88b" containerName="istio-proxy"
Oct 30 22:14:16.321601 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.320991    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="9739aa48-8d50-44be-80da-5eb24bed7994" containerName="istio-proxy"
Oct 30 22:14:16.321601 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.321002    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="3ced892b-6a91-43f1-b44d-62857db6004a" containerName="maas-api"
Oct 30 22:14:16.321601 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.321016    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b22aac2-81a7-4c52-bd29-7424121a2157" containerName="maas-api"
Oct 30 22:14:16.336740 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.329063    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.395795 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.385744    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-2d8852-openshift-default-dockercfg-2kg9q\""
Oct 30 22:14:16.615303 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.565105    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"]
Oct 30 22:14:16.615303 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.573914    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:16.704858 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.696219    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istiod-ca-cert\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.704858 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.696289    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-podinfo\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.704858 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.696333    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-workload-socket\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.704858 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.696628    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2f6b\" (UniqueName: \"kubernetes.io/projected/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-kube-api-access-b2f6b\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.760908 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.696674    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-credential-socket\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.760908 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.759846    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-token\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.776718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.767217    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-data\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.776718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.767350    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-workload-certs\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.776718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.767510    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-envoy\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.875934 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.875814    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2f6b\" (UniqueName: \"kubernetes.io/projected/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-kube-api-access-b2f6b\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.875934 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.875874    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-credential-socket\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.875934 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.875906    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-token\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.877442 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.877410    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-credential-socket\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.882719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.878503    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-data\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.882719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.878578    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-workload-certs\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.882719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.878762    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-envoy\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.882719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.878854    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istiod-ca-cert\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.882719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.878886    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-podinfo\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.882719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.878914    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-workload-socket\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.882719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.879291    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-workload-socket\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.882719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.880210    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-workload-certs\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.882719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.880420    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-data\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.890484 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.890409    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istiod-ca-cert\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.890484 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.890433    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-envoy\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.892990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.892972    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-podinfo\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.937337 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.937315    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2f6b\" (UniqueName: \"kubernetes.io/projected/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-kube-api-access-b2f6b\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.939557 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.939533    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-token\") pod \"e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") " pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:16.977979 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.977950    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"]
Oct 30 22:14:16.984068 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:16.984051    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:17.050712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.048225    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d7b3c557-serving-cert\""
Oct 30 22:14:17.080410 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.078035    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"]
Oct 30 22:14:17.084193 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.084151    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-maas-api-tls\") pod \"maas-api-e2e-ait-d7b3c557-586c75c579-shb5x\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:17.084794 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.084770    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-metrics-certs\") pod \"maas-api-e2e-ait-d7b3c557-586c75c579-shb5x\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:17.087250 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.085089    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84xw9\" (UniqueName: \"kubernetes.io/projected/c007e243-983e-4de7-8bed-7df4a06e99ad-kube-api-access-84xw9\") pod \"maas-api-e2e-ait-d7b3c557-586c75c579-shb5x\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:17.087529 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.087501    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c007e243-983e-4de7-8bed-7df4a06e99ad-openshift-service-ca\") pod \"maas-api-e2e-ait-d7b3c557-586c75c579-shb5x\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:17.190103 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.190066    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-maas-api-tls\") pod \"maas-api-e2e-ait-d7b3c557-586c75c579-shb5x\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:17.190249 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:14:17.190194    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-serving-cert: secret "maas-api-e2e-ait-d7b3c557-serving-cert" not found
Oct 30 22:14:17.190249 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.190209    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-metrics-certs\") pod \"maas-api-e2e-ait-d7b3c557-586c75c579-shb5x\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:17.190334 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:14:17.190276    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-maas-api-tls podName:c007e243-983e-4de7-8bed-7df4a06e99ad nodeName:}" failed. No retries permitted until 2026-10-30 22:14:17.690256813 +0000 UTC m=+1795.738864501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-maas-api-tls") pod "maas-api-e2e-ait-d7b3c557-586c75c579-shb5x" (UID: "c007e243-983e-4de7-8bed-7df4a06e99ad") : secret "maas-api-e2e-ait-d7b3c557-serving-cert" not found
Oct 30 22:14:17.190391 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.190339    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84xw9\" (UniqueName: \"kubernetes.io/projected/c007e243-983e-4de7-8bed-7df4a06e99ad-kube-api-access-84xw9\") pod \"maas-api-e2e-ait-d7b3c557-586c75c579-shb5x\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:17.190463 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.190448    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c007e243-983e-4de7-8bed-7df4a06e99ad-openshift-service-ca\") pod \"maas-api-e2e-ait-d7b3c557-586c75c579-shb5x\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:17.191111 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.191090    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c007e243-983e-4de7-8bed-7df4a06e99ad-openshift-service-ca\") pod \"maas-api-e2e-ait-d7b3c557-586c75c579-shb5x\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:17.192762 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.192738    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-metrics-certs\") pod \"maas-api-e2e-ait-d7b3c557-586c75c579-shb5x\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:17.209666 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.209646    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:17.256495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.256464    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84xw9\" (UniqueName: \"kubernetes.io/projected/c007e243-983e-4de7-8bed-7df4a06e99ad-kube-api-access-84xw9\") pod \"maas-api-e2e-ait-d7b3c557-586c75c579-shb5x\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:17.267607 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.267580    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:17.587800 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.587639    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:17.719670 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.719645    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"]
Oct 30 22:14:17.720143 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:14:17.720114    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod612f3d2b_2897_489a_bb3e_0dc4b00f49e4.slice/crio-1350479a5af810c6c56a5d3436ed2e6fe458750933003b8990472fd1e0a281a5 WatchSource:0}: Error finding container 1350479a5af810c6c56a5d3436ed2e6fe458750933003b8990472fd1e0a281a5: Status 404 returned error can't find the container with id 1350479a5af810c6c56a5d3436ed2e6fe458750933003b8990472fd1e0a281a5
Oct 30 22:14:17.722885 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.722850    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:17.723017 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.722922    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:17.723017 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.722957    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:17.725126 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.725099    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-maas-api-tls\") pod \"maas-api-e2e-ait-d7b3c557-586c75c579-shb5x\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:17.727697 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.727664    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-maas-api-tls\") pod \"maas-api-e2e-ait-d7b3c557-586c75c579-shb5x\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:17.766833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.766805    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525" event={"ID":"612f3d2b-2897-489a-bb3e-0dc4b00f49e4","Type":"ContainerStarted","Data":"1350479a5af810c6c56a5d3436ed2e6fe458750933003b8990472fd1e0a281a5"}
Oct 30 22:14:17.933522 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:17.933497    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:18.328600 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:18.328570    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"]
Oct 30 22:14:18.329377 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:14:18.329353    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc007e243_983e_4de7_8bed_7df4a06e99ad.slice/crio-bdb9b3981b7b57693a7e03dde62fe7c088a6e9d262c606cc2a4f7ff6c58ac695 WatchSource:0}: Error finding container bdb9b3981b7b57693a7e03dde62fe7c088a6e9d262c606cc2a4f7ff6c58ac695: Status 404 returned error can't find the container with id bdb9b3981b7b57693a7e03dde62fe7c088a6e9d262c606cc2a4f7ff6c58ac695
Oct 30 22:14:18.774661 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:18.774627    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x" event={"ID":"c007e243-983e-4de7-8bed-7df4a06e99ad","Type":"ContainerStarted","Data":"bdb9b3981b7b57693a7e03dde62fe7c088a6e9d262c606cc2a4f7ff6c58ac695"}
Oct 30 22:14:18.776574 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:18.776547    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525" event={"ID":"612f3d2b-2897-489a-bb3e-0dc4b00f49e4","Type":"ContainerStarted","Data":"b588a73fedc1289405f56c0abaa9b035e70a309cd255752ab3db3fe84bffcba1"}
Oct 30 22:14:18.899005 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:18.898958    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525" podStartSLOduration=2.898943557 podStartE2EDuration="2.898943557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:18.895924504 +0000 UTC m=+1796.944532204" watchObservedRunningTime="2026-10-30 22:14:18.898943557 +0000 UTC m=+1796.947551251"
Oct 30 22:14:19.223708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.220058    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:19.230702 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.227065    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:19.785670 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.785629    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x" event={"ID":"c007e243-983e-4de7-8bed-7df4a06e99ad","Type":"ContainerStarted","Data":"7fc4adae10aca5af1da889e3dd3022b80337cb146b5277dcafa32dfe468d31c3"}
Oct 30 22:14:19.785878 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.785729    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:19.785878 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.785769    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:19.786804 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.786782    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:14:19.875953 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.875925    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"]
Oct 30 22:14:19.880589 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.880567    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:19.893127 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.893105    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"]
Oct 30 22:14:19.897301 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.897283    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:19.905831 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.905792    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x" podStartSLOduration=2.9644246709999997 podStartE2EDuration="3.905781235s" totalImagesPullingTime="941.356564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:19.903808962 +0000 UTC m=+1797.952416660" watchObservedRunningTime="2026-10-30 22:14:19.905781235 +0000 UTC m=+1797.954388930"
Oct 30 22:14:19.985470 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.985436    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"]
Oct 30 22:14:19.997245 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.997198    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:19.997385 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.997338    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:19.997385 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.997379    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:19.997717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.997652    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28475ffd-de42-4a6a-a116-25e940739ffb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:19.997803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.997760    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:19.997903 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.997876    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gvnq\" (UniqueName: \"kubernetes.io/projected/4ac242a8-aab1-4e8b-83fd-5c25425d417a-kube-api-access-7gvnq\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:19.998136 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.998116    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:19.998215 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.998190    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:19.998263 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.998230    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:19.998319 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.998299    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28475ffd-de42-4a6a-a116-25e940739ffb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:19.998544 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.998516    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:19.998724 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.998577    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:19.998724 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.998641    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:19.998853 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.998752    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:19.998853 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.998787    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28475ffd-de42-4a6a-a116-25e940739ffb-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:19.998946 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.998908    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:19.998993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.998957    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft6lw\" (UniqueName: \"kubernetes.io/projected/28475ffd-de42-4a6a-a116-25e940739ffb-kube-api-access-ft6lw\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:19.999077 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:19.999055    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.030870 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.030815    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"]
Oct 30 22:14:20.100584 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.100509    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.100770 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.100582    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.100770 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.100610    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.100770 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.100636    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28475ffd-de42-4a6a-a116-25e940739ffb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.100770 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.100705    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.100770 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.100760    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gvnq\" (UniqueName: \"kubernetes.io/projected/4ac242a8-aab1-4e8b-83fd-5c25425d417a-kube-api-access-7gvnq\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.101043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.100793    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.101043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.100826    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.101043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.100870    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.101043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.100896    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28475ffd-de42-4a6a-a116-25e940739ffb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.101291 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.101037    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.101291 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.101043    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.101291 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.101183    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.101291 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.101233    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.101291 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.101290    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.101545 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.101320    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28475ffd-de42-4a6a-a116-25e940739ffb-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.101545 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.101388    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.101545 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.101428    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.101545 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.101491    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft6lw\" (UniqueName: \"kubernetes.io/projected/28475ffd-de42-4a6a-a116-25e940739ffb-kube-api-access-ft6lw\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.101545 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.101535    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.101866 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.101841    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.102156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.102127    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.102398 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.102375    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.102940 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.102911    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.105750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.103784    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.105750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.104584    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28475ffd-de42-4a6a-a116-25e940739ffb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.105750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.104852    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.105750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.105048    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.105750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.105078    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.107223 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.107206    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.107927 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.107905    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.109351 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.109312    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28475ffd-de42-4a6a-a116-25e940739ffb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.242863 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.236536    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft6lw\" (UniqueName: \"kubernetes.io/projected/28475ffd-de42-4a6a-a116-25e940739ffb-kube-api-access-ft6lw\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.242863 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.242746    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28475ffd-de42-4a6a-a116-25e940739ffb-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-4fhw7\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.244658 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.244608    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gvnq\" (UniqueName: \"kubernetes.io/projected/4ac242a8-aab1-4e8b-83fd-5c25425d417a-kube-api-access-7gvnq\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.246900 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.246856    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-dwtrc\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.495039 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.495004    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:20.511127 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.511097    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:20.990790 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:20.990759    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"]
Oct 30 22:14:21.026378 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:14:21.026347    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac242a8_aab1_4e8b_83fd_5c25425d417a.slice/crio-1ae728e22f400ba04f9afcbd4df24f775bada7470bf8e67a7f5ffd46615d7c95 WatchSource:0}: Error finding container 1ae728e22f400ba04f9afcbd4df24f775bada7470bf8e67a7f5ffd46615d7c95: Status 404 returned error can't find the container with id 1ae728e22f400ba04f9afcbd4df24f775bada7470bf8e67a7f5ffd46615d7c95
Oct 30 22:14:21.027410 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:14:21.027382    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28475ffd_de42_4a6a_a116_25e940739ffb.slice/crio-cc0e4c5a600ec5752117974e3f1b11f4d536b7091b13ee3568680f1b548ad4a8 WatchSource:0}: Error finding container cc0e4c5a600ec5752117974e3f1b11f4d536b7091b13ee3568680f1b548ad4a8: Status 404 returned error can't find the container with id cc0e4c5a600ec5752117974e3f1b11f4d536b7091b13ee3568680f1b548ad4a8
Oct 30 22:14:21.029169 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:21.029138    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:21.029257 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:21.029205    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:21.029257 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:21.029240    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:21.030376 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:21.030346    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:21.030453 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:21.030420    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:21.030487 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:21.030460    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:21.041150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:21.041124    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"]
Oct 30 22:14:21.815708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:21.815553    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:21.840709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:21.834429    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" event={"ID":"28475ffd-de42-4a6a-a116-25e940739ffb","Type":"ContainerStarted","Data":"65a4f8a9a17794d586ba6057395980c3a8e4f1703f7756e5cea7839d143a5140"}
Oct 30 22:14:21.840709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:21.834495    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" event={"ID":"28475ffd-de42-4a6a-a116-25e940739ffb","Type":"ContainerStarted","Data":"cc0e4c5a600ec5752117974e3f1b11f4d536b7091b13ee3568680f1b548ad4a8"}
Oct 30 22:14:21.840709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:21.837887    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" event={"ID":"4ac242a8-aab1-4e8b-83fd-5c25425d417a","Type":"ContainerStarted","Data":"657b43c2c5a5f5d4153ed6d6739a46ccd535fddaf690b230be2c5c7703a8148f"}
Oct 30 22:14:21.840709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:21.837951    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" event={"ID":"4ac242a8-aab1-4e8b-83fd-5c25425d417a","Type":"ContainerStarted","Data":"1ae728e22f400ba04f9afcbd4df24f775bada7470bf8e67a7f5ffd46615d7c95"}
Oct 30 22:14:21.956433 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:21.956370    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" podStartSLOduration=2.956355875 podStartE2EDuration="2.956355875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:21.95367556 +0000 UTC m=+1800.002283255" watchObservedRunningTime="2026-10-30 22:14:21.956355875 +0000 UTC m=+1800.004963571"
Oct 30 22:14:22.088543 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:22.088444    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" podStartSLOduration=3.088431051 podStartE2EDuration="3.088431051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:22.085791196 +0000 UTC m=+1800.134398891" watchObservedRunningTime="2026-10-30 22:14:22.088431051 +0000 UTC m=+1800.137038743"
Oct 30 22:14:22.091942 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:22.091910    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:22.279796 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:22.279764    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:14:22.282321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:22.282299    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:14:22.511845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:22.511770    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:22.513646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:22.513622    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:22.520991 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:22.519565    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4fhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 22:14:22.520991 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:22.519627    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 22:14:22.524545 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:22.522791    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dwtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 22:14:22.524545 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:22.522842    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" podUID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 22:14:22.595445 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:22.595411    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:23.179803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:23.154430    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"]
Oct 30 22:14:23.179803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:23.154792    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr" podUID="9b51782b-f6a0-43c8-a8d8-c06c3045f379" containerName="istio-proxy" containerID="cri-o://c8f1ce9c1c22efd79489f08726ff1ecf83d058e2cfd915899474b973dbbfc22a" gracePeriod=30
Oct 30 22:14:23.248734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:23.238352    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:23.297787 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:23.294895    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"]
Oct 30 22:14:23.297787 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:23.295142    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6" podUID="004019a0-a1a4-4042-abb4-d6229795bc35" containerName="istio-proxy" containerID="cri-o://cff318c2c3d2519081c7fb9391ba72f0634b21c9c9d4a8f0d8d0b2bdfd2db4f2" gracePeriod=30
Oct 30 22:14:23.353719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:23.336034    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"]
Oct 30 22:14:23.353719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:23.336318    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf" podUID="be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" containerName="istio-proxy" containerID="cri-o://66e811e67ded3d147e886c54e185831ec2c203f88859a89a9c29d4285176551b" gracePeriod=30
Oct 30 22:14:23.530026 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:23.508236    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dwtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 22:14:23.530026 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:23.508307    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" podUID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 22:14:23.530026 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:23.509396    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:23.530026 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:23.515328    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4fhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 22:14:23.530026 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:23.515367    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 22:14:23.823861 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:23.823775    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:24.268719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.265272    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"]
Oct 30 22:14:24.285728 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.284083    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.314752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.303970    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-workload-certs\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.314752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.304036    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-credential-socket\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.314752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.304107    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-podinfo\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.314752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.304210    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j8zn\" (UniqueName: \"kubernetes.io/projected/e184fc8f-c462-4f29-bbf0-46ab63033f13-kube-api-access-8j8zn\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.314752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.304305    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-workload-socket\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.314752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.304340    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-data\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.314752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.304377    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-envoy\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.314752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.304471    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e184fc8f-c462-4f29-bbf0-46ab63033f13-istiod-ca-cert\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.314752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.304549    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-token\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.371882 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.369670    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"]
Oct 30 22:14:24.436709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.413102    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w5-9a96b4-openshift-default-dockercfg-cdjvs\""
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.521246    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dwtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.521304    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" podUID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.523669    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4fhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.523737    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.530107    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e184fc8f-c462-4f29-bbf0-46ab63033f13-istiod-ca-cert\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.530202    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-token\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.530351    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-workload-certs\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.530392    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-credential-socket\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.530464    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-podinfo\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.530571    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j8zn\" (UniqueName: \"kubernetes.io/projected/e184fc8f-c462-4f29-bbf0-46ab63033f13-kube-api-access-8j8zn\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.530670    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-workload-socket\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.530727    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-data\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.530773    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-envoy\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.544453    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-credential-socket\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.545144    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e184fc8f-c462-4f29-bbf0-46ab63033f13-istiod-ca-cert\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.545729    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-workload-certs\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.545985    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-workload-socket\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.551114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.546222    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-data\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.584133 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.584088    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:24.632474 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.632313    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-podinfo\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.634966 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.634931    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-envoy\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.771710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.766868    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-token\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.862761 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.844369    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j8zn\" (UniqueName: \"kubernetes.io/projected/e184fc8f-c462-4f29-bbf0-46ab63033f13-kube-api-access-8j8zn\") pod \"e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") " pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:24.917737 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:24.912032    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:25.099715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:25.097182    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:25.413351 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:25.412611    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:25.522330 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:25.521835    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dwtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 22:14:25.522330 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:25.521912    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" podUID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 22:14:25.530705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:25.526824    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4fhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 22:14:25.530705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:25.526885    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 22:14:25.794758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:25.788154    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:25.840963 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:25.840936    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:14:26.488612 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.488566    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:26.489033 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.488748    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:26.489033 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.488838    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:26.520321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.520237    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4fhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 22:14:26.520583 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.520556    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 22:14:26.520977 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.520950    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dwtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 22:14:26.521140 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.521119    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" podUID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 22:14:26.565918 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.565882    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"]
Oct 30 22:14:26.573057 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.572982    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"]
Oct 30 22:14:26.573177 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.573081    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"
Oct 30 22:14:26.574438 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.574417    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"]
Oct 30 22:14:26.639258 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.638445    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-2d8852\""
Oct 30 22:14:26.639258 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.638630    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-2d8852-dockercfg-tkcp8\""
Oct 30 22:14:26.662908 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.662722    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxd7n\" (UniqueName: \"kubernetes.io/projected/06c38ed1-2d5f-4d24-94e2-66622e8730b2-kube-api-access-zxd7n\") pod \"payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l\" (UID: \"06c38ed1-2d5f-4d24-94e2-66622e8730b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"
Oct 30 22:14:26.662908 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.662895    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06c38ed1-2d5f-4d24-94e2-66622e8730b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l\" (UID: \"06c38ed1-2d5f-4d24-94e2-66622e8730b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"
Oct 30 22:14:26.765629 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.765133    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxd7n\" (UniqueName: \"kubernetes.io/projected/06c38ed1-2d5f-4d24-94e2-66622e8730b2-kube-api-access-zxd7n\") pod \"payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l\" (UID: \"06c38ed1-2d5f-4d24-94e2-66622e8730b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"
Oct 30 22:14:26.765831 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.765808    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06c38ed1-2d5f-4d24-94e2-66622e8730b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l\" (UID: \"06c38ed1-2d5f-4d24-94e2-66622e8730b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"
Oct 30 22:14:26.766982 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.766954    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06c38ed1-2d5f-4d24-94e2-66622e8730b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l\" (UID: \"06c38ed1-2d5f-4d24-94e2-66622e8730b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"
Oct 30 22:14:26.860143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.860117    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxd7n\" (UniqueName: \"kubernetes.io/projected/06c38ed1-2d5f-4d24-94e2-66622e8730b2-kube-api-access-zxd7n\") pod \"payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l\" (UID: \"06c38ed1-2d5f-4d24-94e2-66622e8730b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"
Oct 30 22:14:26.975486 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:26.975453    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"
Oct 30 22:14:27.564215 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:27.564185    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4fhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 22:14:27.564752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:27.564719    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 22:14:27.565862 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:27.565840    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dwtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 22:14:27.566042 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:27.566016    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" podUID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 22:14:27.600972 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:27.600901    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt" event={"ID":"e184fc8f-c462-4f29-bbf0-46ab63033f13","Type":"ContainerStarted","Data":"f4bcc12162e521adbaa7871f657160aa28eb34e3ae61a736481008a86d31428d"}
Oct 30 22:14:27.601229 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:27.601207    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt" event={"ID":"e184fc8f-c462-4f29-bbf0-46ab63033f13","Type":"ContainerStarted","Data":"6a59acb86599e2c5d6d47909c0129c4ecb04667f3e57f01a46a1fbee7fae5ba6"}
Oct 30 22:14:27.676764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:27.674264    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"]
Oct 30 22:14:27.754143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:27.754081    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt" podStartSLOduration=3.75406046 podStartE2EDuration="3.75406046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:27.752564318 +0000 UTC m=+1805.801172016" watchObservedRunningTime="2026-10-30 22:14:27.75406046 +0000 UTC m=+1805.802668156"
Oct 30 22:14:27.921708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:27.919369    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:27.945743 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:27.942913    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:28.218816 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.213784    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:28.510748 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.498983    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dwtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 22:14:28.510748 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.499042    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" podUID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 22:14:28.542965 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.542842    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4fhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 22:14:28.542965 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.542906    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 22:14:28.774850 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.774756    4918 generic.go:356] "Generic (PLEG): container finished" podID="004019a0-a1a4-4042-abb4-d6229795bc35" containerID="cff318c2c3d2519081c7fb9391ba72f0634b21c9c9d4a8f0d8d0b2bdfd2db4f2" exitCode=0
Oct 30 22:14:28.775338 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.774946    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6" event={"ID":"004019a0-a1a4-4042-abb4-d6229795bc35","Type":"ContainerDied","Data":"cff318c2c3d2519081c7fb9391ba72f0634b21c9c9d4a8f0d8d0b2bdfd2db4f2"}
Oct 30 22:14:28.783739 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.779792    4918 generic.go:356] "Generic (PLEG): container finished" podID="be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" containerID="66e811e67ded3d147e886c54e185831ec2c203f88859a89a9c29d4285176551b" exitCode=0
Oct 30 22:14:28.783739 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.779990    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf" event={"ID":"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3","Type":"ContainerDied","Data":"66e811e67ded3d147e886c54e185831ec2c203f88859a89a9c29d4285176551b"}
Oct 30 22:14:28.783739 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.782742    4918 generic.go:356] "Generic (PLEG): container finished" podID="9b51782b-f6a0-43c8-a8d8-c06c3045f379" containerID="c8f1ce9c1c22efd79489f08726ff1ecf83d058e2cfd915899474b973dbbfc22a" exitCode=0
Oct 30 22:14:28.783739 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.782896    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr" event={"ID":"9b51782b-f6a0-43c8-a8d8-c06c3045f379","Type":"ContainerDied","Data":"c8f1ce9c1c22efd79489f08726ff1ecf83d058e2cfd915899474b973dbbfc22a"}
Oct 30 22:14:28.831309 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.827306    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l" event={"ID":"06c38ed1-2d5f-4d24-94e2-66622e8730b2","Type":"ContainerStarted","Data":"e8f53e7a6c699f1324224df7a8631fd08760bf524bf2fdc821c8873a5aacb89e"}
Oct 30 22:14:28.831309 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.827379    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"
Oct 30 22:14:28.831309 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.827403    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l" event={"ID":"06c38ed1-2d5f-4d24-94e2-66622e8730b2","Type":"ContainerStarted","Data":"51ce2c6d9d8218236e070907bce771115ebb70d918b089c289237ef16b02c3b9"}
Oct 30 22:14:28.831309 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.827725    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:28.831309 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.829582    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:14:28.948711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:28.946177    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l" podStartSLOduration=3.946153646 podStartE2EDuration="3.946153646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:28.942795861 +0000 UTC m=+1806.991403557" watchObservedRunningTime="2026-10-30 22:14:28.946153646 +0000 UTC m=+1806.994761343"
Oct 30 22:14:29.034740 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.034707    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:14:29.039881 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.039850    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:14:29.041991 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.041960    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:14:29.268047 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.268011    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-workload-socket\") pod \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") "
Oct 30 22:14:29.268314 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.268291    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-podinfo\") pod \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") "
Oct 30 22:14:29.268470 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.268453    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-credential-socket\") pod \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") "
Oct 30 22:14:29.268607 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.268587    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-envoy\") pod \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") "
Oct 30 22:14:29.276970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.268805    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-credential-socket\") pod \"004019a0-a1a4-4042-abb4-d6229795bc35\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") "
Oct 30 22:14:29.277280 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.277258    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-workload-certs\") pod \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") "
Oct 30 22:14:29.277453 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.277435    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-istio-data\") pod \"004019a0-a1a4-4042-abb4-d6229795bc35\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") "
Oct 30 22:14:29.277634 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.277617    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-token\" (UniqueName: \"kubernetes.io/projected/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-token\") pod \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") "
Oct 30 22:14:29.277781 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.277759    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/004019a0-a1a4-4042-abb4-d6229795bc35-kube-api-access-qkkdq\" (UniqueName: \"kubernetes.io/projected/004019a0-a1a4-4042-abb4-d6229795bc35-kube-api-access-qkkdq\") pod \"004019a0-a1a4-4042-abb4-d6229795bc35\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") "
Oct 30 22:14:29.277901 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.277887    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-workload-certs\") pod \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") "
Oct 30 22:14:29.278098 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.278082    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-istio-envoy\") pod \"004019a0-a1a4-4042-abb4-d6229795bc35\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") "
Oct 30 22:14:29.278224 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.278209    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istiod-ca-cert\") pod \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") "
Oct 30 22:14:29.278336 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.278320    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-credential-socket\") pod \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") "
Oct 30 22:14:29.278467 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.278453    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-envoy\") pod \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") "
Oct 30 22:14:29.278640 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.278622    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-data\") pod \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") "
Oct 30 22:14:29.278839 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.278821    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b51782b-f6a0-43c8-a8d8-c06c3045f379-kube-api-access-d77hs\" (UniqueName: \"kubernetes.io/projected/9b51782b-f6a0-43c8-a8d8-c06c3045f379-kube-api-access-d77hs\") pod \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") "
Oct 30 22:14:29.278994 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.278977    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-workload-socket\") pod \"004019a0-a1a4-4042-abb4-d6229795bc35\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") "
Oct 30 22:14:29.279146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.279129    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-kube-api-access-7wwpp\" (UniqueName: \"kubernetes.io/projected/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-kube-api-access-7wwpp\") pod \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") "
Oct 30 22:14:29.279267 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.279253    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-token\" (UniqueName: \"kubernetes.io/projected/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-token\") pod \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") "
Oct 30 22:14:29.279403 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.279389    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/004019a0-a1a4-4042-abb4-d6229795bc35-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004019a0-a1a4-4042-abb4-d6229795bc35-istiod-ca-cert\") pod \"004019a0-a1a4-4042-abb4-d6229795bc35\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") "
Oct 30 22:14:29.279672 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.279621    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-workload-socket\") pod \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") "
Oct 30 22:14:29.279880 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.279862    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istiod-ca-cert\") pod \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") "
Oct 30 22:14:29.280034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.280020    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-podinfo\") pod \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\" (UID: \"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3\") "
Oct 30 22:14:29.280143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.280131    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-data\") pod \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\" (UID: \"9b51782b-f6a0-43c8-a8d8-c06c3045f379\") "
Oct 30 22:14:29.280242 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.280230    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/004019a0-a1a4-4042-abb4-d6229795bc35-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004019a0-a1a4-4042-abb4-d6229795bc35-istio-podinfo\") pod \"004019a0-a1a4-4042-abb4-d6229795bc35\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") "
Oct 30 22:14:29.280334 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.280321    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/004019a0-a1a4-4042-abb4-d6229795bc35-istio-token\" (UniqueName: \"kubernetes.io/projected/004019a0-a1a4-4042-abb4-d6229795bc35-istio-token\") pod \"004019a0-a1a4-4042-abb4-d6229795bc35\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") "
Oct 30 22:14:29.280464 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.280452    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-workload-certs\") pod \"004019a0-a1a4-4042-abb4-d6229795bc35\" (UID: \"004019a0-a1a4-4042-abb4-d6229795bc35\") "
Oct 30 22:14:29.281841 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.281818    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-workload-certs" pod "004019a0-a1a4-4042-abb4-d6229795bc35" (UID: "004019a0-a1a4-4042-abb4-d6229795bc35"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:29.282185 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.282167    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-workload-socket" pod "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" (UID: "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:29.284603 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.284581    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-podinfo" pod "9b51782b-f6a0-43c8-a8d8-c06c3045f379" (UID: "9b51782b-f6a0-43c8-a8d8-c06c3045f379"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:14:29.284991 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.284972    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-credential-socket" pod "9b51782b-f6a0-43c8-a8d8-c06c3045f379" (UID: "9b51782b-f6a0-43c8-a8d8-c06c3045f379"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:29.287843 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.287616    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-envoy" pod "9b51782b-f6a0-43c8-a8d8-c06c3045f379" (UID: "9b51782b-f6a0-43c8-a8d8-c06c3045f379"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:29.288141 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.287974    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-credential-socket" pod "004019a0-a1a4-4042-abb4-d6229795bc35" (UID: "004019a0-a1a4-4042-abb4-d6229795bc35"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:29.288439 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.288271    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-workload-certs" pod "9b51782b-f6a0-43c8-a8d8-c06c3045f379" (UID: "9b51782b-f6a0-43c8-a8d8-c06c3045f379"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:29.288803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.288561    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-istio-data" pod "004019a0-a1a4-4042-abb4-d6229795bc35" (UID: "004019a0-a1a4-4042-abb4-d6229795bc35"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:29.291622 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.291364    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-token" pod "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" (UID: "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:29.294136 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.293947    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/004019a0-a1a4-4042-abb4-d6229795bc35-kube-api-access-qkkdq" pod "004019a0-a1a4-4042-abb4-d6229795bc35" (UID: "004019a0-a1a4-4042-abb4-d6229795bc35"). InnerVolumeSpecName "kube-api-access-qkkdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:29.294506 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.294269    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-workload-certs" pod "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" (UID: "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:29.296826 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.296573    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-istio-envoy" pod "004019a0-a1a4-4042-abb4-d6229795bc35" (UID: "004019a0-a1a4-4042-abb4-d6229795bc35"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:29.297269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.297056    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istiod-ca-cert" pod "9b51782b-f6a0-43c8-a8d8-c06c3045f379" (UID: "9b51782b-f6a0-43c8-a8d8-c06c3045f379"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:14:29.297647 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.297398    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-credential-socket" pod "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" (UID: "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:29.300061 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.299889    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-envoy" pod "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" (UID: "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:29.300444 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.300193    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-data" pod "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" (UID: "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:29.303454 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.303242    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b51782b-f6a0-43c8-a8d8-c06c3045f379-kube-api-access-d77hs" pod "9b51782b-f6a0-43c8-a8d8-c06c3045f379" (UID: "9b51782b-f6a0-43c8-a8d8-c06c3045f379"). InnerVolumeSpecName "kube-api-access-d77hs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:29.303874 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.303598    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-workload-socket" pod "004019a0-a1a4-4042-abb4-d6229795bc35" (UID: "004019a0-a1a4-4042-abb4-d6229795bc35"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:29.306727 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.306411    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-kube-api-access-7wwpp" pod "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" (UID: "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3"). InnerVolumeSpecName "kube-api-access-7wwpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:29.306727 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.306653    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istiod-ca-cert" pod "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" (UID: "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:14:29.310085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.309854    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-podinfo" pod "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" (UID: "be3fcc89-f2e9-493b-a1cd-4e1ac67186c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:14:29.310509 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.310237    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-data" pod "9b51782b-f6a0-43c8-a8d8-c06c3045f379" (UID: "9b51782b-f6a0-43c8-a8d8-c06c3045f379"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:29.311438 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.311415    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-token" pod "9b51782b-f6a0-43c8-a8d8-c06c3045f379" (UID: "9b51782b-f6a0-43c8-a8d8-c06c3045f379"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:29.311938 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.311916    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/004019a0-a1a4-4042-abb4-d6229795bc35-istiod-ca-cert" pod "004019a0-a1a4-4042-abb4-d6229795bc35" (UID: "004019a0-a1a4-4042-abb4-d6229795bc35"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:14:29.312320 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.312300    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-workload-socket" pod "9b51782b-f6a0-43c8-a8d8-c06c3045f379" (UID: "9b51782b-f6a0-43c8-a8d8-c06c3045f379"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:14:29.312943 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.312627    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/004019a0-a1a4-4042-abb4-d6229795bc35-istio-podinfo" pod "004019a0-a1a4-4042-abb4-d6229795bc35" (UID: "004019a0-a1a4-4042-abb4-d6229795bc35"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:14:29.321951 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.319037    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/004019a0-a1a4-4042-abb4-d6229795bc35-istio-token" pod "004019a0-a1a4-4042-abb4-d6229795bc35" (UID: "004019a0-a1a4-4042-abb4-d6229795bc35"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:14:29.325474 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.325382    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:29.383110 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383066    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383110 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383101    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004019a0-a1a4-4042-abb4-d6229795bc35-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383110 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383115    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004019a0-a1a4-4042-abb4-d6229795bc35-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383127    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383140    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383151    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383163    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383174    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383187    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383198    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383209    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383220    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383233    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkkdq\" (UniqueName: \"kubernetes.io/projected/004019a0-a1a4-4042-abb4-d6229795bc35-kube-api-access-qkkdq\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383246    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383258    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383270    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383282    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383295    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383307    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383321    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d77hs\" (UniqueName: \"kubernetes.io/projected/9b51782b-f6a0-43c8-a8d8-c06c3045f379-kube-api-access-d77hs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383335    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004019a0-a1a4-4042-abb4-d6229795bc35-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383348    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wwpp\" (UniqueName: \"kubernetes.io/projected/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-kube-api-access-7wwpp\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383363    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b51782b-f6a0-43c8-a8d8-c06c3045f379-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383377    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004019a0-a1a4-4042-abb4-d6229795bc35-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383392    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b51782b-f6a0-43c8-a8d8-c06c3045f379-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383405    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.383411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.383419    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:14:29.497798 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.495589    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dwtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 22:14:29.497798 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.495733    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" podUID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 22:14:29.512195 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.512166    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4fhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 22:14:29.512339 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:29.512231    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 22:14:30.104120 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.101791    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"
Oct 30 22:14:30.597107 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.597042    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dwtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 22:14:30.597446 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.597391    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" podUID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 22:14:30.626298 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.626023    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:30.700082 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.700030    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:14:30.705848 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.705787    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4fhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 22:14:30.706057 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.705909    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 22:14:30.721913 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.721880    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"
Oct 30 22:14:30.804370 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.804345    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"
Oct 30 22:14:30.839597 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.839572    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"]
Oct 30 22:14:30.840875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.840775    4918 cpu_manager.go:414] "containerMap: removing container" podUID="be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" containerName="istio-proxy"
Oct 30 22:14:30.841006 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.840991    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" containerName="istio-proxy"
Oct 30 22:14:30.841149 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.841139    4918 cpu_manager.go:414] "containerMap: removing container" podUID="9b51782b-f6a0-43c8-a8d8-c06c3045f379" containerName="istio-proxy"
Oct 30 22:14:30.842952 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.842933    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9b51782b-f6a0-43c8-a8d8-c06c3045f379" containerName="istio-proxy"
Oct 30 22:14:30.843106 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.843086    4918 cpu_manager.go:414] "containerMap: removing container" podUID="004019a0-a1a4-4042-abb4-d6229795bc35" containerName="istio-proxy"
Oct 30 22:14:30.843181 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.843172    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="004019a0-a1a4-4042-abb4-d6229795bc35" containerName="istio-proxy"
Oct 30 22:14:30.843384 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.843375    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="9b51782b-f6a0-43c8-a8d8-c06c3045f379" containerName="istio-proxy"
Oct 30 22:14:30.843439 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.843433    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="004019a0-a1a4-4042-abb4-d6229795bc35" containerName="istio-proxy"
Oct 30 22:14:30.843494 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.843487    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" containerName="istio-proxy"
Oct 30 22:14:30.853796 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.851722    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6" event={"ID":"004019a0-a1a4-4042-abb4-d6229795bc35","Type":"ContainerDied","Data":"138ae220453a64da2143eca89c19095697074e7a7542feb29d1a1112a6e8022c"}
Oct 30 22:14:30.853796 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.851763    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"]
Oct 30 22:14:30.853796 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.851802    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"]
Oct 30 22:14:30.853796 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.851820    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf" event={"ID":"be3fcc89-f2e9-493b-a1cd-4e1ac67186c3","Type":"ContainerDied","Data":"cae69fb2e0e793ce3e266765eb02cae9a56cd387fe772e18e727ed6406ca0943"}
Oct 30 22:14:30.853796 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.851851    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-rthh6"]
Oct 30 22:14:30.853796 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.851873    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr" event={"ID":"9b51782b-f6a0-43c8-a8d8-c06c3045f379","Type":"ContainerDied","Data":"a2fbf925055ae4c4901fff39cb38754eabe101fe6b75d01f370beb17f5e007cb"}
Oct 30 22:14:30.853796 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.851895    4918 scope.go:122] "RemoveContainer" containerID="cff318c2c3d2519081c7fb9391ba72f0634b21c9c9d4a8f0d8d0b2bdfd2db4f2"
Oct 30 22:14:30.853796 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.852101    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:30.879050 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.878088    4918 scope.go:122] "RemoveContainer" containerID="66e811e67ded3d147e886c54e185831ec2c203f88859a89a9c29d4285176551b"
Oct 30 22:14:30.893115 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.893070    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:30.893341 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.893320    4918 scope.go:122] "RemoveContainer" containerID="c8f1ce9c1c22efd79489f08726ff1ecf83d058e2cfd915899474b973dbbfc22a"
Oct 30 22:14:30.904763 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.904743    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3b355441-openshift-default-dockercfg-7g4pz\""
Oct 30 22:14:30.926442 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.926408    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-workload-socket\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:30.926576 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.926487    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-envoy\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:30.926576 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.926520    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44fc5\" (UniqueName: \"kubernetes.io/projected/100bc157-e8bd-4b34-811d-c857cd4e8640-kube-api-access-44fc5\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:30.926742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.926634    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/100bc157-e8bd-4b34-811d-c857cd4e8640-istiod-ca-cert\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:30.926810 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.926756    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-token\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:30.927441 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.927415    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-data\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:30.927540 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.927490    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-credential-socket\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:30.927611 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.927540    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-workload-certs\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:30.927611 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.927565    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-podinfo\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:30.954770 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.954738    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"]
Oct 30 22:14:30.965730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:30.964710    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-4sbtr"]
Oct 30 22:14:31.029005 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.028961    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-workload-socket\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.030157 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.030026    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-workload-socket\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.030759 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.030739    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-envoy\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.030926 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.030908    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44fc5\" (UniqueName: \"kubernetes.io/projected/100bc157-e8bd-4b34-811d-c857cd4e8640-kube-api-access-44fc5\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.031462 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.031437    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/100bc157-e8bd-4b34-811d-c857cd4e8640-istiod-ca-cert\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.032361 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.032341    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-token\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.032822 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.032800    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-data\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.032980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.032962    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-credential-socket\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.033132 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.033113    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-workload-certs\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.033262 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.033244    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-podinfo\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.040154 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.032243    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/100bc157-e8bd-4b34-811d-c857cd4e8640-istiod-ca-cert\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.040154 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.039852    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-data\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.040154 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.040105    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-workload-certs\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.040651 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.040629    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-credential-socket\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.041302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.041260    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-envoy\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.047957 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.047655    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-podinfo\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.136206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.134351    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44fc5\" (UniqueName: \"kubernetes.io/projected/100bc157-e8bd-4b34-811d-c857cd4e8640-kube-api-access-44fc5\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.144181 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.144127    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-token\") pod \"e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") " pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.181074 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.181041    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:31.205273 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.205243    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"]
Oct 30 22:14:31.211231 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.211205    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-aa8c82d5-openshift-default-7949b48845-r7jvf"]
Oct 30 22:14:31.496366 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.495893    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dwtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Oct 30 22:14:31.496366 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.495960    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" podUID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Oct 30 22:14:31.512850 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.512715    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4fhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 22:14:31.512850 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.512794    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 22:14:31.671839 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:14:31.671807    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod100bc157_e8bd_4b34_811d_c857cd4e8640.slice/crio-0ccba0ae3f36e2be98b153990d63b51bf9e728c24c96be32e424f4703a80d924 WatchSource:0}: Error finding container 0ccba0ae3f36e2be98b153990d63b51bf9e728c24c96be32e424f4703a80d924: Status 404 returned error can't find the container with id 0ccba0ae3f36e2be98b153990d63b51bf9e728c24c96be32e424f4703a80d924
Oct 30 22:14:31.672288 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.672260    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"]
Oct 30 22:14:31.674782 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.674748    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:31.675056 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.675032    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:31.675235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.675215    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:14:31.823116 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:31.823071    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w" event={"ID":"100bc157-e8bd-4b34-811d-c857cd4e8640","Type":"ContainerStarted","Data":"0ccba0ae3f36e2be98b153990d63b51bf9e728c24c96be32e424f4703a80d924"}
Oct 30 22:14:32.197708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:32.192162    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="004019a0-a1a4-4042-abb4-d6229795bc35" path="/var/lib/kubelet/pods/004019a0-a1a4-4042-abb4-d6229795bc35/volumes"
Oct 30 22:14:32.206557 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:32.206527    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9b51782b-f6a0-43c8-a8d8-c06c3045f379" path="/var/lib/kubelet/pods/9b51782b-f6a0-43c8-a8d8-c06c3045f379/volumes"
Oct 30 22:14:32.207555 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:32.207532    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="be3fcc89-f2e9-493b-a1cd-4e1ac67186c3" path="/var/lib/kubelet/pods/be3fcc89-f2e9-493b-a1cd-4e1ac67186c3/volumes"
Oct 30 22:14:32.299149 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:14:32.299111    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:14:32.890073 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:32.890031    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w" event={"ID":"100bc157-e8bd-4b34-811d-c857cd4e8640","Type":"ContainerStarted","Data":"924952bcfd3712aa07ea3c70804f87cc723ebbaaa14b57ee96b5996d88e3eb07"}
Oct 30 22:14:33.002986 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:33.002942    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:14:33.159762 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:33.143415    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w" podStartSLOduration=4.143394473 podStartE2EDuration="4.143394473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:33.077618071 +0000 UTC m=+1811.126225767" watchObservedRunningTime="2026-10-30 22:14:33.143394473 +0000 UTC m=+1811.192002169"
Oct 30 22:14:33.193182 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:33.193152    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:33.209710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:33.208059    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:33.530904 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:33.530810    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4fhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:14:33.531142 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:33.531114    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:14:33.554216 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:33.553788    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-dwtrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:14:33.554216 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:33.553850    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" podUID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:14:33.728434 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:33.728394    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:33.943363 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:33.943324    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:33.945350 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:33.945333    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:14:34.077948 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:34.077909    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:34.079281 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:34.079169    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:34.081327 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:34.081306    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:14:34.531876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:34.531835    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4fhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:14:34.532503 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:34.532468    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:14:35.511436 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:35.511399    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:35.575875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:35.575836    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-4fhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:14:35.576388 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:35.575896    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:14:36.061709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:36.051644    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:36.320759 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:36.320229    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:36.541369 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:36.541328    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:36.543248 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:36.543221    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:14:38.794639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:38.794604    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:39.295469 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:39.290157    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:39.552762 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:39.551876    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:40.804297 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:40.804272    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"
Oct 30 22:14:44.181712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:44.180896    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:49.646790 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:49.646753    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:50.696009 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:50.695976    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:51.000637 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:51.000557    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:54.106706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:54.106247    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:54.386880 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:54.386781    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:54.389625 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:54.389600    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"]
Oct 30 22:14:54.395984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:54.395966    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"
Oct 30 22:14:54.428559 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:54.428524    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf7t6\" (UniqueName: \"kubernetes.io/projected/b87b4e20-3e41-4364-a89e-f92ef042a0db-kube-api-access-kf7t6\") pod \"payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62\" (UID: \"b87b4e20-3e41-4364-a89e-f92ef042a0db\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"
Oct 30 22:14:54.428736 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:54.428597    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b87b4e20-3e41-4364-a89e-f92ef042a0db-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62\" (UID: \"b87b4e20-3e41-4364-a89e-f92ef042a0db\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"
Oct 30 22:14:54.442628 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:54.442601    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"]
Oct 30 22:14:54.486514 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:54.486478    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w5-9a96b4-dockercfg-4qpbx\""
Oct 30 22:14:54.507006 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:54.487448    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w5-9a96b4\""
Oct 30 22:14:54.578331 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:54.541375    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf7t6\" (UniqueName: \"kubernetes.io/projected/b87b4e20-3e41-4364-a89e-f92ef042a0db-kube-api-access-kf7t6\") pod \"payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62\" (UID: \"b87b4e20-3e41-4364-a89e-f92ef042a0db\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"
Oct 30 22:14:54.638761 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:54.588455    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b87b4e20-3e41-4364-a89e-f92ef042a0db-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62\" (UID: \"b87b4e20-3e41-4364-a89e-f92ef042a0db\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"
Oct 30 22:14:54.638761 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:54.589759    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b87b4e20-3e41-4364-a89e-f92ef042a0db-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62\" (UID: \"b87b4e20-3e41-4364-a89e-f92ef042a0db\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"
Oct 30 22:14:54.854711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:54.837831    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf7t6\" (UniqueName: \"kubernetes.io/projected/b87b4e20-3e41-4364-a89e-f92ef042a0db-kube-api-access-kf7t6\") pod \"payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62\" (UID: \"b87b4e20-3e41-4364-a89e-f92ef042a0db\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"
Oct 30 22:14:55.011712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:55.011001    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"
Oct 30 22:14:55.058656 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:55.058623    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:55.492563 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:55.492541    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"]
Oct 30 22:14:55.493395 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:14:55.493369    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87b4e20_3e41_4364_a89e_f92ef042a0db.slice/crio-5c0176392aa25c934799bdfe98f18cc693651712715e5b1f27e2c685cb6d9b6c WatchSource:0}: Error finding container 5c0176392aa25c934799bdfe98f18cc693651712715e5b1f27e2c685cb6d9b6c: Status 404 returned error can't find the container with id 5c0176392aa25c934799bdfe98f18cc693651712715e5b1f27e2c685cb6d9b6c
Oct 30 22:14:56.405632 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:56.405588    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62" event={"ID":"b87b4e20-3e41-4364-a89e-f92ef042a0db","Type":"ContainerStarted","Data":"045db80882fd633c86401413e442a677ea2529a0321397ece4c5cf9d90f4ac87"}
Oct 30 22:14:56.405843 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:56.405705    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"
Oct 30 22:14:56.405843 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:56.405730    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62" event={"ID":"b87b4e20-3e41-4364-a89e-f92ef042a0db","Type":"ContainerStarted","Data":"5c0176392aa25c934799bdfe98f18cc693651712715e5b1f27e2c685cb6d9b6c"}
Oct 30 22:14:56.520917 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:56.520836    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62" podStartSLOduration=2.520818306 podStartE2EDuration="2.520818306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:14:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:14:56.519716748 +0000 UTC m=+1834.568324443" watchObservedRunningTime="2026-10-30 22:14:56.520818306 +0000 UTC m=+1834.569426001"
Oct 30 22:14:59.873714 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:14:59.872708    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:02.160836 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:15:02.160758    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:15:04.860710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:04.858010    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:07.416566 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:07.416535    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"
Oct 30 22:15:09.815952 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:09.815911    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:10.087112 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:10.087022    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:15.289284 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:15.289199    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:19.472745 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:19.472666    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:20.247247 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:20.247211    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:20.662553 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:20.662517    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:23.398195 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:23.398150    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:25.173465 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:25.169443    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:29.687199 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:29.687159    4918 generic.go:356] "Generic (PLEG): container finished" podID="61b7bfc4-ac41-46b1-a7f7-952f8745a765" containerID="026e3031169cc60027f7f8c3265493189fca91b42fa53145156289cc6b0d87d3" exitCode=0
Oct 30 22:15:29.687627 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:29.687238    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz" event={"ID":"61b7bfc4-ac41-46b1-a7f7-952f8745a765","Type":"ContainerDied","Data":"026e3031169cc60027f7f8c3265493189fca91b42fa53145156289cc6b0d87d3"}
Oct 30 22:15:29.687765 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:29.687747    4918 scope.go:122] "RemoveContainer" containerID="026e3031169cc60027f7f8c3265493189fca91b42fa53145156289cc6b0d87d3"
Oct 30 22:15:29.689432 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:29.689400    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:15:29.689547 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:29.689491    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:15:29.689547 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:29.689542    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:15:30.029727 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:29.962520    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:30.241696 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:30.241551    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:30.623001 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:30.622970    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:30.710378 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:30.710344    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz" event={"ID":"61b7bfc4-ac41-46b1-a7f7-952f8745a765","Type":"ContainerStarted","Data":"4872f15aa9a19aa1061a6cd3ae58bfc10e6ff951ceab88ab8f7848f7d51216c6"}
Oct 30 22:15:31.247708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.247351    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:15:31.257707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.248793    4918 patch_prober.go:29] interesting pod/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 22:15:31.257707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.248845    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz" podUID="61b7bfc4-ac41-46b1-a7f7-952f8745a765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 22:15:31.589206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.588651    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"]
Oct 30 22:15:31.592351 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.592330    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.644297 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.644260    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w4-55beb8-openshift-default-dockercfg-gvtbb\""
Oct 30 22:15:31.664412 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.664373    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdvj4\" (UniqueName: \"kubernetes.io/projected/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-kube-api-access-tdvj4\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.664571 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.664487    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-workload-socket\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.664571 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.664551    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istiod-ca-cert\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.664647 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.664580    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-workload-certs\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.664997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.664972    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-token\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.665127 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.665016    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-envoy\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.665197 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.665169    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-credential-socket\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.665269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.665226    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-data\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.665337 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.665304    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-podinfo\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.704433 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.704393    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"]
Oct 30 22:15:31.795718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.774085    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-credential-socket\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.795718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.774224    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-data\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.795718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.774274    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-podinfo\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.795718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.774410    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdvj4\" (UniqueName: \"kubernetes.io/projected/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-kube-api-access-tdvj4\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.795718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.774512    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-workload-socket\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.795718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.774582    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istiod-ca-cert\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.795718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.774610    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-workload-certs\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.795718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.774912    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-token\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.795718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.774967    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-envoy\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.795718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.781178    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-credential-socket\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.795718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.781448    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-data\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.815646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.800225    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istiod-ca-cert\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.815646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.800841    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-workload-socket\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.815646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.814924    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:31.815646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.815095    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-workload-certs\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.844755 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.844069    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-envoy\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.844755 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.844565    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-podinfo\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:31.872936 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:31.872906    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdvj4\" (UniqueName: \"kubernetes.io/projected/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-kube-api-access-tdvj4\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:32.162748 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:32.157654    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-token\") pod \"e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") " pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:32.171713 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:32.168743    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:32.223892 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:32.223862    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:32.233076 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:15:32.233039    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:15:32.244021 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:32.243991    4918 patch_prober.go:29] interesting pod/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 22:15:32.244143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:32.244051    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz" podUID="61b7bfc4-ac41-46b1-a7f7-952f8745a765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 22:15:32.250258 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:32.250237    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:15:33.048416 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:33.042775    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"]
Oct 30 22:15:33.116478 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:33.110980    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:15:33.116478 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:33.111075    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:15:33.116478 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:33.111119    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:15:33.252123 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:33.252079    4918 patch_prober.go:29] interesting pod/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 22:15:33.252417 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:33.252388    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz" podUID="61b7bfc4-ac41-46b1-a7f7-952f8745a765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 22:15:33.831030 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:33.830991    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj" event={"ID":"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a","Type":"ContainerStarted","Data":"52225e022e7e6f029c7e29b23ea35a12b30bac220b8f82bfdf277819e3ccacae"}
Oct 30 22:15:33.831348 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:33.831054    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj" event={"ID":"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a","Type":"ContainerStarted","Data":"bc009595747c9f2e7965b6bd3db9cdcb10856942d646e606226890632d80afa5"}
Oct 30 22:15:34.049795 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:34.049726    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj" podStartSLOduration=3.049703501 podStartE2EDuration="3.049703501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:33.999162254 +0000 UTC m=+1872.047769950" watchObservedRunningTime="2026-10-30 22:15:34.049703501 +0000 UTC m=+1872.098311197"
Oct 30 22:15:34.244173 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:34.243269    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:34.258274 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:34.258240    4918 patch_prober.go:29] interesting pod/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 22:15:34.259070 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:34.259038    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz" podUID="61b7bfc4-ac41-46b1-a7f7-952f8745a765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 22:15:34.275462 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:34.274988    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:34.837904 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:34.837868    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:34.838936 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:34.838912    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:15:35.247198 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:35.247126    4918 patch_prober.go:29] interesting pod/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 22:15:35.247891 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:35.247859    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz" podUID="61b7bfc4-ac41-46b1-a7f7-952f8745a765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 22:15:35.332886 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:35.332853    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:36.242618 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:36.242584    4918 patch_prober.go:29] interesting pod/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 22:15:36.242825 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:36.242642    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz" podUID="61b7bfc4-ac41-46b1-a7f7-952f8745a765" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 22:15:36.991927 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:36.991896    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:37.247604 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:37.247536    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:15:37.248664 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:37.248644    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:15:37.261240 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:37.261214    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:40.321143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:40.321106    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:40.641710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:40.641298    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:40.667340 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:40.667302    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"]
Oct 30 22:15:40.755240 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:40.755207    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"]
Oct 30 22:15:40.755645 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:40.755574    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"
Oct 30 22:15:40.882042 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:40.881914    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/966cb5c4-9d3a-410f-bd2c-87cf0927bf1f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn\" (UID: \"966cb5c4-9d3a-410f-bd2c-87cf0927bf1f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"
Oct 30 22:15:40.942755 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:40.931580    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jn5c\" (UniqueName: \"kubernetes.io/projected/966cb5c4-9d3a-410f-bd2c-87cf0927bf1f-kube-api-access-7jn5c\") pod \"payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn\" (UID: \"966cb5c4-9d3a-410f-bd2c-87cf0927bf1f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"
Oct 30 22:15:40.942755 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:40.937238    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w4-55beb8\""
Oct 30 22:15:40.942755 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:40.940826    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w4-55beb8-dockercfg-8jp8z\""
Oct 30 22:15:41.001558 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:41.001523    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:41.071717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:41.071624    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/966cb5c4-9d3a-410f-bd2c-87cf0927bf1f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn\" (UID: \"966cb5c4-9d3a-410f-bd2c-87cf0927bf1f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"
Oct 30 22:15:41.075798 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:41.070744    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/966cb5c4-9d3a-410f-bd2c-87cf0927bf1f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn\" (UID: \"966cb5c4-9d3a-410f-bd2c-87cf0927bf1f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"
Oct 30 22:15:41.110531 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:41.110487    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jn5c\" (UniqueName: \"kubernetes.io/projected/966cb5c4-9d3a-410f-bd2c-87cf0927bf1f-kube-api-access-7jn5c\") pod \"payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn\" (UID: \"966cb5c4-9d3a-410f-bd2c-87cf0927bf1f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"
Oct 30 22:15:41.230551 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:41.230474    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jn5c\" (UniqueName: \"kubernetes.io/projected/966cb5c4-9d3a-410f-bd2c-87cf0927bf1f-kube-api-access-7jn5c\") pod \"payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn\" (UID: \"966cb5c4-9d3a-410f-bd2c-87cf0927bf1f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"
Oct 30 22:15:41.388848 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:41.388814    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:41.441185 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:41.441157    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"
Oct 30 22:15:41.844602 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:41.844564    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"]
Oct 30 22:15:41.845252 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:15:41.845218    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod966cb5c4_9d3a_410f_bd2c_87cf0927bf1f.slice/crio-229f049e02859e0c07b35434bc37f2b92f198b5f1dbeae76d57c4f45cb7416e6 WatchSource:0}: Error finding container 229f049e02859e0c07b35434bc37f2b92f198b5f1dbeae76d57c4f45cb7416e6: Status 404 returned error can't find the container with id 229f049e02859e0c07b35434bc37f2b92f198b5f1dbeae76d57c4f45cb7416e6
Oct 30 22:15:42.081083 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:42.081047    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn" event={"ID":"966cb5c4-9d3a-410f-bd2c-87cf0927bf1f","Type":"ContainerStarted","Data":"dc9eafc69ed8878c7d0c770c32da8c145ab4431949ef6bcea7e78f8d02a9bf38"}
Oct 30 22:15:42.081249 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:42.081200    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"
Oct 30 22:15:42.081249 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:42.081226    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn" event={"ID":"966cb5c4-9d3a-410f-bd2c-87cf0927bf1f","Type":"ContainerStarted","Data":"229f049e02859e0c07b35434bc37f2b92f198b5f1dbeae76d57c4f45cb7416e6"}
Oct 30 22:15:42.196973 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:42.196924    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn" podStartSLOduration=2.196910718 podStartE2EDuration="2.196910718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:42.195329884 +0000 UTC m=+1880.243937580" watchObservedRunningTime="2026-10-30 22:15:42.196910718 +0000 UTC m=+1880.245518413"
Oct 30 22:15:42.248823 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:42.248792    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"]
Oct 30 22:15:42.298350 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:42.298317    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"]
Oct 30 22:15:42.305458 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:42.305431    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:42.702929 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:42.702896    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:42.963046 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:42.962963    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:45.383590 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:45.383555    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:45.636207 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:45.636120    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:46.668162 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:46.667836    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:47.254325 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:47.254273    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z" podUID="0d28d1af-b09f-4b11-8590-516816b0d809" containerName="payload-processing" containerID="cri-o://6fad0c547bf80ada2a53a01df0af9db911c3f690dd2edbc7c81eea37c5e7c244" gracePeriod=25
Oct 30 22:15:47.301332 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:47.301291    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz" podUID="6f720a6b-f1b3-4738-9e50-b9c6f5c8e300" containerName="payload-pre-processing" containerID="cri-o://3529878bc032364ce7d0b4b28cb2cb44ef4b6bd78baf8092775b34832f2f1551" gracePeriod=25
Oct 30 22:15:47.470891 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:47.470534    4918 generic.go:356] "Generic (PLEG): container finished" podID="0d28d1af-b09f-4b11-8590-516816b0d809" containerID="6fad0c547bf80ada2a53a01df0af9db911c3f690dd2edbc7c81eea37c5e7c244" exitCode=0
Oct 30 22:15:47.470891 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:47.470816    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z" event={"ID":"0d28d1af-b09f-4b11-8590-516816b0d809","Type":"ContainerDied","Data":"6fad0c547bf80ada2a53a01df0af9db911c3f690dd2edbc7c81eea37c5e7c244"}
Oct 30 22:15:48.133122 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.132936    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:48.256888 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.232574    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"
Oct 30 22:15:48.487720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.484269    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f720a6b-f1b3-4738-9e50-b9c6f5c8e300-kube-api-access-nl987\" (UniqueName: \"kubernetes.io/projected/6f720a6b-f1b3-4738-9e50-b9c6f5c8e300-kube-api-access-nl987\") pod \"6f720a6b-f1b3-4738-9e50-b9c6f5c8e300\" (UID: \"6f720a6b-f1b3-4738-9e50-b9c6f5c8e300\") "
Oct 30 22:15:48.526772 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.526730    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6f720a6b-f1b3-4738-9e50-b9c6f5c8e300-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f720a6b-f1b3-4738-9e50-b9c6f5c8e300-plugins-config-volume\") pod \"6f720a6b-f1b3-4738-9e50-b9c6f5c8e300\" (UID: \"6f720a6b-f1b3-4738-9e50-b9c6f5c8e300\") "
Oct 30 22:15:48.530028 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.529903    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f720a6b-f1b3-4738-9e50-b9c6f5c8e300-plugins-config-volume" pod "6f720a6b-f1b3-4738-9e50-b9c6f5c8e300" (UID: "6f720a6b-f1b3-4738-9e50-b9c6f5c8e300"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:48.673737 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.658288    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f720a6b-f1b3-4738-9e50-b9c6f5c8e300-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:48.673737 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.671983    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f720a6b-f1b3-4738-9e50-b9c6f5c8e300-kube-api-access-nl987" pod "6f720a6b-f1b3-4738-9e50-b9c6f5c8e300" (UID: "6f720a6b-f1b3-4738-9e50-b9c6f5c8e300"). InnerVolumeSpecName "kube-api-access-nl987". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:48.714916 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.694049    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z" event={"ID":"0d28d1af-b09f-4b11-8590-516816b0d809","Type":"ContainerDied","Data":"868d91ccf25bba454acc2d99681f738d4a7e1887f3d13f0a3ac24b4b1c35d31c"}
Oct 30 22:15:48.714916 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.694108    4918 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="868d91ccf25bba454acc2d99681f738d4a7e1887f3d13f0a3ac24b4b1c35d31c"
Oct 30 22:15:48.714916 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.696741    4918 generic.go:356] "Generic (PLEG): container finished" podID="6f720a6b-f1b3-4738-9e50-b9c6f5c8e300" containerID="3529878bc032364ce7d0b4b28cb2cb44ef4b6bd78baf8092775b34832f2f1551" exitCode=0
Oct 30 22:15:48.714916 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.696874    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz" event={"ID":"6f720a6b-f1b3-4738-9e50-b9c6f5c8e300","Type":"ContainerDied","Data":"3529878bc032364ce7d0b4b28cb2cb44ef4b6bd78baf8092775b34832f2f1551"}
Oct 30 22:15:48.714916 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.696915    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz" event={"ID":"6f720a6b-f1b3-4738-9e50-b9c6f5c8e300","Type":"ContainerDied","Data":"69426f28b4228be21f3b54616edc142c826543582cf8c5424b80a8042be372c4"}
Oct 30 22:15:48.714916 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.696945    4918 scope.go:122] "RemoveContainer" containerID="3529878bc032364ce7d0b4b28cb2cb44ef4b6bd78baf8092775b34832f2f1551"
Oct 30 22:15:48.714916 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.697108    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"
Oct 30 22:15:48.758058 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.757945    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"
Oct 30 22:15:48.760443 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.760412    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl987\" (UniqueName: \"kubernetes.io/projected/6f720a6b-f1b3-4738-9e50-b9c6f5c8e300-kube-api-access-nl987\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:48.785191 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.785150    4918 scope.go:122] "RemoveContainer" containerID="3529878bc032364ce7d0b4b28cb2cb44ef4b6bd78baf8092775b34832f2f1551"
Oct 30 22:15:48.785850 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:15:48.785781    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3529878bc032364ce7d0b4b28cb2cb44ef4b6bd78baf8092775b34832f2f1551\": container with ID starting with 3529878bc032364ce7d0b4b28cb2cb44ef4b6bd78baf8092775b34832f2f1551 not found: ID does not exist" containerID="3529878bc032364ce7d0b4b28cb2cb44ef4b6bd78baf8092775b34832f2f1551"
Oct 30 22:15:48.785850 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.785821    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3529878bc032364ce7d0b4b28cb2cb44ef4b6bd78baf8092775b34832f2f1551"} err="failed to get container status \"3529878bc032364ce7d0b4b28cb2cb44ef4b6bd78baf8092775b34832f2f1551\": rpc error: code = NotFound desc = could not find container \"3529878bc032364ce7d0b4b28cb2cb44ef4b6bd78baf8092775b34832f2f1551\": container with ID starting with 3529878bc032364ce7d0b4b28cb2cb44ef4b6bd78baf8092775b34832f2f1551 not found: ID does not exist"
Oct 30 22:15:48.862039 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.862001    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d28d1af-b09f-4b11-8590-516816b0d809-kube-api-access-rc5kk\" (UniqueName: \"kubernetes.io/projected/0d28d1af-b09f-4b11-8590-516816b0d809-kube-api-access-rc5kk\") pod \"0d28d1af-b09f-4b11-8590-516816b0d809\" (UID: \"0d28d1af-b09f-4b11-8590-516816b0d809\") "
Oct 30 22:15:48.862241 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.862173    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0d28d1af-b09f-4b11-8590-516816b0d809-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d28d1af-b09f-4b11-8590-516816b0d809-plugins-config-volume\") pod \"0d28d1af-b09f-4b11-8590-516816b0d809\" (UID: \"0d28d1af-b09f-4b11-8590-516816b0d809\") "
Oct 30 22:15:48.862547 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.862523    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d28d1af-b09f-4b11-8590-516816b0d809-plugins-config-volume" pod "0d28d1af-b09f-4b11-8590-516816b0d809" (UID: "0d28d1af-b09f-4b11-8590-516816b0d809"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:48.862841 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.862823    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d28d1af-b09f-4b11-8590-516816b0d809-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:48.864553 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.864523    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d28d1af-b09f-4b11-8590-516816b0d809-kube-api-access-rc5kk" pod "0d28d1af-b09f-4b11-8590-516816b0d809" (UID: "0d28d1af-b09f-4b11-8590-516816b0d809"). InnerVolumeSpecName "kube-api-access-rc5kk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:48.964073 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:48.963983    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc5kk\" (UniqueName: \"kubernetes.io/projected/0d28d1af-b09f-4b11-8590-516816b0d809-kube-api-access-rc5kk\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:49.034823 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:49.034788    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"]
Oct 30 22:15:49.038811 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:49.038782    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d7b3c557-7fd55d4bbc-ltcgz"]
Oct 30 22:15:49.723014 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:49.722938    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"
Oct 30 22:15:49.890817 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:49.890787    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"]
Oct 30 22:15:49.939610 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:49.939576    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d7b3c557-77c8b6584c-kcw4z"]
Oct 30 22:15:50.076300 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:50.076227    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0d28d1af-b09f-4b11-8590-516816b0d809" path="/var/lib/kubelet/pods/0d28d1af-b09f-4b11-8590-516816b0d809/volumes"
Oct 30 22:15:50.076744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:50.076729    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f720a6b-f1b3-4738-9e50-b9c6f5c8e300" path="/var/lib/kubelet/pods/6f720a6b-f1b3-4738-9e50-b9c6f5c8e300/volumes"
Oct 30 22:15:50.591496 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:50.591463    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:50.635922 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:50.635892    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"]
Oct 30 22:15:50.636391 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:50.636357    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy" containerID="cri-o://5c17ed72dfa9e39ff11cda368357499448a55c8deb8efbd185bc9c5bb59ca476" gracePeriod=30
Oct 30 22:15:50.671890 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:50.671856    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"]
Oct 30 22:15:50.672132 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:50.672106    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6" podUID="7fd08bce-f53b-442f-a87d-767757897c86" containerName="istio-proxy" containerID="cri-o://5fb15b36ae32d48b1408913a75c1bd430b2edac19b299137c7f6653d6057ea21" gracePeriod=30
Oct 30 22:15:50.675883 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:50.675856    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"]
Oct 30 22:15:50.679957 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:50.679935    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"]
Oct 30 22:15:50.680128 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:50.680110    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng" podUID="0856582a-2e5e-4d49-9f58-9cf10c008b41" containerName="istio-proxy" containerID="cri-o://841af1963f4b123e11328c8c6a8543281e350881d11d56ab36963e8a51a39ed2" gracePeriod=30
Oct 30 22:15:50.760469 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:50.760430    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy" containerID="cri-o://e6c2aa2f0dfc2016db533c75cff81fe49c5c49caf61a0badb3f73ebfe600db60" gracePeriod=30
Oct 30 22:15:53.091944 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:53.091916    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"
Oct 30 22:15:55.499714 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:55.498470    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:55.800003 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:55.799956    4918 generic.go:356] "Generic (PLEG): container finished" podID="7fd08bce-f53b-442f-a87d-767757897c86" containerID="5fb15b36ae32d48b1408913a75c1bd430b2edac19b299137c7f6653d6057ea21" exitCode=0
Oct 30 22:15:55.800153 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:55.800015    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6" event={"ID":"7fd08bce-f53b-442f-a87d-767757897c86","Type":"ContainerDied","Data":"5fb15b36ae32d48b1408913a75c1bd430b2edac19b299137c7f6653d6057ea21"}
Oct 30 22:15:55.802223 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:55.802201    4918 generic.go:356] "Generic (PLEG): container finished" podID="0856582a-2e5e-4d49-9f58-9cf10c008b41" containerID="841af1963f4b123e11328c8c6a8543281e350881d11d56ab36963e8a51a39ed2" exitCode=0
Oct 30 22:15:55.802339 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:55.802275    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng" event={"ID":"0856582a-2e5e-4d49-9f58-9cf10c008b41","Type":"ContainerDied","Data":"841af1963f4b123e11328c8c6a8543281e350881d11d56ab36963e8a51a39ed2"}
Oct 30 22:15:55.802339 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:55.802330    4918 scope.go:122] "RemoveContainer" containerID="939f6a3775ea4112441e303cbbc1fb49f801887af07eb4ba3da9e8ec6bac83f0"
Oct 30 22:15:55.804341 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:55.804320    4918 generic.go:356] "Generic (PLEG): container finished" podID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerID="5c17ed72dfa9e39ff11cda368357499448a55c8deb8efbd185bc9c5bb59ca476" exitCode=0
Oct 30 22:15:55.804430 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:55.804351    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" event={"ID":"8cf9fa16-1134-4be4-a24a-97e9e6b2d567","Type":"ContainerDied","Data":"5c17ed72dfa9e39ff11cda368357499448a55c8deb8efbd185bc9c5bb59ca476"}
Oct 30 22:15:56.190932 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.190425    4918 patch_prober.go:29] interesting pod/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Oct 30 22:15:56.190932 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.190518    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6" podUID="7fd08bce-f53b-442f-a87d-767757897c86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Oct 30 22:15:56.290579 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.290546    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:15:56.347432 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.347316    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 22:15:56.355342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.355313    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-envoy\") pod \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") "
Oct 30 22:15:56.356414 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.356386    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-data\") pod \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") "
Oct 30 22:15:56.356593 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.356574    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-token\" (UniqueName: \"kubernetes.io/projected/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-token\") pod \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") "
Oct 30 22:15:56.356867 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.356849    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istiod-ca-cert\") pod \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") "
Oct 30 22:15:56.357009 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.356991    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-podinfo\") pod \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") "
Oct 30 22:15:56.357125 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.357109    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-credential-socket\") pod \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") "
Oct 30 22:15:56.357251 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.357235    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-kube-api-access-p9h4b\" (UniqueName: \"kubernetes.io/projected/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-kube-api-access-p9h4b\") pod \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") "
Oct 30 22:15:56.357546 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.357527    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-workload-socket\") pod \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") "
Oct 30 22:15:56.357718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.357700    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-workload-certs\") pod \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\" (UID: \"8cf9fa16-1134-4be4-a24a-97e9e6b2d567\") "
Oct 30 22:15:56.359191 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.358271    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-data" pod "8cf9fa16-1134-4be4-a24a-97e9e6b2d567" (UID: "8cf9fa16-1134-4be4-a24a-97e9e6b2d567"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.359191 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.358506    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-workload-certs" pod "8cf9fa16-1134-4be4-a24a-97e9e6b2d567" (UID: "8cf9fa16-1134-4be4-a24a-97e9e6b2d567"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.359191 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.358829    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.359191 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.358851    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.359191 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.358827    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istiod-ca-cert" pod "8cf9fa16-1134-4be4-a24a-97e9e6b2d567" (UID: "8cf9fa16-1134-4be4-a24a-97e9e6b2d567"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:56.359191 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.359129    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-workload-socket" pod "8cf9fa16-1134-4be4-a24a-97e9e6b2d567" (UID: "8cf9fa16-1134-4be4-a24a-97e9e6b2d567"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.359762 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.359304    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-credential-socket" pod "8cf9fa16-1134-4be4-a24a-97e9e6b2d567" (UID: "8cf9fa16-1134-4be4-a24a-97e9e6b2d567"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.367106 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.367076    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-podinfo" pod "8cf9fa16-1134-4be4-a24a-97e9e6b2d567" (UID: "8cf9fa16-1134-4be4-a24a-97e9e6b2d567"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:15:56.389704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.378300    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-token" pod "8cf9fa16-1134-4be4-a24a-97e9e6b2d567" (UID: "8cf9fa16-1134-4be4-a24a-97e9e6b2d567"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:56.389704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.379307    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-envoy" pod "8cf9fa16-1134-4be4-a24a-97e9e6b2d567" (UID: "8cf9fa16-1134-4be4-a24a-97e9e6b2d567"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.396744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.389977    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-kube-api-access-p9h4b" pod "8cf9fa16-1134-4be4-a24a-97e9e6b2d567" (UID: "8cf9fa16-1134-4be4-a24a-97e9e6b2d567"). InnerVolumeSpecName "kube-api-access-p9h4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:56.459730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.459646    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:15:56.459935 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.459911    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-envoy\") pod \"0856582a-2e5e-4d49-9f58-9cf10c008b41\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") "
Oct 30 22:15:56.460020 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.460002    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0856582a-2e5e-4d49-9f58-9cf10c008b41-kube-api-access-c2srr\" (UniqueName: \"kubernetes.io/projected/0856582a-2e5e-4d49-9f58-9cf10c008b41-kube-api-access-c2srr\") pod \"0856582a-2e5e-4d49-9f58-9cf10c008b41\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") "
Oct 30 22:15:56.460077 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.460051    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-workload-socket\") pod \"0856582a-2e5e-4d49-9f58-9cf10c008b41\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") "
Oct 30 22:15:56.460140 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.460100    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-podinfo\") pod \"0856582a-2e5e-4d49-9f58-9cf10c008b41\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") "
Oct 30 22:15:56.460140 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.460128    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-data\") pod \"0856582a-2e5e-4d49-9f58-9cf10c008b41\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") "
Oct 30 22:15:56.460252 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.460163    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-token\" (UniqueName: \"kubernetes.io/projected/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-token\") pod \"0856582a-2e5e-4d49-9f58-9cf10c008b41\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") "
Oct 30 22:15:56.460309 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.460269    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-credential-socket\") pod \"0856582a-2e5e-4d49-9f58-9cf10c008b41\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") "
Oct 30 22:15:56.461182 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.460361    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0856582a-2e5e-4d49-9f58-9cf10c008b41-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0856582a-2e5e-4d49-9f58-9cf10c008b41-istiod-ca-cert\") pod \"0856582a-2e5e-4d49-9f58-9cf10c008b41\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") "
Oct 30 22:15:56.461182 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.460389    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-workload-socket" pod "0856582a-2e5e-4d49-9f58-9cf10c008b41" (UID: "0856582a-2e5e-4d49-9f58-9cf10c008b41"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.461182 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.460564    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-workload-certs\") pod \"0856582a-2e5e-4d49-9f58-9cf10c008b41\" (UID: \"0856582a-2e5e-4d49-9f58-9cf10c008b41\") "
Oct 30 22:15:56.461672 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.461536    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.461672 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.461565    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.461672 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.461580    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.461672 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.461593    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.461672 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.461608    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.461672 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.461623    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9h4b\" (UniqueName: \"kubernetes.io/projected/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-kube-api-access-p9h4b\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.461672 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.461637    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.461672 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.461650    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cf9fa16-1134-4be4-a24a-97e9e6b2d567-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.461672 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.461541    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:15:56.462192 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.460561    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-data" pod "0856582a-2e5e-4d49-9f58-9cf10c008b41" (UID: "0856582a-2e5e-4d49-9f58-9cf10c008b41"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.462192 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.460777    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-credential-socket" pod "0856582a-2e5e-4d49-9f58-9cf10c008b41" (UID: "0856582a-2e5e-4d49-9f58-9cf10c008b41"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.462664 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.462626    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0856582a-2e5e-4d49-9f58-9cf10c008b41-istiod-ca-cert" pod "0856582a-2e5e-4d49-9f58-9cf10c008b41" (UID: "0856582a-2e5e-4d49-9f58-9cf10c008b41"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:56.462995 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.462974    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-workload-certs" pod "0856582a-2e5e-4d49-9f58-9cf10c008b41" (UID: "0856582a-2e5e-4d49-9f58-9cf10c008b41"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.464807 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.464785    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-token" pod "0856582a-2e5e-4d49-9f58-9cf10c008b41" (UID: "0856582a-2e5e-4d49-9f58-9cf10c008b41"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:56.467895 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.467866    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0856582a-2e5e-4d49-9f58-9cf10c008b41-kube-api-access-c2srr" pod "0856582a-2e5e-4d49-9f58-9cf10c008b41" (UID: "0856582a-2e5e-4d49-9f58-9cf10c008b41"). InnerVolumeSpecName "kube-api-access-c2srr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:56.467895 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.467873    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-envoy" pod "0856582a-2e5e-4d49-9f58-9cf10c008b41" (UID: "0856582a-2e5e-4d49-9f58-9cf10c008b41"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.469114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.469088    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-podinfo" pod "0856582a-2e5e-4d49-9f58-9cf10c008b41" (UID: "0856582a-2e5e-4d49-9f58-9cf10c008b41"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:15:56.562389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.562324    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-workload-socket\") pod \"7fd08bce-f53b-442f-a87d-767757897c86\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") "
Oct 30 22:15:56.562833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.562600    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-workload-socket" pod "7fd08bce-f53b-442f-a87d-767757897c86" (UID: "7fd08bce-f53b-442f-a87d-767757897c86"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.562833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.562720    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-podinfo\") pod \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") "
Oct 30 22:15:56.563159 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.563139    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7fd08bce-f53b-442f-a87d-767757897c86-kube-api-access-279rv\" (UniqueName: \"kubernetes.io/projected/7fd08bce-f53b-442f-a87d-767757897c86-kube-api-access-279rv\") pod \"7fd08bce-f53b-442f-a87d-767757897c86\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") "
Oct 30 22:15:56.563260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.563228    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-credential-socket\") pod \"7fd08bce-f53b-442f-a87d-767757897c86\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") "
Oct 30 22:15:56.563323 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.563272    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-workload-socket\") pod \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") "
Oct 30 22:15:56.563500 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.563369    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-istio-data\") pod \"7fd08bce-f53b-442f-a87d-767757897c86\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") "
Oct 30 22:15:56.563500 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.563413    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7fd08bce-f53b-442f-a87d-767757897c86-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd08bce-f53b-442f-a87d-767757897c86-istiod-ca-cert\") pod \"7fd08bce-f53b-442f-a87d-767757897c86\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") "
Oct 30 22:15:56.563500 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.563463    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-envoy\") pod \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") "
Oct 30 22:15:56.563717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.563547    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-workload-certs\") pod \"7fd08bce-f53b-442f-a87d-767757897c86\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") "
Oct 30 22:15:56.563717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.563562    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-credential-socket" pod "7fd08bce-f53b-442f-a87d-767757897c86" (UID: "7fd08bce-f53b-442f-a87d-767757897c86"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.563717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.563575    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-credential-socket\") pod \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") "
Oct 30 22:15:56.563717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.563633    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-istio-envoy\") pod \"7fd08bce-f53b-442f-a87d-767757897c86\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") "
Oct 30 22:15:56.563956 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.563832    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-credential-socket" pod "a0d3af2f-d2e7-4368-86c1-0b99005186e8" (UID: "a0d3af2f-d2e7-4368-86c1-0b99005186e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.563956 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.563831    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-workload-certs\") pod \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") "
Oct 30 22:15:56.563956 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.563876    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-data\") pod \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") "
Oct 30 22:15:56.564111 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.563958    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7fd08bce-f53b-442f-a87d-767757897c86-istio-token\" (UniqueName: \"kubernetes.io/projected/7fd08bce-f53b-442f-a87d-767757897c86-istio-token\") pod \"7fd08bce-f53b-442f-a87d-767757897c86\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") "
Oct 30 22:15:56.564111 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.564000    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-workload-socket" pod "a0d3af2f-d2e7-4368-86c1-0b99005186e8" (UID: "a0d3af2f-d2e7-4368-86c1-0b99005186e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.564111 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.564043    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7fd08bce-f53b-442f-a87d-767757897c86-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd08bce-f53b-442f-a87d-767757897c86-istio-podinfo\") pod \"7fd08bce-f53b-442f-a87d-767757897c86\" (UID: \"7fd08bce-f53b-442f-a87d-767757897c86\") "
Oct 30 22:15:56.564111 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.564077    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0d3af2f-d2e7-4368-86c1-0b99005186e8-kube-api-access-djfmc\" (UniqueName: \"kubernetes.io/projected/a0d3af2f-d2e7-4368-86c1-0b99005186e8-kube-api-access-djfmc\") pod \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") "
Oct 30 22:15:56.564324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.564141    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istiod-ca-cert\") pod \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") "
Oct 30 22:15:56.564324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.564157    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-istio-data" pod "7fd08bce-f53b-442f-a87d-767757897c86" (UID: "7fd08bce-f53b-442f-a87d-767757897c86"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.564324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.564227    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-token\" (UniqueName: \"kubernetes.io/projected/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-token\") pod \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\" (UID: \"a0d3af2f-d2e7-4368-86c1-0b99005186e8\") "
Oct 30 22:15:56.564477 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.564449    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fd08bce-f53b-442f-a87d-767757897c86-istiod-ca-cert" pod "7fd08bce-f53b-442f-a87d-767757897c86" (UID: "7fd08bce-f53b-442f-a87d-767757897c86"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:56.565347 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.565321    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.565536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.565349    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd08bce-f53b-442f-a87d-767757897c86-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.565536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.565365    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.565536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.565380    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.565536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.565394    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2srr\" (UniqueName: \"kubernetes.io/projected/0856582a-2e5e-4d49-9f58-9cf10c008b41-kube-api-access-c2srr\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.565536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.565412    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.565536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.565428    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.565536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.565444    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0856582a-2e5e-4d49-9f58-9cf10c008b41-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.565536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.565457    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.565536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.565470    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0856582a-2e5e-4d49-9f58-9cf10c008b41-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.565536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.565484    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.565536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.565498    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0856582a-2e5e-4d49-9f58-9cf10c008b41-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.565536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.565517    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.565536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.565531    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.565536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.565390    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-podinfo" pod "a0d3af2f-d2e7-4368-86c1-0b99005186e8" (UID: "a0d3af2f-d2e7-4368-86c1-0b99005186e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:15:56.566763 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.565975    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istiod-ca-cert" pod "a0d3af2f-d2e7-4368-86c1-0b99005186e8" (UID: "a0d3af2f-d2e7-4368-86c1-0b99005186e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:56.566825 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.566781    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-workload-certs" pod "a0d3af2f-d2e7-4368-86c1-0b99005186e8" (UID: "a0d3af2f-d2e7-4368-86c1-0b99005186e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.567260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.567232    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-workload-certs" pod "7fd08bce-f53b-442f-a87d-767757897c86" (UID: "7fd08bce-f53b-442f-a87d-767757897c86"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.567443 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.567420    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-data" pod "a0d3af2f-d2e7-4368-86c1-0b99005186e8" (UID: "a0d3af2f-d2e7-4368-86c1-0b99005186e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.568186 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.568157    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0d3af2f-d2e7-4368-86c1-0b99005186e8-kube-api-access-djfmc" pod "a0d3af2f-d2e7-4368-86c1-0b99005186e8" (UID: "a0d3af2f-d2e7-4368-86c1-0b99005186e8"). InnerVolumeSpecName "kube-api-access-djfmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:56.569703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.569632    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-token" pod "a0d3af2f-d2e7-4368-86c1-0b99005186e8" (UID: "a0d3af2f-d2e7-4368-86c1-0b99005186e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:56.569838 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.569730    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fd08bce-f53b-442f-a87d-767757897c86-istio-token" pod "7fd08bce-f53b-442f-a87d-767757897c86" (UID: "7fd08bce-f53b-442f-a87d-767757897c86"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:56.570199 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.570164    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fd08bce-f53b-442f-a87d-767757897c86-kube-api-access-279rv" pod "7fd08bce-f53b-442f-a87d-767757897c86" (UID: "7fd08bce-f53b-442f-a87d-767757897c86"). InnerVolumeSpecName "kube-api-access-279rv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:56.570815 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.570789    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-envoy" pod "a0d3af2f-d2e7-4368-86c1-0b99005186e8" (UID: "a0d3af2f-d2e7-4368-86c1-0b99005186e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.571152 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.571127    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-istio-envoy" pod "7fd08bce-f53b-442f-a87d-767757897c86" (UID: "7fd08bce-f53b-442f-a87d-767757897c86"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:56.571591 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.571530    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7fd08bce-f53b-442f-a87d-767757897c86-istio-podinfo" pod "7fd08bce-f53b-442f-a87d-767757897c86" (UID: "7fd08bce-f53b-442f-a87d-767757897c86"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:15:56.669190 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.668894    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.669190 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.668978    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-279rv\" (UniqueName: \"kubernetes.io/projected/7fd08bce-f53b-442f-a87d-767757897c86-kube-api-access-279rv\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.669190 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.668998    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.669190 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.669011    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.669190 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.669149    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd08bce-f53b-442f-a87d-767757897c86-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.669190 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.669168    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.669190 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.669213    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.669190 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.669227    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd08bce-f53b-442f-a87d-767757897c86-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.670728 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.669240    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd08bce-f53b-442f-a87d-767757897c86-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.670728 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.669266    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djfmc\" (UniqueName: \"kubernetes.io/projected/a0d3af2f-d2e7-4368-86c1-0b99005186e8-kube-api-access-djfmc\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.670728 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.669278    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.670728 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.669291    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d3af2f-d2e7-4368-86c1-0b99005186e8-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:56.827024 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.818228    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc" event={"ID":"8cf9fa16-1134-4be4-a24a-97e9e6b2d567","Type":"ContainerDied","Data":"5c8848d7934a11c3e7ada680c6ca72e8bdedeaf6c8fc1b17d009c69647bc7dbe"}
Oct 30 22:15:56.827024 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.818329    4918 scope.go:122] "RemoveContainer" containerID="5c17ed72dfa9e39ff11cda368357499448a55c8deb8efbd185bc9c5bb59ca476"
Oct 30 22:15:56.827024 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.818520    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"
Oct 30 22:15:56.827024 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.823986    4918 generic.go:356] "Generic (PLEG): container finished" podID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerID="e6c2aa2f0dfc2016db533c75cff81fe49c5c49caf61a0badb3f73ebfe600db60" exitCode=0
Oct 30 22:15:56.827024 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.824088    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" event={"ID":"a0d3af2f-d2e7-4368-86c1-0b99005186e8","Type":"ContainerDied","Data":"e6c2aa2f0dfc2016db533c75cff81fe49c5c49caf61a0badb3f73ebfe600db60"}
Oct 30 22:15:56.827024 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.824147    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths" event={"ID":"a0d3af2f-d2e7-4368-86c1-0b99005186e8","Type":"ContainerDied","Data":"2ce4a270332cba2a69e69c60a1d095e230a0d8923e113a28e65758f77f4bae9d"}
Oct 30 22:15:56.827024 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.824214    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"
Oct 30 22:15:56.846099 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.846072    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"
Oct 30 22:15:56.846217 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.846169    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6" event={"ID":"7fd08bce-f53b-442f-a87d-767757897c86","Type":"ContainerDied","Data":"45839cc39c4b3006d4d71287be154c2b62931981f892cd1dc1a96f443ec67ed6"}
Oct 30 22:15:56.847038 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.845276    4918 scope.go:122] "RemoveContainer" containerID="e6c2aa2f0dfc2016db533c75cff81fe49c5c49caf61a0badb3f73ebfe600db60"
Oct 30 22:15:56.848851 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.848815    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng" event={"ID":"0856582a-2e5e-4d49-9f58-9cf10c008b41","Type":"ContainerDied","Data":"5c0399bbc353349a4168f368a8782924f19bce32a57c8658e48326b3ec65e88a"}
Oct 30 22:15:56.848986 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.848967    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"
Oct 30 22:15:56.873113 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.873053    4918 scope.go:122] "RemoveContainer" containerID="e6c2aa2f0dfc2016db533c75cff81fe49c5c49caf61a0badb3f73ebfe600db60"
Oct 30 22:15:56.873408 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:15:56.873379    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6c2aa2f0dfc2016db533c75cff81fe49c5c49caf61a0badb3f73ebfe600db60\": container with ID starting with e6c2aa2f0dfc2016db533c75cff81fe49c5c49caf61a0badb3f73ebfe600db60 not found: ID does not exist" containerID="e6c2aa2f0dfc2016db533c75cff81fe49c5c49caf61a0badb3f73ebfe600db60"
Oct 30 22:15:56.873510 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.873414    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6c2aa2f0dfc2016db533c75cff81fe49c5c49caf61a0badb3f73ebfe600db60"} err="failed to get container status \"e6c2aa2f0dfc2016db533c75cff81fe49c5c49caf61a0badb3f73ebfe600db60\": rpc error: code = NotFound desc = could not find container \"e6c2aa2f0dfc2016db533c75cff81fe49c5c49caf61a0badb3f73ebfe600db60\": container with ID starting with e6c2aa2f0dfc2016db533c75cff81fe49c5c49caf61a0badb3f73ebfe600db60 not found: ID does not exist"
Oct 30 22:15:56.873510 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.873429    4918 scope.go:122] "RemoveContainer" containerID="5fb15b36ae32d48b1408913a75c1bd430b2edac19b299137c7f6653d6057ea21"
Oct 30 22:15:56.897167 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.897146    4918 scope.go:122] "RemoveContainer" containerID="841af1963f4b123e11328c8c6a8543281e350881d11d56ab36963e8a51a39ed2"
Oct 30 22:15:56.991734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.991702    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"]
Oct 30 22:15:56.995855 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:56.995830    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-5pmmc"]
Oct 30 22:15:57.105076 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:57.105041    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"]
Oct 30 22:15:57.110711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:57.110666    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-4sbng"]
Oct 30 22:15:57.222835 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:57.222764    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"]
Oct 30 22:15:57.228670 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:57.228647    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-cgths"]
Oct 30 22:15:57.334197 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:57.334168    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"]
Oct 30 22:15:57.340735 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:57.340711    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-536975-openshift-default-5ddddcdd95-hslq6"]
Oct 30 22:15:58.076350 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:58.076322    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0856582a-2e5e-4d49-9f58-9cf10c008b41" path="/var/lib/kubelet/pods/0856582a-2e5e-4d49-9f58-9cf10c008b41/volumes"
Oct 30 22:15:58.076952 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:58.076915    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7fd08bce-f53b-442f-a87d-767757897c86" path="/var/lib/kubelet/pods/7fd08bce-f53b-442f-a87d-767757897c86/volumes"
Oct 30 22:15:58.098530 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:58.077418    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" path="/var/lib/kubelet/pods/8cf9fa16-1134-4be4-a24a-97e9e6b2d567/volumes"
Oct 30 22:15:58.098530 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:58.078150    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" path="/var/lib/kubelet/pods/a0d3af2f-d2e7-4368-86c1-0b99005186e8/volumes"
Oct 30 22:15:58.871023 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:58.870939    4918 generic.go:356] "Generic (PLEG): container finished" podID="612f3d2b-2897-489a-bb3e-0dc4b00f49e4" containerID="b588a73fedc1289405f56c0abaa9b035e70a309cd255752ab3db3fe84bffcba1" exitCode=0
Oct 30 22:15:58.871023 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:58.870976    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525" event={"ID":"612f3d2b-2897-489a-bb3e-0dc4b00f49e4","Type":"ContainerDied","Data":"b588a73fedc1289405f56c0abaa9b035e70a309cd255752ab3db3fe84bffcba1"}
Oct 30 22:15:58.871336 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:58.871321    4918 scope.go:122] "RemoveContainer" containerID="b588a73fedc1289405f56c0abaa9b035e70a309cd255752ab3db3fe84bffcba1"
Oct 30 22:15:58.872824 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:58.872793    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:15:58.872928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:58.872860    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:15:58.872928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:58.872894    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:15:59.881205 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:15:59.881173    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525" event={"ID":"612f3d2b-2897-489a-bb3e-0dc4b00f49e4","Type":"ContainerStarted","Data":"5473ea7d42662d9478d33958d7f583ac7cc310d57624f9940bc54c97baa2ff2d"}
Oct 30 22:16:00.220485 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:00.219057    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:16:00.220485 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:00.220060    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 22:16:00.220485 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:00.220126    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525" podUID="612f3d2b-2897-489a-bb3e-0dc4b00f49e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 22:16:00.349398 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:00.349298    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:01.215959 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:01.215920    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 22:16:01.216558 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:01.216526    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525" podUID="612f3d2b-2897-489a-bb3e-0dc4b00f49e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 22:16:02.162445 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:16:02.162406    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:16:02.212709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:02.210088    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 22:16:02.212709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:02.210168    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525" podUID="612f3d2b-2897-489a-bb3e-0dc4b00f49e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 22:16:03.217726 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:03.215748    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 22:16:03.217726 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:03.215822    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525" podUID="612f3d2b-2897-489a-bb3e-0dc4b00f49e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 22:16:03.251495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:03.251461    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:04.218119 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:04.217826    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 22:16:04.218119 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:04.217893    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525" podUID="612f3d2b-2897-489a-bb3e-0dc4b00f49e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 22:16:04.359457 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:04.359423    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"]
Oct 30 22:16:04.359630 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:04.359612    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x" podUID="c007e243-983e-4de7-8bed-7df4a06e99ad" containerName="maas-api" containerID="cri-o://7fc4adae10aca5af1da889e3dd3022b80337cb146b5277dcafa32dfe468d31c3" gracePeriod=30
Oct 30 22:16:04.569386 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:04.569319    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:04.963044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:04.961799    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:16:05.017711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.017190    4918 generic.go:356] "Generic (PLEG): container finished" podID="c007e243-983e-4de7-8bed-7df4a06e99ad" containerID="7fc4adae10aca5af1da889e3dd3022b80337cb146b5277dcafa32dfe468d31c3" exitCode=0
Oct 30 22:16:05.017711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.017439    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x" event={"ID":"c007e243-983e-4de7-8bed-7df4a06e99ad","Type":"ContainerDied","Data":"7fc4adae10aca5af1da889e3dd3022b80337cb146b5277dcafa32dfe468d31c3"}
Oct 30 22:16:05.203236 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.203210    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:16:05.210802 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.210764    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 22:16:05.210975 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.210833    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525" podUID="612f3d2b-2897-489a-bb3e-0dc4b00f49e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 22:16:05.371757 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.346406    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-metrics-certs\") pod \"c007e243-983e-4de7-8bed-7df4a06e99ad\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") "
Oct 30 22:16:05.371757 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.346631    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-maas-api-tls\") pod \"c007e243-983e-4de7-8bed-7df4a06e99ad\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") "
Oct 30 22:16:05.371757 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.346780    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c007e243-983e-4de7-8bed-7df4a06e99ad-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c007e243-983e-4de7-8bed-7df4a06e99ad-openshift-service-ca\") pod \"c007e243-983e-4de7-8bed-7df4a06e99ad\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") "
Oct 30 22:16:05.371757 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.346918    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c007e243-983e-4de7-8bed-7df4a06e99ad-kube-api-access-84xw9\" (UniqueName: \"kubernetes.io/projected/c007e243-983e-4de7-8bed-7df4a06e99ad-kube-api-access-84xw9\") pod \"c007e243-983e-4de7-8bed-7df4a06e99ad\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") "
Oct 30 22:16:05.371757 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.357342    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c007e243-983e-4de7-8bed-7df4a06e99ad-kube-api-access-84xw9" pod "c007e243-983e-4de7-8bed-7df4a06e99ad" (UID: "c007e243-983e-4de7-8bed-7df4a06e99ad"). InnerVolumeSpecName "kube-api-access-84xw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:05.380427 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.379524    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c007e243-983e-4de7-8bed-7df4a06e99ad-openshift-service-ca" pod "c007e243-983e-4de7-8bed-7df4a06e99ad" (UID: "c007e243-983e-4de7-8bed-7df4a06e99ad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:05.429219 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.410817    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-metrics-certs" pod "c007e243-983e-4de7-8bed-7df4a06e99ad" (UID: "c007e243-983e-4de7-8bed-7df4a06e99ad"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:16:05.464748 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.449411    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-maas-api-tls" pod "c007e243-983e-4de7-8bed-7df4a06e99ad" (UID: "c007e243-983e-4de7-8bed-7df4a06e99ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:16:05.464748 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.449655    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-maas-api-tls\") pod \"c007e243-983e-4de7-8bed-7df4a06e99ad\" (UID: \"c007e243-983e-4de7-8bed-7df4a06e99ad\") "
Oct 30 22:16:05.464748 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.450428    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84xw9\" (UniqueName: \"kubernetes.io/projected/c007e243-983e-4de7-8bed-7df4a06e99ad-kube-api-access-84xw9\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:05.464748 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.450452    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:05.464748 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.450467    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c007e243-983e-4de7-8bed-7df4a06e99ad-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:05.464748 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:16:05.450557    4918 empty_dir.go:505] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/c007e243-983e-4de7-8bed-7df4a06e99ad/volumes/kubernetes.io~secret/maas-api-tls
Oct 30 22:16:05.464748 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.450569    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-maas-api-tls" pod "c007e243-983e-4de7-8bed-7df4a06e99ad" (UID: "c007e243-983e-4de7-8bed-7df4a06e99ad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:16:05.622862 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:05.622745    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c007e243-983e-4de7-8bed-7df4a06e99ad-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:06.026795 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:06.026766    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"
Oct 30 22:16:06.027000 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:06.026769    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x" event={"ID":"c007e243-983e-4de7-8bed-7df4a06e99ad","Type":"ContainerDied","Data":"bdb9b3981b7b57693a7e03dde62fe7c088a6e9d262c606cc2a4f7ff6c58ac695"}
Oct 30 22:16:06.027000 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:06.026906    4918 scope.go:122] "RemoveContainer" containerID="7fc4adae10aca5af1da889e3dd3022b80337cb146b5277dcafa32dfe468d31c3"
Oct 30 22:16:06.193808 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:06.193770    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"]
Oct 30 22:16:06.215110 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:06.215082    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:16:06.216151 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:06.216126    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:16:06.242752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:06.242725    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d7b3c557-586c75c579-shb5x"]
Oct 30 22:16:06.444704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:06.443759    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:06.725539 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:06.725440    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:06.982237 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:06.982141    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:08.074674 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:08.074643    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c007e243-983e-4de7-8bed-7df4a06e99ad" path="/var/lib/kubelet/pods/c007e243-983e-4de7-8bed-7df4a06e99ad/volumes"
Oct 30 22:16:08.622759 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:08.622721    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"]
Oct 30 22:16:08.634758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:08.623235    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz" podUID="61b7bfc4-ac41-46b1-a7f7-952f8745a765" containerName="istio-proxy" containerID="cri-o://4872f15aa9a19aa1061a6cd3ae58bfc10e6ff951ceab88ab8f7848f7d51216c6" gracePeriod=30
Oct 30 22:16:08.777187 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:08.775424    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:09.506018 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:09.505985    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:11.827101 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:11.827066    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:13.962124 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:13.962098    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:16:14.028096 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.028067    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-workload-socket\") pod \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") "
Oct 30 22:16:14.028249 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.028146    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-envoy\") pod \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") "
Oct 30 22:16:14.028249 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.028184    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-data\") pod \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") "
Oct 30 22:16:14.028389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.028289    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61b7bfc4-ac41-46b1-a7f7-952f8745a765-kube-api-access-d95rv\" (UniqueName: \"kubernetes.io/projected/61b7bfc4-ac41-46b1-a7f7-952f8745a765-kube-api-access-d95rv\") pod \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") "
Oct 30 22:16:14.028389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.028300    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-workload-socket" pod "61b7bfc4-ac41-46b1-a7f7-952f8745a765" (UID: "61b7bfc4-ac41-46b1-a7f7-952f8745a765"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:14.028389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.028346    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-podinfo\") pod \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") "
Oct 30 22:16:14.028389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.028374    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-token\" (UniqueName: \"kubernetes.io/projected/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-token\") pod \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") "
Oct 30 22:16:14.028607 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.028465    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-workload-certs\") pod \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") "
Oct 30 22:16:14.028607 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.028533    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-credential-socket\") pod \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") "
Oct 30 22:16:14.028607 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.028537    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-data" pod "61b7bfc4-ac41-46b1-a7f7-952f8745a765" (UID: "61b7bfc4-ac41-46b1-a7f7-952f8745a765"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:14.028788 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.028627    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istiod-ca-cert\") pod \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\" (UID: \"61b7bfc4-ac41-46b1-a7f7-952f8745a765\") "
Oct 30 22:16:14.028788 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.028771    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-workload-certs" pod "61b7bfc4-ac41-46b1-a7f7-952f8745a765" (UID: "61b7bfc4-ac41-46b1-a7f7-952f8745a765"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:14.029041 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.028853    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-credential-socket" pod "61b7bfc4-ac41-46b1-a7f7-952f8745a765" (UID: "61b7bfc4-ac41-46b1-a7f7-952f8745a765"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:14.029153 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.029135    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istiod-ca-cert" pod "61b7bfc4-ac41-46b1-a7f7-952f8745a765" (UID: "61b7bfc4-ac41-46b1-a7f7-952f8745a765"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:14.029653 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.029626    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:14.029797 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.029659    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:14.029797 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.029674    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:14.029797 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.029706    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:14.029797 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.029719    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:14.030675 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.030653    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-envoy" pod "61b7bfc4-ac41-46b1-a7f7-952f8745a765" (UID: "61b7bfc4-ac41-46b1-a7f7-952f8745a765"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:14.030675 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.030666    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-podinfo" pod "61b7bfc4-ac41-46b1-a7f7-952f8745a765" (UID: "61b7bfc4-ac41-46b1-a7f7-952f8745a765"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:16:14.031201 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.031185    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b7bfc4-ac41-46b1-a7f7-952f8745a765-kube-api-access-d95rv" pod "61b7bfc4-ac41-46b1-a7f7-952f8745a765" (UID: "61b7bfc4-ac41-46b1-a7f7-952f8745a765"). InnerVolumeSpecName "kube-api-access-d95rv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:14.031266 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.031207    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-token" pod "61b7bfc4-ac41-46b1-a7f7-952f8745a765" (UID: "61b7bfc4-ac41-46b1-a7f7-952f8745a765"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:14.131150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.131122    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:14.131150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.131148    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d95rv\" (UniqueName: \"kubernetes.io/projected/61b7bfc4-ac41-46b1-a7f7-952f8745a765-kube-api-access-d95rv\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:14.131299 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.131159    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:14.131299 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.131167    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61b7bfc4-ac41-46b1-a7f7-952f8745a765-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:14.193355 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.193267    4918 generic.go:356] "Generic (PLEG): container finished" podID="61b7bfc4-ac41-46b1-a7f7-952f8745a765" containerID="4872f15aa9a19aa1061a6cd3ae58bfc10e6ff951ceab88ab8f7848f7d51216c6" exitCode=0
Oct 30 22:16:14.193500 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.193379    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"
Oct 30 22:16:14.193500 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.193400    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz" event={"ID":"61b7bfc4-ac41-46b1-a7f7-952f8745a765","Type":"ContainerDied","Data":"4872f15aa9a19aa1061a6cd3ae58bfc10e6ff951ceab88ab8f7848f7d51216c6"}
Oct 30 22:16:14.193500 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.193468    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz" event={"ID":"61b7bfc4-ac41-46b1-a7f7-952f8745a765","Type":"ContainerDied","Data":"d698b08eb038db1f28f0a613d8b174066bfd7988c90419f4822df87ded0d504c"}
Oct 30 22:16:14.193729 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.193501    4918 scope.go:122] "RemoveContainer" containerID="4872f15aa9a19aa1061a6cd3ae58bfc10e6ff951ceab88ab8f7848f7d51216c6"
Oct 30 22:16:14.205629 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.205612    4918 scope.go:122] "RemoveContainer" containerID="026e3031169cc60027f7f8c3265493189fca91b42fa53145156289cc6b0d87d3"
Oct 30 22:16:14.215836 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.215814    4918 scope.go:122] "RemoveContainer" containerID="4872f15aa9a19aa1061a6cd3ae58bfc10e6ff951ceab88ab8f7848f7d51216c6"
Oct 30 22:16:14.216113 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:16:14.216095    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4872f15aa9a19aa1061a6cd3ae58bfc10e6ff951ceab88ab8f7848f7d51216c6\": container with ID starting with 4872f15aa9a19aa1061a6cd3ae58bfc10e6ff951ceab88ab8f7848f7d51216c6 not found: ID does not exist" containerID="4872f15aa9a19aa1061a6cd3ae58bfc10e6ff951ceab88ab8f7848f7d51216c6"
Oct 30 22:16:14.216193 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.216119    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4872f15aa9a19aa1061a6cd3ae58bfc10e6ff951ceab88ab8f7848f7d51216c6"} err="failed to get container status \"4872f15aa9a19aa1061a6cd3ae58bfc10e6ff951ceab88ab8f7848f7d51216c6\": rpc error: code = NotFound desc = could not find container \"4872f15aa9a19aa1061a6cd3ae58bfc10e6ff951ceab88ab8f7848f7d51216c6\": container with ID starting with 4872f15aa9a19aa1061a6cd3ae58bfc10e6ff951ceab88ab8f7848f7d51216c6 not found: ID does not exist"
Oct 30 22:16:14.216193 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.216144    4918 scope.go:122] "RemoveContainer" containerID="026e3031169cc60027f7f8c3265493189fca91b42fa53145156289cc6b0d87d3"
Oct 30 22:16:14.216366 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:16:14.216347    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"026e3031169cc60027f7f8c3265493189fca91b42fa53145156289cc6b0d87d3\": container with ID starting with 026e3031169cc60027f7f8c3265493189fca91b42fa53145156289cc6b0d87d3 not found: ID does not exist" containerID="026e3031169cc60027f7f8c3265493189fca91b42fa53145156289cc6b0d87d3"
Oct 30 22:16:14.216417 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.216374    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"026e3031169cc60027f7f8c3265493189fca91b42fa53145156289cc6b0d87d3"} err="failed to get container status \"026e3031169cc60027f7f8c3265493189fca91b42fa53145156289cc6b0d87d3\": rpc error: code = NotFound desc = could not find container \"026e3031169cc60027f7f8c3265493189fca91b42fa53145156289cc6b0d87d3\": container with ID starting with 026e3031169cc60027f7f8c3265493189fca91b42fa53145156289cc6b0d87d3 not found: ID does not exist"
Oct 30 22:16:14.359745 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.359711    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"]
Oct 30 22:16:14.364299 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:14.364270    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d7b3c557-openshift-default-65f45ff7b5-dh6kz"]
Oct 30 22:16:16.074781 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:16.074749    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="61b7bfc4-ac41-46b1-a7f7-952f8745a765" path="/var/lib/kubelet/pods/61b7bfc4-ac41-46b1-a7f7-952f8745a765/volumes"
Oct 30 22:16:17.045646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:17.044594    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:20.075866 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:20.075838    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"]
Oct 30 22:16:20.076321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:20.076028    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk" podUID="e3a89ded-e923-49b1-ba16-08c53edb68be" containerName="istio-proxy" containerID="cri-o://fa7703710b4a12ccace02b41d791188dd1f58e876993acc598f44b755602b714" gracePeriod=30
Oct 30 22:16:20.136046 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:20.136009    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"]
Oct 30 22:16:20.136535 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:20.136484    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj" podUID="1fec41f1-9d5d-410f-99ac-299ee5385f24" containerName="istio-proxy" containerID="cri-o://90d39f06a168ee5342d5a1d88f5263850b6b45861a3f366264c3c78d02d49c40" gracePeriod=30
Oct 30 22:16:20.140244 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:20.140210    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"]
Oct 30 22:16:20.140487 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:20.140429    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj" podUID="22c64c07-65da-4549-b90c-b5c7a01b516e" containerName="istio-proxy" containerID="cri-o://04e72b2c08c691660968833fdbe7f15543506bea3e375ea18149fb56dad834cb" gracePeriod=30
Oct 30 22:16:20.171982 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:20.171959    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"]
Oct 30 22:16:20.172154 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:20.172121    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl" podUID="8eee972d-c1a3-4b1b-91b9-94f516ccfa85" containerName="istio-proxy" containerID="cri-o://d0a307aeda10127388ef12b065233eaa8dd8d4522ea6ce300512df20eb34748e" gracePeriod=30
Oct 30 22:16:21.959306 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:21.953805    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:23.797164 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:23.797028    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:23.848787 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:23.846757    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:16:23.848787 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:23.846874    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl" podUID="8eee972d-c1a3-4b1b-91b9-94f516ccfa85" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:16:24.056077 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:24.056040    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:24.518702 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:24.518186    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:25.557057 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:25.528786    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:25.665046 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:25.647878    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:25.830746 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:25.818062    4918 generic.go:356] "Generic (PLEG): container finished" podID="8eee972d-c1a3-4b1b-91b9-94f516ccfa85" containerID="d0a307aeda10127388ef12b065233eaa8dd8d4522ea6ce300512df20eb34748e" exitCode=0
Oct 30 22:16:25.830746 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:25.818210    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl" event={"ID":"8eee972d-c1a3-4b1b-91b9-94f516ccfa85","Type":"ContainerDied","Data":"d0a307aeda10127388ef12b065233eaa8dd8d4522ea6ce300512df20eb34748e"}
Oct 30 22:16:25.954775 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:25.954201    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:26.032747 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:26.017234    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:16:26.175672 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:26.168213    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:26.178517 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:26.178372    4918 generic.go:356] "Generic (PLEG): container finished" podID="e3a89ded-e923-49b1-ba16-08c53edb68be" containerID="fa7703710b4a12ccace02b41d791188dd1f58e876993acc598f44b755602b714" exitCode=0
Oct 30 22:16:26.228803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:26.216375    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 22:16:26.228803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:26.216432    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj" podUID="22c64c07-65da-4549-b90c-b5c7a01b516e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 22:16:26.338254 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:26.306905    4918 generic.go:356] "Generic (PLEG): container finished" podID="1fec41f1-9d5d-410f-99ac-299ee5385f24" containerID="90d39f06a168ee5342d5a1d88f5263850b6b45861a3f366264c3c78d02d49c40" exitCode=0
Oct 30 22:16:26.546805 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:26.546703    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:26.750883 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:26.655305    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:16:26.824768 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:26.801795    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:26.845993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:26.845004    4918 generic.go:356] "Generic (PLEG): container finished" podID="22c64c07-65da-4549-b90c-b5c7a01b516e" containerID="04e72b2c08c691660968833fdbe7f15543506bea3e375ea18149fb56dad834cb" exitCode=0
Oct 30 22:16:26.898717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:26.883896    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk" event={"ID":"e3a89ded-e923-49b1-ba16-08c53edb68be","Type":"ContainerDied","Data":"fa7703710b4a12ccace02b41d791188dd1f58e876993acc598f44b755602b714"}
Oct 30 22:16:26.898717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:26.884015    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:16:26.898717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:26.884038    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj" event={"ID":"1fec41f1-9d5d-410f-99ac-299ee5385f24","Type":"ContainerDied","Data":"90d39f06a168ee5342d5a1d88f5263850b6b45861a3f366264c3c78d02d49c40"}
Oct 30 22:16:26.898717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:26.884095    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:16:26.898717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:26.884112    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj" event={"ID":"22c64c07-65da-4549-b90c-b5c7a01b516e","Type":"ContainerDied","Data":"04e72b2c08c691660968833fdbe7f15543506bea3e375ea18149fb56dad834cb"}
Oct 30 22:16:26.898717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:26.885869    4918 scope.go:122] "RemoveContainer" containerID="30e6c194511c42eb8fd8b901434e3be4167a434910d2286340c95391de26d453"
Oct 30 22:16:27.071302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.055300    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:16:27.071302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.061053    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:16:27.071302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.063195    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/health\": context deadline exceeded"
Oct 30 22:16:27.071302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.063410    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 22:16:27.129762 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.087897    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:16:27.129762 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.126663    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:27.192717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.181116    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:27.192717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.181672    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:16:27.237861 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.221798    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:16:27.259743 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.253778    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:27.259743 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.254031    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:16:27.259743 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.254064    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk" podUID="e3a89ded-e923-49b1-ba16-08c53edb68be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:27.314705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.307602    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-credential-socket\") pod \"e3a89ded-e923-49b1-ba16-08c53edb68be\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") "
Oct 30 22:16:27.345091 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.336379    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-envoy\") pod \"e3a89ded-e923-49b1-ba16-08c53edb68be\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") "
Oct 30 22:16:27.367843 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.367772    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-workload-socket\") pod \"e3a89ded-e923-49b1-ba16-08c53edb68be\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") "
Oct 30 22:16:27.368009 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.367868    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-data\") pod \"e3a89ded-e923-49b1-ba16-08c53edb68be\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") "
Oct 30 22:16:27.368009 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.367950    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e3a89ded-e923-49b1-ba16-08c53edb68be-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3a89ded-e923-49b1-ba16-08c53edb68be-istiod-ca-cert\") pod \"e3a89ded-e923-49b1-ba16-08c53edb68be\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") "
Oct 30 22:16:27.368009 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.367996    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-podinfo\") pod \"e3a89ded-e923-49b1-ba16-08c53edb68be\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") "
Oct 30 22:16:27.368941 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.368199    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e3a89ded-e923-49b1-ba16-08c53edb68be-kube-api-access-tsmwb\" (UniqueName: \"kubernetes.io/projected/e3a89ded-e923-49b1-ba16-08c53edb68be-kube-api-access-tsmwb\") pod \"e3a89ded-e923-49b1-ba16-08c53edb68be\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") "
Oct 30 22:16:27.368941 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.368294    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-token\" (UniqueName: \"kubernetes.io/projected/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-token\") pod \"e3a89ded-e923-49b1-ba16-08c53edb68be\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") "
Oct 30 22:16:27.368941 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.368446    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-workload-certs\") pod \"e3a89ded-e923-49b1-ba16-08c53edb68be\" (UID: \"e3a89ded-e923-49b1-ba16-08c53edb68be\") "
Oct 30 22:16:27.368941 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.368461    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-data" pod "e3a89ded-e923-49b1-ba16-08c53edb68be" (UID: "e3a89ded-e923-49b1-ba16-08c53edb68be"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:27.368941 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.368623    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-workload-socket" pod "e3a89ded-e923-49b1-ba16-08c53edb68be" (UID: "e3a89ded-e923-49b1-ba16-08c53edb68be"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:27.370864 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.369402    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:27.370864 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.369429    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:27.413802 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.403665    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3a89ded-e923-49b1-ba16-08c53edb68be-istiod-ca-cert" pod "e3a89ded-e923-49b1-ba16-08c53edb68be" (UID: "e3a89ded-e923-49b1-ba16-08c53edb68be"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:27.413802 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.403982    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-workload-certs" pod "e3a89ded-e923-49b1-ba16-08c53edb68be" (UID: "e3a89ded-e923-49b1-ba16-08c53edb68be"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:27.457835 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.457792    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-credential-socket" pod "e3a89ded-e923-49b1-ba16-08c53edb68be" (UID: "e3a89ded-e923-49b1-ba16-08c53edb68be"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:27.525228 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.505669    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:27.525574 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.525545    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:27.525770 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.525753    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3a89ded-e923-49b1-ba16-08c53edb68be-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:27.650709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.557289    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-envoy" pod "e3a89ded-e923-49b1-ba16-08c53edb68be" (UID: "e3a89ded-e923-49b1-ba16-08c53edb68be"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:27.650709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.602440    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:27.676762 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.663203    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:27.676762 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.663530    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:27.679358 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.679308    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3a89ded-e923-49b1-ba16-08c53edb68be-kube-api-access-tsmwb" pod "e3a89ded-e923-49b1-ba16-08c53edb68be" (UID: "e3a89ded-e923-49b1-ba16-08c53edb68be"). InnerVolumeSpecName "kube-api-access-tsmwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:27.802791 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.802753    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsmwb\" (UniqueName: \"kubernetes.io/projected/e3a89ded-e923-49b1-ba16-08c53edb68be-kube-api-access-tsmwb\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:27.838814 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.837137    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 22:16:27.838814 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.838438    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:16:27.868706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:27.855815    4918 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:28.112714 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.092761    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:16:28.161635 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.138368    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": context deadline exceeded"
Oct 30 22:16:28.249732 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.222923    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:16:28.249732 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.223292    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-token" pod "e3a89ded-e923-49b1-ba16-08c53edb68be" (UID: "e3a89ded-e923-49b1-ba16-08c53edb68be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:28.249732 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.223376    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:28.319739 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.316812    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:28.410380 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.410344    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-podinfo" pod "e3a89ded-e923-49b1-ba16-08c53edb68be" (UID: "e3a89ded-e923-49b1-ba16-08c53edb68be"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:16:28.436893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.432907    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-workload-socket\") pod \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") "
Oct 30 22:16:28.436893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.432973    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-token\" (UniqueName: \"kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-token\") pod \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") "
Oct 30 22:16:28.436893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.433027    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-podinfo\") pod \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") "
Oct 30 22:16:28.436893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.433060    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-workload-certs\") pod \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") "
Oct 30 22:16:28.436893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.433101    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-credential-socket\") pod \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") "
Oct 30 22:16:28.436893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.433273    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-data\") pod \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") "
Oct 30 22:16:28.436893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.433350    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-envoy\") pod \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") "
Oct 30 22:16:28.436893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.433381    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-kube-api-access-rvflj\" (UniqueName: \"kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-kube-api-access-rvflj\") pod \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") "
Oct 30 22:16:28.450251 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.433666    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istiod-ca-cert\") pod \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") "
Oct 30 22:16:28.460014 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.459971    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3a89ded-e923-49b1-ba16-08c53edb68be-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:28.460215 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.438605    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istiod-ca-cert" pod "8eee972d-c1a3-4b1b-91b9-94f516ccfa85" (UID: "8eee972d-c1a3-4b1b-91b9-94f516ccfa85"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:28.464803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.438949    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-workload-socket" pod "8eee972d-c1a3-4b1b-91b9-94f516ccfa85" (UID: "8eee972d-c1a3-4b1b-91b9-94f516ccfa85"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:28.464986 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.464435    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-credential-socket" pod "8eee972d-c1a3-4b1b-91b9-94f516ccfa85" (UID: "8eee972d-c1a3-4b1b-91b9-94f516ccfa85"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:28.465073 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.464941    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-workload-certs" pod "8eee972d-c1a3-4b1b-91b9-94f516ccfa85" (UID: "8eee972d-c1a3-4b1b-91b9-94f516ccfa85"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:28.557591 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.557513    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-data" pod "8eee972d-c1a3-4b1b-91b9-94f516ccfa85" (UID: "8eee972d-c1a3-4b1b-91b9-94f516ccfa85"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:28.564452 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.564421    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:28.564661 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.564643    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:28.564810 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.564794    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:28.564905 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.564893    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:28.565004 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.564991    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:28.565469 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.565446    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-envoy" pod "8eee972d-c1a3-4b1b-91b9-94f516ccfa85" (UID: "8eee972d-c1a3-4b1b-91b9-94f516ccfa85"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:28.566330 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.566156    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"
Oct 30 22:16:28.584041 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.584004    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:16:28.584206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.584051    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj" event={"ID":"22c64c07-65da-4549-b90c-b5c7a01b516e","Type":"ContainerDied","Data":"3132701ca88c9969cc788adfd2869ce8e30fb8d34771be000c0ddd6ce9ade34f"}
Oct 30 22:16:28.584206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.584089    4918 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3132701ca88c9969cc788adfd2869ce8e30fb8d34771be000c0ddd6ce9ade34f"
Oct 30 22:16:28.584206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.584102    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl" event={"ID":"8eee972d-c1a3-4b1b-91b9-94f516ccfa85","Type":"ContainerDied","Data":"ce3667fdbcc515947fbaa8f542073a46d116827c4e532e862d344ee1f36de4d3"}
Oct 30 22:16:28.584206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.584128    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk" event={"ID":"e3a89ded-e923-49b1-ba16-08c53edb68be","Type":"ContainerDied","Data":"83bbbb45ab58b38f113f6ca5673cdfcf17caeb2bfd6dc8e260864de3aaa0351a"}
Oct 30 22:16:28.584206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.584162    4918 scope.go:122] "RemoveContainer" containerID="d0a307aeda10127388ef12b065233eaa8dd8d4522ea6ce300512df20eb34748e"
Oct 30 22:16:28.627165 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.626974    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:16:28.678937 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.678875    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:28.679729 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.679669    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": context deadline exceeded"
Oct 30 22:16:28.689118 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.689094    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:16:28.694006 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.693977    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:28.709407 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.709368    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-podinfo" pod "8eee972d-c1a3-4b1b-91b9-94f516ccfa85" (UID: "8eee972d-c1a3-4b1b-91b9-94f516ccfa85"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:16:28.748945 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.748911    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-token" pod "8eee972d-c1a3-4b1b-91b9-94f516ccfa85" (UID: "8eee972d-c1a3-4b1b-91b9-94f516ccfa85"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:28.793199 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.793163    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-kube-api-access-rvflj" pod "8eee972d-c1a3-4b1b-91b9-94f516ccfa85" (UID: "8eee972d-c1a3-4b1b-91b9-94f516ccfa85"). InnerVolumeSpecName "kube-api-access-rvflj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:28.889018 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.799506    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-token\" (UniqueName: \"kubernetes.io/projected/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-token\") pod \"22c64c07-65da-4549-b90c-b5c7a01b516e\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") "
Oct 30 22:16:28.891298 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.891252    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-kube-api-access-rvflj\" (UniqueName: \"kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-kube-api-access-rvflj\") pod \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\" (UID: \"8eee972d-c1a3-4b1b-91b9-94f516ccfa85\") "
Oct 30 22:16:28.891610 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.891591    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/22c64c07-65da-4549-b90c-b5c7a01b516e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22c64c07-65da-4549-b90c-b5c7a01b516e-istiod-ca-cert\") pod \"22c64c07-65da-4549-b90c-b5c7a01b516e\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") "
Oct 30 22:16:28.891984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.891955    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-envoy\") pod \"22c64c07-65da-4549-b90c-b5c7a01b516e\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") "
Oct 30 22:16:28.892298 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.892277    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-credential-socket\") pod \"22c64c07-65da-4549-b90c-b5c7a01b516e\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") "
Oct 30 22:16:28.892486 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.892470    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/22c64c07-65da-4549-b90c-b5c7a01b516e-kube-api-access-cvk94\" (UniqueName: \"kubernetes.io/projected/22c64c07-65da-4549-b90c-b5c7a01b516e-kube-api-access-cvk94\") pod \"22c64c07-65da-4549-b90c-b5c7a01b516e\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") "
Oct 30 22:16:28.893326 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.893305    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-podinfo\") pod \"22c64c07-65da-4549-b90c-b5c7a01b516e\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") "
Oct 30 22:16:28.893552 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.893536    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-workload-certs\") pod \"22c64c07-65da-4549-b90c-b5c7a01b516e\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") "
Oct 30 22:16:28.893876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.893858    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-workload-socket\") pod \"22c64c07-65da-4549-b90c-b5c7a01b516e\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") "
Oct 30 22:16:28.894811 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.894792    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-data\") pod \"22c64c07-65da-4549-b90c-b5c7a01b516e\" (UID: \"22c64c07-65da-4549-b90c-b5c7a01b516e\") "
Oct 30 22:16:28.938705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.927390    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-token" pod "22c64c07-65da-4549-b90c-b5c7a01b516e" (UID: "22c64c07-65da-4549-b90c-b5c7a01b516e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:28.939044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.932555    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-data" pod "22c64c07-65da-4549-b90c-b5c7a01b516e" (UID: "22c64c07-65da-4549-b90c-b5c7a01b516e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:28.939253 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:16:28.932647    4918 empty_dir.go:505] Warning: Unmount skipped because path does not exist: /var/lib/kubelet/pods/8eee972d-c1a3-4b1b-91b9-94f516ccfa85/volumes/kubernetes.io~projected/kube-api-access-rvflj
Oct 30 22:16:28.946707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.939405    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-kube-api-access-rvflj" pod "8eee972d-c1a3-4b1b-91b9-94f516ccfa85" (UID: "8eee972d-c1a3-4b1b-91b9-94f516ccfa85"). InnerVolumeSpecName "kube-api-access-rvflj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:28.956769 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.853511    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:16:28.956769 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.937132    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:28.956769 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.951480    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:28.956769 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.951510    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvflj\" (UniqueName: \"kubernetes.io/projected/8eee972d-c1a3-4b1b-91b9-94f516ccfa85-kube-api-access-rvflj\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:28.958328 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.892892    4918 scope.go:122] "RemoveContainer" containerID="fa7703710b4a12ccace02b41d791188dd1f58e876993acc598f44b755602b714"
Oct 30 22:16:28.959619 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.959583    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 22:16:28.960560 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.960537    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-credential-socket" pod "22c64c07-65da-4549-b90c-b5c7a01b516e" (UID: "22c64c07-65da-4549-b90c-b5c7a01b516e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:28.973081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.971340    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-workload-certs" pod "22c64c07-65da-4549-b90c-b5c7a01b516e" (UID: "22c64c07-65da-4549-b90c-b5c7a01b516e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:28.973081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.971509    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-workload-socket" pod "22c64c07-65da-4549-b90c-b5c7a01b516e" (UID: "22c64c07-65da-4549-b90c-b5c7a01b516e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:28.983637 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.983604    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:16:28.986884 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.986857    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22c64c07-65da-4549-b90c-b5c7a01b516e-istiod-ca-cert" pod "22c64c07-65da-4549-b90c-b5c7a01b516e" (UID: "22c64c07-65da-4549-b90c-b5c7a01b516e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:28.989660 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.987612    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-podinfo" pod "22c64c07-65da-4549-b90c-b5c7a01b516e" (UID: "22c64c07-65da-4549-b90c-b5c7a01b516e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:16:28.989940 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.987751    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-envoy" pod "22c64c07-65da-4549-b90c-b5c7a01b516e" (UID: "22c64c07-65da-4549-b90c-b5c7a01b516e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:28.991372 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:28.991326    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22c64c07-65da-4549-b90c-b5c7a01b516e-kube-api-access-cvk94" pod "22c64c07-65da-4549-b90c-b5c7a01b516e" (UID: "22c64c07-65da-4549-b90c-b5c7a01b516e"). InnerVolumeSpecName "kube-api-access-cvk94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:29.002457 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.001891    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.055246    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1fec41f1-9d5d-410f-99ac-299ee5385f24-kube-api-access-tmckh\" (UniqueName: \"kubernetes.io/projected/1fec41f1-9d5d-410f-99ac-299ee5385f24-kube-api-access-tmckh\") pod \"1fec41f1-9d5d-410f-99ac-299ee5385f24\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") "
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.055343    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-workload-certs\") pod \"1fec41f1-9d5d-410f-99ac-299ee5385f24\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") "
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.055425    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-data\") pod \"1fec41f1-9d5d-410f-99ac-299ee5385f24\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") "
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.055511    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-podinfo\") pod \"1fec41f1-9d5d-410f-99ac-299ee5385f24\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") "
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.055548    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1fec41f1-9d5d-410f-99ac-299ee5385f24-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fec41f1-9d5d-410f-99ac-299ee5385f24-istiod-ca-cert\") pod \"1fec41f1-9d5d-410f-99ac-299ee5385f24\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") "
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.055588    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-envoy\") pod \"1fec41f1-9d5d-410f-99ac-299ee5385f24\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") "
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.055630    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-token\" (UniqueName: \"kubernetes.io/projected/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-token\") pod \"1fec41f1-9d5d-410f-99ac-299ee5385f24\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") "
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.055708    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-workload-socket\") pod \"1fec41f1-9d5d-410f-99ac-299ee5385f24\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") "
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.055928    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-credential-socket\") pod \"1fec41f1-9d5d-410f-99ac-299ee5385f24\" (UID: \"1fec41f1-9d5d-410f-99ac-299ee5385f24\") "
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.056729    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.056752    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22c64c07-65da-4549-b90c-b5c7a01b516e-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.056772    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.056787    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.056809    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvk94\" (UniqueName: \"kubernetes.io/projected/22c64c07-65da-4549-b90c-b5c7a01b516e-kube-api-access-cvk94\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.056824    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.056838    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.056854    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.056866    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22c64c07-65da-4549-b90c-b5c7a01b516e-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.058261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.058198    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fec41f1-9d5d-410f-99ac-299ee5385f24-istiod-ca-cert" pod "1fec41f1-9d5d-410f-99ac-299ee5385f24" (UID: "1fec41f1-9d5d-410f-99ac-299ee5385f24"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:29.066366 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.066338    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-workload-certs" pod "1fec41f1-9d5d-410f-99ac-299ee5385f24" (UID: "1fec41f1-9d5d-410f-99ac-299ee5385f24"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:29.073214 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.073188    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-credential-socket" pod "1fec41f1-9d5d-410f-99ac-299ee5385f24" (UID: "1fec41f1-9d5d-410f-99ac-299ee5385f24"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:29.091349 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.089578    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:16:29.095442 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.095250    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-token" pod "1fec41f1-9d5d-410f-99ac-299ee5385f24" (UID: "1fec41f1-9d5d-410f-99ac-299ee5385f24"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:29.095813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.095621    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-data" pod "1fec41f1-9d5d-410f-99ac-299ee5385f24" (UID: "1fec41f1-9d5d-410f-99ac-299ee5385f24"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:29.098041 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.095947    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-workload-socket" pod "1fec41f1-9d5d-410f-99ac-299ee5385f24" (UID: "1fec41f1-9d5d-410f-99ac-299ee5385f24"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:29.101592 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.101567    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-podinfo" pod "1fec41f1-9d5d-410f-99ac-299ee5385f24" (UID: "1fec41f1-9d5d-410f-99ac-299ee5385f24"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:16:29.169706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.161398    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.169706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.161435    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fec41f1-9d5d-410f-99ac-299ee5385f24-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.169706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.161471    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.169706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.161486    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.169706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.161502    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.169706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.161518    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.169706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.161533    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.203423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.203368    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fec41f1-9d5d-410f-99ac-299ee5385f24-kube-api-access-tmckh" pod "1fec41f1-9d5d-410f-99ac-299ee5385f24" (UID: "1fec41f1-9d5d-410f-99ac-299ee5385f24"). InnerVolumeSpecName "kube-api-access-tmckh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:29.254147 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.254083    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-envoy" pod "1fec41f1-9d5d-410f-99ac-299ee5385f24" (UID: "1fec41f1-9d5d-410f-99ac-299ee5385f24"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:29.262930 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.262897    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmckh\" (UniqueName: \"kubernetes.io/projected/1fec41f1-9d5d-410f-99ac-299ee5385f24-kube-api-access-tmckh\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.263146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.263130    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fec41f1-9d5d-410f-99ac-299ee5385f24-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:29.284622 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:16:29.284587    4918 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a89ded_e923_49b1_ba16_08c53edb68be.slice/crio-83bbbb45ab58b38f113f6ca5673cdfcf17caeb2bfd6dc8e260864de3aaa0351a\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a89ded_e923_49b1_ba16_08c53edb68be.slice\": RecentStats: unable to find data in memory cache]"
Oct 30 22:16:29.588120 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.588087    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"
Oct 30 22:16:29.592839 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.592814    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"
Oct 30 22:16:29.664405 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.605812    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"
Oct 30 22:16:29.674004 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.673940    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj" event={"ID":"1fec41f1-9d5d-410f-99ac-299ee5385f24","Type":"ContainerDied","Data":"248c1831079ef563b76d5552fac08bfd4f5408afa12dcb0f41cbf3f76c17ea85"}
Oct 30 22:16:29.674158 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.674059    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"]
Oct 30 22:16:29.674158 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.674093    4918 scope.go:122] "RemoveContainer" containerID="90d39f06a168ee5342d5a1d88f5263850b6b45861a3f366264c3c78d02d49c40"
Oct 30 22:16:29.678792 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:29.678733    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-r8glk"]
Oct 30 22:16:30.080727 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:30.080627    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e3a89ded-e923-49b1-ba16-08c53edb68be" path="/var/lib/kubelet/pods/e3a89ded-e923-49b1-ba16-08c53edb68be/volumes"
Oct 30 22:16:30.081144 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:30.081125    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"]
Oct 30 22:16:30.081187 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:30.081162    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-jhxnl"]
Oct 30 22:16:30.213772 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:30.213729    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"]
Oct 30 22:16:30.250641 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:30.250547    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-n6wvj"]
Oct 30 22:16:30.350079 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:30.349985    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"]
Oct 30 22:16:30.352393 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:30.352366    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-mztbj"]
Oct 30 22:16:31.677010 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.676971    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"]
Oct 30 22:16:31.677907 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.677890    4918 cpu_manager.go:414] "containerMap: removing container" podUID="7fd08bce-f53b-442f-a87d-767757897c86" containerName="istio-proxy"
Oct 30 22:16:31.677980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.677910    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7fd08bce-f53b-442f-a87d-767757897c86" containerName="istio-proxy"
Oct 30 22:16:31.677980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.677933    4918 cpu_manager.go:414] "containerMap: removing container" podUID="61b7bfc4-ac41-46b1-a7f7-952f8745a765" containerName="istio-proxy"
Oct 30 22:16:31.677980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.677940    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61b7bfc4-ac41-46b1-a7f7-952f8745a765" containerName="istio-proxy"
Oct 30 22:16:31.677980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.677960    4918 cpu_manager.go:414] "containerMap: removing container" podUID="0d28d1af-b09f-4b11-8590-516816b0d809" containerName="payload-processing"
Oct 30 22:16:31.677980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.677968    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d28d1af-b09f-4b11-8590-516816b0d809" containerName="payload-processing"
Oct 30 22:16:31.678146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.677991    4918 cpu_manager.go:414] "containerMap: removing container" podUID="1fec41f1-9d5d-410f-99ac-299ee5385f24" containerName="istio-proxy"
Oct 30 22:16:31.678146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.677998    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1fec41f1-9d5d-410f-99ac-299ee5385f24" containerName="istio-proxy"
Oct 30 22:16:31.678146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678023    4918 cpu_manager.go:414] "containerMap: removing container" podUID="22c64c07-65da-4549-b90c-b5c7a01b516e" containerName="istio-proxy"
Oct 30 22:16:31.678146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678029    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22c64c07-65da-4549-b90c-b5c7a01b516e" containerName="istio-proxy"
Oct 30 22:16:31.678146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678038    4918 cpu_manager.go:414] "containerMap: removing container" podUID="c007e243-983e-4de7-8bed-7df4a06e99ad" containerName="maas-api"
Oct 30 22:16:31.678146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678045    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c007e243-983e-4de7-8bed-7df4a06e99ad" containerName="maas-api"
Oct 30 22:16:31.678146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678057    4918 cpu_manager.go:414] "containerMap: removing container" podUID="6f720a6b-f1b3-4738-9e50-b9c6f5c8e300" containerName="payload-pre-processing"
Oct 30 22:16:31.678146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678064    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f720a6b-f1b3-4738-9e50-b9c6f5c8e300" containerName="payload-pre-processing"
Oct 30 22:16:31.678146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678081    4918 cpu_manager.go:414] "containerMap: removing container" podUID="0856582a-2e5e-4d49-9f58-9cf10c008b41" containerName="istio-proxy"
Oct 30 22:16:31.678146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678088    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0856582a-2e5e-4d49-9f58-9cf10c008b41" containerName="istio-proxy"
Oct 30 22:16:31.678146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678114    4918 cpu_manager.go:414] "containerMap: removing container" podUID="e3a89ded-e923-49b1-ba16-08c53edb68be" containerName="istio-proxy"
Oct 30 22:16:31.678146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678121    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e3a89ded-e923-49b1-ba16-08c53edb68be" containerName="istio-proxy"
Oct 30 22:16:31.678146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678130    4918 cpu_manager.go:414] "containerMap: removing container" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy"
Oct 30 22:16:31.678146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678137    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy"
Oct 30 22:16:31.678146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678149    4918 cpu_manager.go:414] "containerMap: removing container" podUID="1fec41f1-9d5d-410f-99ac-299ee5385f24" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678156    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1fec41f1-9d5d-410f-99ac-299ee5385f24" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678165    4918 cpu_manager.go:414] "containerMap: removing container" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678172    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678187    4918 cpu_manager.go:414] "containerMap: removing container" podUID="0856582a-2e5e-4d49-9f58-9cf10c008b41" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678194    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0856582a-2e5e-4d49-9f58-9cf10c008b41" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678204    4918 cpu_manager.go:414] "containerMap: removing container" podUID="8eee972d-c1a3-4b1b-91b9-94f516ccfa85" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678211    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8eee972d-c1a3-4b1b-91b9-94f516ccfa85" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678339    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="7fd08bce-f53b-442f-a87d-767757897c86" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678349    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="61b7bfc4-ac41-46b1-a7f7-952f8745a765" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678358    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d28d1af-b09f-4b11-8590-516816b0d809" containerName="payload-processing"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678372    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="1fec41f1-9d5d-410f-99ac-299ee5385f24" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678383    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="22c64c07-65da-4549-b90c-b5c7a01b516e" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678391    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="c007e243-983e-4de7-8bed-7df4a06e99ad" containerName="maas-api"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678398    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f720a6b-f1b3-4738-9e50-b9c6f5c8e300" containerName="payload-pre-processing"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678407    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="0856582a-2e5e-4d49-9f58-9cf10c008b41" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678417    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="61b7bfc4-ac41-46b1-a7f7-952f8745a765" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678428    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="e3a89ded-e923-49b1-ba16-08c53edb68be" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678435    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="8cf9fa16-1134-4be4-a24a-97e9e6b2d567" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678445    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="1fec41f1-9d5d-410f-99ac-299ee5385f24" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678453    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="a0d3af2f-d2e7-4368-86c1-0b99005186e8" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678463    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="0856582a-2e5e-4d49-9f58-9cf10c008b41" containerName="istio-proxy"
Oct 30 22:16:31.678564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.678472    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="8eee972d-c1a3-4b1b-91b9-94f516ccfa85" containerName="istio-proxy"
Oct 30 22:16:31.684043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.684024    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:31.747334 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.747298    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"]
Oct 30 22:16:31.787479 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.787444    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w4-55beb8-serving-cert\""
Oct 30 22:16:31.847711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.846935    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glkwk\" (UniqueName: \"kubernetes.io/projected/b3766273-8b07-490e-b256-34bfac3b0483-kube-api-access-glkwk\") pod \"maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:31.847711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.847011    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3766273-8b07-490e-b256-34bfac3b0483-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:31.847711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.847156    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:31.847711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.847225    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:31.950771 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.950443    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:31.950771 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.950541    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:31.951038 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.950771    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glkwk\" (UniqueName: \"kubernetes.io/projected/b3766273-8b07-490e-b256-34bfac3b0483-kube-api-access-glkwk\") pod \"maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:31.951038 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.950837    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3766273-8b07-490e-b256-34bfac3b0483-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:31.983705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.982069    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-metrics-certs\") pod \"maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:31.983705 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:16:31.982214    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-serving-cert: secret "maas-api-e2e-shared-a-w4-55beb8-serving-cert" not found
Oct 30 22:16:31.983705 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:16:31.982278    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-maas-api-tls podName:b3766273-8b07-490e-b256-34bfac3b0483 nodeName:}" failed. No retries permitted until 2026-10-30 22:16:32.482256523 +0000 UTC m=+1930.530864210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-maas-api-tls") pod "maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk" (UID: "b3766273-8b07-490e-b256-34bfac3b0483") : secret "maas-api-e2e-shared-a-w4-55beb8-serving-cert" not found
Oct 30 22:16:31.989908 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.989811    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3766273-8b07-490e-b256-34bfac3b0483-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:31.990132 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:31.990074    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:32.160704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:32.137241    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glkwk\" (UniqueName: \"kubernetes.io/projected/b3766273-8b07-490e-b256-34bfac3b0483-kube-api-access-glkwk\") pod \"maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:32.169452 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:32.169404    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1fec41f1-9d5d-410f-99ac-299ee5385f24" path="/var/lib/kubelet/pods/1fec41f1-9d5d-410f-99ac-299ee5385f24/volumes"
Oct 30 22:16:32.172793 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:32.172743    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="22c64c07-65da-4549-b90c-b5c7a01b516e" path="/var/lib/kubelet/pods/22c64c07-65da-4549-b90c-b5c7a01b516e/volumes"
Oct 30 22:16:32.174630 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:32.174606    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8eee972d-c1a3-4b1b-91b9-94f516ccfa85" path="/var/lib/kubelet/pods/8eee972d-c1a3-4b1b-91b9-94f516ccfa85/volumes"
Oct 30 22:16:32.313773 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:32.310619    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:32.320456 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:16:32.320338    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:16:32.483818 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:32.483786    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:32.486278 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:32.486250    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-maas-api-tls\") pod \"maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:32.580394 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:32.580289    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:32.619514 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:32.619485    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:33.016320 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:16:33.016287    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3766273_8b07_490e_b256_34bfac3b0483.slice/crio-bae05c789519819cde67ab83f9b36e2c56d863e8cbd77fdb16670ec23a4bda64 WatchSource:0}: Error finding container bae05c789519819cde67ab83f9b36e2c56d863e8cbd77fdb16670ec23a4bda64: Status 404 returned error can't find the container with id bae05c789519819cde67ab83f9b36e2c56d863e8cbd77fdb16670ec23a4bda64
Oct 30 22:16:33.016781 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:33.016537    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"]
Oct 30 22:16:33.018408 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:33.018385    4918 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:16:33.337374 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:33.337294    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:33.677575 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:33.677524    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk" event={"ID":"b3766273-8b07-490e-b256-34bfac3b0483","Type":"ContainerStarted","Data":"bae05c789519819cde67ab83f9b36e2c56d863e8cbd77fdb16670ec23a4bda64"}
Oct 30 22:16:34.253031 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:34.252991    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:34.523418 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:34.519573    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:34.693653 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:34.691123    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"]
Oct 30 22:16:34.705391 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:34.696017    4918 cpu_manager.go:414] "containerMap: removing container" podUID="61b7bfc4-ac41-46b1-a7f7-952f8745a765" containerName="istio-proxy"
Oct 30 22:16:34.705391 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:34.696042    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61b7bfc4-ac41-46b1-a7f7-952f8745a765" containerName="istio-proxy"
Oct 30 22:16:34.897214 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:34.896880    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:34.917064 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:34.917018    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk" event={"ID":"b3766273-8b07-490e-b256-34bfac3b0483","Type":"ContainerStarted","Data":"c66ab1e1ec24913832e3603dba1acf24cf23d60e947bd99af9c73981c1277890"}
Oct 30 22:16:34.917299 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:34.917284    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:34.917503 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:34.917491    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:34.974153 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:34.970491    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-b8a091-openshift-default-dockercfg-25pm9\""
Oct 30 22:16:34.984138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:34.974544    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"]
Oct 30 22:16:34.988728 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:34.987771    4918 patch_prober.go:29] interesting pod/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:16:34.988728 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:34.987850    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w" podUID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:16:35.040764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.039217    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk" podStartSLOduration=2.954913457 podStartE2EDuration="4.039198225s" totalImagesPullingTime="1.084284768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:35.035517937 +0000 UTC m=+1933.084125633" watchObservedRunningTime="2026-10-30 22:16:35.039198225 +0000 UTC m=+1933.087805921"
Oct 30 22:16:35.049618 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.048473    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wshdk\" (UniqueName: \"kubernetes.io/projected/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-kube-api-access-wshdk\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.049618 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.048713    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-token\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.049618 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.048790    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-credential-socket\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.049618 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.048884    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-envoy\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.049618 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.048959    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istiod-ca-cert\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.049618 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.049015    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-workload-socket\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.049618 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.049050    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-podinfo\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.049618 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.049084    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-workload-certs\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.049618 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.049235    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-data\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.150493 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.150213    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-token\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.150493 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.150270    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-credential-socket\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.150493 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.150318    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-envoy\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.150493 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.150361    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istiod-ca-cert\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.150493 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.150396    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-workload-socket\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.150493 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.150422    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-podinfo\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.150493 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.150444    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-workload-certs\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.170134 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.150542    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-data\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.170134 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.150634    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wshdk\" (UniqueName: \"kubernetes.io/projected/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-kube-api-access-wshdk\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.170134 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.151776    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-credential-socket\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.170134 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.152379    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-workload-socket\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.170134 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.152637    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-workload-certs\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.170134 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.153104    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-data\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.170134 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.154039    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istiod-ca-cert\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.170134 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.156194    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-envoy\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.170134 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.158490    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-podinfo\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.170134 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.159814    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:35.212545 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.212510    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-token\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.212804 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.212662    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wshdk\" (UniqueName: \"kubernetes.io/projected/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-kube-api-access-wshdk\") pod \"e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") " pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.341704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.339986    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:35.414801 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.413610    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:35.884063 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.884033    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"]
Oct 30 22:16:35.886074 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:16:35.886045    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6202640_b4eb_49b4_a93d_ef4b2d7e8d4f.slice/crio-7f6238c3ee56ad8b888033df51a22d70ec74afb9d2cfd1280542f46b0b8d87b6 WatchSource:0}: Error finding container 7f6238c3ee56ad8b888033df51a22d70ec74afb9d2cfd1280542f46b0b8d87b6: Status 404 returned error can't find the container with id 7f6238c3ee56ad8b888033df51a22d70ec74afb9d2cfd1280542f46b0b8d87b6
Oct 30 22:16:35.889749 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.889710    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:16:35.889857 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.889797    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:16:35.889857 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:35.889842    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:16:36.835209 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:36.835169    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5" event={"ID":"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f","Type":"ContainerStarted","Data":"1de595c912a8dac9e34664e2158c69d3cdb08fb0967f713f253f7c15cb6f95ac"}
Oct 30 22:16:36.835900 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:36.835229    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5" event={"ID":"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f","Type":"ContainerStarted","Data":"7f6238c3ee56ad8b888033df51a22d70ec74afb9d2cfd1280542f46b0b8d87b6"}
Oct 30 22:16:37.008464 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:37.008403    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5" podStartSLOduration=3.008386854 podStartE2EDuration="3.008386854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:37.00556671 +0000 UTC m=+1935.054174420" watchObservedRunningTime="2026-10-30 22:16:37.008386854 +0000 UTC m=+1935.056994551"
Oct 30 22:16:37.371989 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:37.340999    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:37.371989 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:37.346850    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:37.491729 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:37.489738    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:37.842430 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:37.842398    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:37.843339 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:37.843322    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:16:38.851358 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:38.851322    4918 generic.go:356] "Generic (PLEG): container finished" podID="e184fc8f-c462-4f29-bbf0-46ab63033f13" containerID="f4bcc12162e521adbaa7871f657160aa28eb34e3ae61a736481008a86d31428d" exitCode=0
Oct 30 22:16:38.851806 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:38.851396    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt" event={"ID":"e184fc8f-c462-4f29-bbf0-46ab63033f13","Type":"ContainerDied","Data":"f4bcc12162e521adbaa7871f657160aa28eb34e3ae61a736481008a86d31428d"}
Oct 30 22:16:38.851910 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:38.851885    4918 scope.go:122] "RemoveContainer" containerID="f4bcc12162e521adbaa7871f657160aa28eb34e3ae61a736481008a86d31428d"
Oct 30 22:16:38.853353 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:38.853328    4918 generic.go:356] "Generic (PLEG): container finished" podID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerID="924952bcfd3712aa07ea3c70804f87cc723ebbaaa14b57ee96b5996d88e3eb07" exitCode=0
Oct 30 22:16:38.853448 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:38.853404    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w" event={"ID":"100bc157-e8bd-4b34-811d-c857cd4e8640","Type":"ContainerDied","Data":"924952bcfd3712aa07ea3c70804f87cc723ebbaaa14b57ee96b5996d88e3eb07"}
Oct 30 22:16:38.853519 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:38.853497    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:16:38.853591 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:38.853574    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:16:38.853635 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:38.853623    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:16:38.854028 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:38.854011    4918 scope.go:122] "RemoveContainer" containerID="924952bcfd3712aa07ea3c70804f87cc723ebbaaa14b57ee96b5996d88e3eb07"
Oct 30 22:16:38.855513 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:38.855486    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:16:38.855632 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:38.855554    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:16:38.855632 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:38.855600    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:16:39.863365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:39.863329    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt" event={"ID":"e184fc8f-c462-4f29-bbf0-46ab63033f13","Type":"ContainerStarted","Data":"fd3fa9ed3d4d83f7207a562059dca395b5708ccf86452aca961e97aa60fd9954"}
Oct 30 22:16:39.865419 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:39.865393    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w" event={"ID":"100bc157-e8bd-4b34-811d-c857cd4e8640","Type":"ContainerStarted","Data":"b276be5f35f45623f912508b6bc36752e5e66a41aa82074fb4a5048f5fc52700"}
Oct 30 22:16:39.923658 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:39.923615    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:16:39.923898 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:39.923787    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 22:16:39.923898 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:39.923843    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt" podUID="e184fc8f-c462-4f29-bbf0-46ab63033f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 22:16:40.039717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:40.037717    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:40.181247 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:40.181217    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:16:40.181435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:40.181389    4918 patch_prober.go:29] interesting pod/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 22:16:40.181500 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:40.181439    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w" podUID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 22:16:40.306707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:40.303236    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:40.848038 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:40.848002    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:16:40.932708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:40.932273    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 22:16:40.932708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:40.932328    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt" podUID="e184fc8f-c462-4f29-bbf0-46ab63033f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 22:16:41.182565 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:41.182082    4918 patch_prober.go:29] interesting pod/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 22:16:41.182565 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:41.182126    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w" podUID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 22:16:41.914707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:41.913948    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 22:16:41.914707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:41.914019    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt" podUID="e184fc8f-c462-4f29-bbf0-46ab63033f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 22:16:42.181784 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:42.181703    4918 patch_prober.go:29] interesting pod/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 22:16:42.181784 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:42.181757    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w" podUID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 22:16:42.351707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:42.351410    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:42.616760 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:42.615753    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:42.929709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:42.922044    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 22:16:42.929709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:42.922104    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt" podUID="e184fc8f-c462-4f29-bbf0-46ab63033f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 22:16:43.182942 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:43.182860    4918 patch_prober.go:29] interesting pod/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 22:16:43.182942 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:43.182921    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w" podUID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 22:16:43.381022 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:43.380983    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:43.685744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:43.684767    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"]
Oct 30 22:16:43.685744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:43.685037    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5" podUID="55d4a550-e7d1-4464-98a8-e7b8204aea78" containerName="istio-proxy" containerID="cri-o://aaa5b65ac4d6e18bf96598f1afd5cf680cc014171f1bf447efcb791733576bc6" gracePeriod=30
Oct 30 22:16:43.805715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:43.804965    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:43.838857 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:43.828603    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:16:43.917384 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:43.893728    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"]
Oct 30 22:16:43.917384 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:43.893973    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc" podUID="11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" containerName="istio-proxy" containerID="cri-o://f4790ab9e2db55ea0be2e7b1e9e7a2e3e862c5496d06988c0e8de7a70ffeacac" gracePeriod=30
Oct 30 22:16:44.013960 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:43.986442    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 22:16:44.013960 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:43.986501    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt" podUID="e184fc8f-c462-4f29-bbf0-46ab63033f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 22:16:44.193400 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:44.193344    4918 patch_prober.go:29] interesting pod/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 22:16:44.194035 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:44.193987    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w" podUID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 22:16:44.452270 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:44.452237    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"]
Oct 30 22:16:44.464146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:44.464091    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"]
Oct 30 22:16:44.464448 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:44.464432    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"
Oct 30 22:16:44.520703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:44.516992    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-b8a091-dockercfg-f4vvs\""
Oct 30 22:16:44.520703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:44.517061    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-b8a091\""
Oct 30 22:16:44.575902 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:44.575872    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/061e5396-ce07-46fe-b478-91d10896e249-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q\" (UID: \"061e5396-ce07-46fe-b478-91d10896e249\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"
Oct 30 22:16:44.576078 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:44.575953    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54kws\" (UniqueName: \"kubernetes.io/projected/061e5396-ce07-46fe-b478-91d10896e249-kube-api-access-54kws\") pod \"payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q\" (UID: \"061e5396-ce07-46fe-b478-91d10896e249\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"
Oct 30 22:16:44.678033 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:44.677985    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/061e5396-ce07-46fe-b478-91d10896e249-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q\" (UID: \"061e5396-ce07-46fe-b478-91d10896e249\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"
Oct 30 22:16:44.678313 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:44.678297    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54kws\" (UniqueName: \"kubernetes.io/projected/061e5396-ce07-46fe-b478-91d10896e249-kube-api-access-54kws\") pod \"payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q\" (UID: \"061e5396-ce07-46fe-b478-91d10896e249\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"
Oct 30 22:16:44.678808 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:44.678788    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/061e5396-ce07-46fe-b478-91d10896e249-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q\" (UID: \"061e5396-ce07-46fe-b478-91d10896e249\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"
Oct 30 22:16:44.744360 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:44.744285    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54kws\" (UniqueName: \"kubernetes.io/projected/061e5396-ce07-46fe-b478-91d10896e249-kube-api-access-54kws\") pod \"payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q\" (UID: \"061e5396-ce07-46fe-b478-91d10896e249\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"
Oct 30 22:16:44.781179 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:44.781154    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"
Oct 30 22:16:44.957777 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:44.954608    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Oct 30 22:16:44.957777 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:44.954668    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt" podUID="e184fc8f-c462-4f29-bbf0-46ab63033f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Oct 30 22:16:45.181351 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:45.181314    4918 patch_prober.go:29] interesting pod/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused" start-of-body=
Oct 30 22:16:45.181550 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:45.181368    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w" podUID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": dial tcp 10.132.0.105:15021: connect: connection refused"
Oct 30 22:16:45.249726 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:45.248859    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"]
Oct 30 22:16:45.251719 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:16:45.251671    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061e5396_ce07_46fe_b478_91d10896e249.slice/crio-5f9dbee77946f1f0d0c8b6110e416c474b6c776aa15c20e8792ebf8704197c06 WatchSource:0}: Error finding container 5f9dbee77946f1f0d0c8b6110e416c474b6c776aa15c20e8792ebf8704197c06: Status 404 returned error can't find the container with id 5f9dbee77946f1f0d0c8b6110e416c474b6c776aa15c20e8792ebf8704197c06
Oct 30 22:16:45.917367 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:45.917337    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:16:45.918573 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:45.918552    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:16:46.076021 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:46.075982    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q" event={"ID":"061e5396-ce07-46fe-b478-91d10896e249","Type":"ContainerStarted","Data":"0079d1f0c2637645f0c15aa796322e4069f353e685a3011502c5762185008f51"}
Oct 30 22:16:46.076206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:46.076040    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q" event={"ID":"061e5396-ce07-46fe-b478-91d10896e249","Type":"ContainerStarted","Data":"5f9dbee77946f1f0d0c8b6110e416c474b6c776aa15c20e8792ebf8704197c06"}
Oct 30 22:16:46.076206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:46.076071    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"
Oct 30 22:16:46.187572 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:46.187488    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:16:46.187959 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:46.187936    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:16:46.188875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:46.188851    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:16:46.416708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:46.407452    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q" podStartSLOduration=3.407432917 podStartE2EDuration="3.407432917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:46.28228957 +0000 UTC m=+1944.330897266" watchObservedRunningTime="2026-10-30 22:16:46.407432917 +0000 UTC m=+1944.456040613"
Oct 30 22:16:47.700043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:47.700008    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:49.068890 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.068864    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:16:49.097022 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.096991    4918 generic.go:356] "Generic (PLEG): container finished" podID="55d4a550-e7d1-4464-98a8-e7b8204aea78" containerID="aaa5b65ac4d6e18bf96598f1afd5cf680cc014171f1bf447efcb791733576bc6" exitCode=0
Oct 30 22:16:49.097164 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.097041    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"
Oct 30 22:16:49.097164 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.097077    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5" event={"ID":"55d4a550-e7d1-4464-98a8-e7b8204aea78","Type":"ContainerDied","Data":"aaa5b65ac4d6e18bf96598f1afd5cf680cc014171f1bf447efcb791733576bc6"}
Oct 30 22:16:49.097164 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.097141    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5" event={"ID":"55d4a550-e7d1-4464-98a8-e7b8204aea78","Type":"ContainerDied","Data":"f536e0dc1c011792ef1df385c9ecb2fa66263d3f1f012a5c3db216f8dec02f94"}
Oct 30 22:16:49.097340 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.097171    4918 scope.go:122] "RemoveContainer" containerID="aaa5b65ac4d6e18bf96598f1afd5cf680cc014171f1bf447efcb791733576bc6"
Oct 30 22:16:49.144633 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.144613    4918 scope.go:122] "RemoveContainer" containerID="aaa5b65ac4d6e18bf96598f1afd5cf680cc014171f1bf447efcb791733576bc6"
Oct 30 22:16:49.145016 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:16:49.144995    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaa5b65ac4d6e18bf96598f1afd5cf680cc014171f1bf447efcb791733576bc6\": container with ID starting with aaa5b65ac4d6e18bf96598f1afd5cf680cc014171f1bf447efcb791733576bc6 not found: ID does not exist" containerID="aaa5b65ac4d6e18bf96598f1afd5cf680cc014171f1bf447efcb791733576bc6"
Oct 30 22:16:49.145084 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.145026    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaa5b65ac4d6e18bf96598f1afd5cf680cc014171f1bf447efcb791733576bc6"} err="failed to get container status \"aaa5b65ac4d6e18bf96598f1afd5cf680cc014171f1bf447efcb791733576bc6\": rpc error: code = NotFound desc = could not find container \"aaa5b65ac4d6e18bf96598f1afd5cf680cc014171f1bf447efcb791733576bc6\": container with ID starting with aaa5b65ac4d6e18bf96598f1afd5cf680cc014171f1bf447efcb791733576bc6 not found: ID does not exist"
Oct 30 22:16:49.150812 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.150793    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/55d4a550-e7d1-4464-98a8-e7b8204aea78-kube-api-access-6jnf2\" (UniqueName: \"kubernetes.io/projected/55d4a550-e7d1-4464-98a8-e7b8204aea78-kube-api-access-6jnf2\") pod \"55d4a550-e7d1-4464-98a8-e7b8204aea78\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") "
Oct 30 22:16:49.150896 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.150822    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/55d4a550-e7d1-4464-98a8-e7b8204aea78-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55d4a550-e7d1-4464-98a8-e7b8204aea78-istiod-ca-cert\") pod \"55d4a550-e7d1-4464-98a8-e7b8204aea78\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") "
Oct 30 22:16:49.150896 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.150885    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-envoy\") pod \"55d4a550-e7d1-4464-98a8-e7b8204aea78\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") "
Oct 30 22:16:49.151011 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.150994    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-credential-socket\") pod \"55d4a550-e7d1-4464-98a8-e7b8204aea78\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") "
Oct 30 22:16:49.151128 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.151050    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-workload-certs\") pod \"55d4a550-e7d1-4464-98a8-e7b8204aea78\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") "
Oct 30 22:16:49.151128 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.151076    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-podinfo\") pod \"55d4a550-e7d1-4464-98a8-e7b8204aea78\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") "
Oct 30 22:16:49.151128 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.151115    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-token\" (UniqueName: \"kubernetes.io/projected/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-token\") pod \"55d4a550-e7d1-4464-98a8-e7b8204aea78\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") "
Oct 30 22:16:49.151293 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.151142    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-workload-socket\") pod \"55d4a550-e7d1-4464-98a8-e7b8204aea78\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") "
Oct 30 22:16:49.151293 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.151173    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-data\") pod \"55d4a550-e7d1-4464-98a8-e7b8204aea78\" (UID: \"55d4a550-e7d1-4464-98a8-e7b8204aea78\") "
Oct 30 22:16:49.151384 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.151337    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55d4a550-e7d1-4464-98a8-e7b8204aea78-istiod-ca-cert" pod "55d4a550-e7d1-4464-98a8-e7b8204aea78" (UID: "55d4a550-e7d1-4464-98a8-e7b8204aea78"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:49.151464 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.151439    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-workload-certs" pod "55d4a550-e7d1-4464-98a8-e7b8204aea78" (UID: "55d4a550-e7d1-4464-98a8-e7b8204aea78"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:49.151595 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.151576    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-credential-socket" pod "55d4a550-e7d1-4464-98a8-e7b8204aea78" (UID: "55d4a550-e7d1-4464-98a8-e7b8204aea78"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:49.151667 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.151593    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-workload-socket" pod "55d4a550-e7d1-4464-98a8-e7b8204aea78" (UID: "55d4a550-e7d1-4464-98a8-e7b8204aea78"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:49.152414 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.152386    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-data" pod "55d4a550-e7d1-4464-98a8-e7b8204aea78" (UID: "55d4a550-e7d1-4464-98a8-e7b8204aea78"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:49.152564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.152499    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.152564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.152522    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.152564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.152539    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55d4a550-e7d1-4464-98a8-e7b8204aea78-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.152564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.152555    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.153444 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.153412    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-envoy" pod "55d4a550-e7d1-4464-98a8-e7b8204aea78" (UID: "55d4a550-e7d1-4464-98a8-e7b8204aea78"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:49.153736 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.153665    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55d4a550-e7d1-4464-98a8-e7b8204aea78-kube-api-access-6jnf2" pod "55d4a550-e7d1-4464-98a8-e7b8204aea78" (UID: "55d4a550-e7d1-4464-98a8-e7b8204aea78"). InnerVolumeSpecName "kube-api-access-6jnf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:49.153736 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.153675    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-token" pod "55d4a550-e7d1-4464-98a8-e7b8204aea78" (UID: "55d4a550-e7d1-4464-98a8-e7b8204aea78"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:49.153940 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.153925    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-podinfo" pod "55d4a550-e7d1-4464-98a8-e7b8204aea78" (UID: "55d4a550-e7d1-4464-98a8-e7b8204aea78"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:16:49.254736 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.254703    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.254736 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.254739    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.254928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.254754    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jnf2\" (UniqueName: \"kubernetes.io/projected/55d4a550-e7d1-4464-98a8-e7b8204aea78-kube-api-access-6jnf2\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.254928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.254770    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.254928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.254783    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55d4a550-e7d1-4464-98a8-e7b8204aea78-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.297512 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.297487    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:16:49.358976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.357455    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-credential-socket\") pod \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") "
Oct 30 22:16:49.358976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.357639    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-kube-api-access-7r85s\" (UniqueName: \"kubernetes.io/projected/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-kube-api-access-7r85s\") pod \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") "
Oct 30 22:16:49.358976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.357733    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-workload-socket\") pod \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") "
Oct 30 22:16:49.358976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.357934    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-envoy\") pod \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") "
Oct 30 22:16:49.358976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.358134    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-data\") pod \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") "
Oct 30 22:16:49.358976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.358192    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-podinfo\") pod \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") "
Oct 30 22:16:49.358976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.358239    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istiod-ca-cert\") pod \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") "
Oct 30 22:16:49.358976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.358410    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-workload-certs\") pod \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") "
Oct 30 22:16:49.358976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.358550    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-token\" (UniqueName: \"kubernetes.io/projected/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-token\") pod \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\" (UID: \"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828\") "
Oct 30 22:16:49.361032 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.361005    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-workload-socket" pod "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" (UID: "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:49.362883 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.362858    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-credential-socket" pod "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" (UID: "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:49.363347 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.363322    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istiod-ca-cert" pod "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" (UID: "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:16:49.364247 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.364200    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-workload-certs" pod "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" (UID: "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:49.364334 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.364253    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-token" pod "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" (UID: "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:49.364742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.364715    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-data" pod "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" (UID: "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:49.366405 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.366374    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-envoy" pod "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" (UID: "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:16:49.366405 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.366383    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-podinfo" pod "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" (UID: "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:16:49.366713 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.366661    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-kube-api-access-7r85s" pod "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" (UID: "11b9e8b3-12d1-4bd7-b896-ba7d0afe7828"). InnerVolumeSpecName "kube-api-access-7r85s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:16:49.461260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.461233    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.461260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.461256    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.461260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.461265    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.461437 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.461274    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.461437 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.461281    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.461437 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.461290    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.461437 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.461298    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r85s\" (UniqueName: \"kubernetes.io/projected/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-kube-api-access-7r85s\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.461437 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.461307    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.461437 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.461315    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:16:49.569100 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.558030    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"]
Oct 30 22:16:49.569100 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:49.559746    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-4bnj5"]
Oct 30 22:16:50.074669 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:50.074636    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="55d4a550-e7d1-4464-98a8-e7b8204aea78" path="/var/lib/kubelet/pods/55d4a550-e7d1-4464-98a8-e7b8204aea78/volumes"
Oct 30 22:16:50.106154 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:50.106125    4918 generic.go:356] "Generic (PLEG): container finished" podID="11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" containerID="f4790ab9e2db55ea0be2e7b1e9e7a2e3e862c5496d06988c0e8de7a70ffeacac" exitCode=0
Oct 30 22:16:50.106285 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:50.106183    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"
Oct 30 22:16:50.106285 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:50.106191    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc" event={"ID":"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828","Type":"ContainerDied","Data":"f4790ab9e2db55ea0be2e7b1e9e7a2e3e862c5496d06988c0e8de7a70ffeacac"}
Oct 30 22:16:50.106285 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:50.106232    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc" event={"ID":"11b9e8b3-12d1-4bd7-b896-ba7d0afe7828","Type":"ContainerDied","Data":"9e446f0baa0e43c1c2487c5f4066f1340222aef890e74d55379f47824869809c"}
Oct 30 22:16:50.106285 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:50.106256    4918 scope.go:122] "RemoveContainer" containerID="f4790ab9e2db55ea0be2e7b1e9e7a2e3e862c5496d06988c0e8de7a70ffeacac"
Oct 30 22:16:50.116847 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:50.116821    4918 scope.go:122] "RemoveContainer" containerID="f4790ab9e2db55ea0be2e7b1e9e7a2e3e862c5496d06988c0e8de7a70ffeacac"
Oct 30 22:16:50.117111 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:16:50.117093    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4790ab9e2db55ea0be2e7b1e9e7a2e3e862c5496d06988c0e8de7a70ffeacac\": container with ID starting with f4790ab9e2db55ea0be2e7b1e9e7a2e3e862c5496d06988c0e8de7a70ffeacac not found: ID does not exist" containerID="f4790ab9e2db55ea0be2e7b1e9e7a2e3e862c5496d06988c0e8de7a70ffeacac"
Oct 30 22:16:50.117159 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:50.117118    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4790ab9e2db55ea0be2e7b1e9e7a2e3e862c5496d06988c0e8de7a70ffeacac"} err="failed to get container status \"f4790ab9e2db55ea0be2e7b1e9e7a2e3e862c5496d06988c0e8de7a70ffeacac\": rpc error: code = NotFound desc = could not find container \"f4790ab9e2db55ea0be2e7b1e9e7a2e3e862c5496d06988c0e8de7a70ffeacac\": container with ID starting with f4790ab9e2db55ea0be2e7b1e9e7a2e3e862c5496d06988c0e8de7a70ffeacac not found: ID does not exist"
Oct 30 22:16:50.272959 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:50.272931    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"]
Oct 30 22:16:50.322079 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:50.322050    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-xcvvc"]
Oct 30 22:16:52.074644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:52.074611    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" path="/var/lib/kubelet/pods/11b9e8b3-12d1-4bd7-b896-ba7d0afe7828/volumes"
Oct 30 22:16:52.691368 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:52.690647    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:53.525389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:53.522656    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:53.976484 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:53.976448    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:54.385620 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.385535    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"]
Oct 30 22:16:54.386286 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.386266    4918 cpu_manager.go:414] "containerMap: removing container" podUID="55d4a550-e7d1-4464-98a8-e7b8204aea78" containerName="istio-proxy"
Oct 30 22:16:54.386410 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.386287    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="55d4a550-e7d1-4464-98a8-e7b8204aea78" containerName="istio-proxy"
Oct 30 22:16:54.386410 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.386356    4918 cpu_manager.go:414] "containerMap: removing container" podUID="11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" containerName="istio-proxy"
Oct 30 22:16:54.386410 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.386364    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" containerName="istio-proxy"
Oct 30 22:16:54.386570 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.386537    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="11b9e8b3-12d1-4bd7-b896-ba7d0afe7828" containerName="istio-proxy"
Oct 30 22:16:54.386570 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.386556    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="55d4a550-e7d1-4464-98a8-e7b8204aea78" containerName="istio-proxy"
Oct 30 22:16:54.389821 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.389801    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.479704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.467325    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w5-2b7317-openshift-default-dockercfg-bqvbr\""
Oct 30 22:16:54.675654 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.675600    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-envoy\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.676460 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.676432    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjxd2\" (UniqueName: \"kubernetes.io/projected/2f4c3406-75c9-4871-b92f-15676af6e5d7-kube-api-access-rjxd2\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.676638 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.676621    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-data\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.676795 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.676778    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-workload-socket\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.676930 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.676915    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-podinfo\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.677124 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.677079    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-token\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.677331 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.677315    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-workload-certs\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.677549 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.677532    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-credential-socket\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.677768 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.677749    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f4c3406-75c9-4871-b92f-15676af6e5d7-istiod-ca-cert\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.678599 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.678566    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:54.830783 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.789993    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-token\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.832303 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.831180    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-workload-certs\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.832579 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.832557    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-credential-socket\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.832717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.832705    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f4c3406-75c9-4871-b92f-15676af6e5d7-istiod-ca-cert\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.832873 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.832857    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-envoy\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.833055 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.833035    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjxd2\" (UniqueName: \"kubernetes.io/projected/2f4c3406-75c9-4871-b92f-15676af6e5d7-kube-api-access-rjxd2\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.833221 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.833205    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-data\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.833358 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.833332    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-credential-socket\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.833522 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.833370    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-workload-socket\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.833652 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.833629    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-workload-socket\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.833749 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.833631    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-podinfo\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.833869 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.833205    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-workload-certs\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.834213 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.834117    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-data\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.835129 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.835100    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f4c3406-75c9-4871-b92f-15676af6e5d7-istiod-ca-cert\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.838120 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.838097    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-podinfo\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.845369 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.845341    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-envoy\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.864639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.864608    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"]
Oct 30 22:16:54.893519 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.893489    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-token\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:54.894213 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:54.894195    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjxd2\" (UniqueName: \"kubernetes.io/projected/2f4c3406-75c9-4871-b92f-15676af6e5d7-kube-api-access-rjxd2\") pod \"e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") " pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:55.014096 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:55.014004    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:55.092567 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:55.092529    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:55.469419 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:16:55.469380    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f4c3406_75c9_4871_b92f_15676af6e5d7.slice/crio-67bcad71457fc7ae3b96c8d73a759b828efdfb632ac0936f90e93abe59d4a914 WatchSource:0}: Error finding container 67bcad71457fc7ae3b96c8d73a759b828efdfb632ac0936f90e93abe59d4a914: Status 404 returned error can't find the container with id 67bcad71457fc7ae3b96c8d73a759b828efdfb632ac0936f90e93abe59d4a914
Oct 30 22:16:55.469885 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:55.469859    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"]
Oct 30 22:16:55.472576 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:55.472543    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:16:55.472723 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:55.472619    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:16:55.472723 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:55.472652    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:16:56.151191 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:56.151154    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp" event={"ID":"2f4c3406-75c9-4871-b92f-15676af6e5d7","Type":"ContainerStarted","Data":"b9693ec12e6832b97d37aef15e067b78afd9949d88391123dd480604d5876129"}
Oct 30 22:16:56.151649 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:56.151219    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp" event={"ID":"2f4c3406-75c9-4871-b92f-15676af6e5d7","Type":"ContainerStarted","Data":"67bcad71457fc7ae3b96c8d73a759b828efdfb632ac0936f90e93abe59d4a914"}
Oct 30 22:16:56.327205 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:56.327143    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp" podStartSLOduration=2.32712575 podStartE2EDuration="2.32712575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:56.322788322 +0000 UTC m=+1954.371396019" watchObservedRunningTime="2026-10-30 22:16:56.32712575 +0000 UTC m=+1954.375733451"
Oct 30 22:16:57.015646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:57.015612    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:57.021696 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:57.021654    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:57.086560 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:57.086540    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"
Oct 30 22:16:57.159632 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:57.159605    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:57.160505 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:57.160485    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:16:58.053345 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:58.053310    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:59.382955 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:59.382915    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:16:59.649107 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:16:59.645523    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:02.472939 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:17:02.472892    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:17:02.704707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:02.701442    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:03.045706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.003342    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:03.045706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.033459    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"]
Oct 30 22:17:03.045706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.041137    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"
Oct 30 22:17:03.084799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.082122    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrvml\" (UniqueName: \"kubernetes.io/projected/844e6de8-25be-467f-a7f5-492b77d45bb8-kube-api-access-rrvml\") pod \"payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw\" (UID: \"844e6de8-25be-467f-a7f5-492b77d45bb8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"
Oct 30 22:17:03.084799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.082196    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/844e6de8-25be-467f-a7f5-492b77d45bb8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw\" (UID: \"844e6de8-25be-467f-a7f5-492b77d45bb8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"
Oct 30 22:17:03.162584 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.162503    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w5-2b7317-dockercfg-78djz\""
Oct 30 22:17:03.229737 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.196924    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w5-2b7317\""
Oct 30 22:17:03.229737 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.196710    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/844e6de8-25be-467f-a7f5-492b77d45bb8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw\" (UID: \"844e6de8-25be-467f-a7f5-492b77d45bb8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"
Oct 30 22:17:03.229737 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.212258    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrvml\" (UniqueName: \"kubernetes.io/projected/844e6de8-25be-467f-a7f5-492b77d45bb8-kube-api-access-rrvml\") pod \"payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw\" (UID: \"844e6de8-25be-467f-a7f5-492b77d45bb8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"
Oct 30 22:17:03.229737 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.213875    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/844e6de8-25be-467f-a7f5-492b77d45bb8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw\" (UID: \"844e6de8-25be-467f-a7f5-492b77d45bb8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"
Oct 30 22:17:03.261209 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.261165    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 22:17:03.421527 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.421482    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"]
Oct 30 22:17:03.421864 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.421842    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"]
Oct 30 22:17:03.446457 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.430909    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"
Oct 30 22:17:03.619721 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.611494    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrnr9\" (UniqueName: \"kubernetes.io/projected/cd38dc35-09e7-4deb-b418-bb5a6a667d93-kube-api-access-wrnr9\") pod \"payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj\" (UID: \"cd38dc35-09e7-4deb-b418-bb5a6a667d93\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"
Oct 30 22:17:03.651725 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.620414    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd38dc35-09e7-4deb-b418-bb5a6a667d93-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj\" (UID: \"cd38dc35-09e7-4deb-b418-bb5a6a667d93\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"
Oct 30 22:17:03.667736 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.660005    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"]
Oct 30 22:17:03.702480 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.702383    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrvml\" (UniqueName: \"kubernetes.io/projected/844e6de8-25be-467f-a7f5-492b77d45bb8-kube-api-access-rrvml\") pod \"payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw\" (UID: \"844e6de8-25be-467f-a7f5-492b77d45bb8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"
Oct 30 22:17:03.731707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.724917    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd38dc35-09e7-4deb-b418-bb5a6a667d93-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj\" (UID: \"cd38dc35-09e7-4deb-b418-bb5a6a667d93\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"
Oct 30 22:17:03.731707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.725117    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrnr9\" (UniqueName: \"kubernetes.io/projected/cd38dc35-09e7-4deb-b418-bb5a6a667d93-kube-api-access-wrnr9\") pod \"payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj\" (UID: \"cd38dc35-09e7-4deb-b418-bb5a6a667d93\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"
Oct 30 22:17:03.731707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.726424    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd38dc35-09e7-4deb-b418-bb5a6a667d93-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj\" (UID: \"cd38dc35-09e7-4deb-b418-bb5a6a667d93\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"
Oct 30 22:17:03.839749 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.838982    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrnr9\" (UniqueName: \"kubernetes.io/projected/cd38dc35-09e7-4deb-b418-bb5a6a667d93-kube-api-access-wrnr9\") pod \"payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj\" (UID: \"cd38dc35-09e7-4deb-b418-bb5a6a667d93\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"
Oct 30 22:17:03.879731 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.876533    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"
Oct 30 22:17:03.960789 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:03.952369    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"
Oct 30 22:17:04.076863 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:04.076815    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:04.247790 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:04.247696    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" probeResult="failure" output="Get \"https://10.132.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:04.264772 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:04.264236    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:17:04.286725 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:04.285756    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:17:04.321866 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:04.321787    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:17:04.906113 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:04.906085    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"]
Oct 30 22:17:04.908174 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:17:04.908142    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod844e6de8_25be_467f_a7f5_492b77d45bb8.slice/crio-b1c137ecb0ac53660b5b7932436c4bae7132d29254bb1a5893cc305fc35b0325 WatchSource:0}: Error finding container b1c137ecb0ac53660b5b7932436c4bae7132d29254bb1a5893cc305fc35b0325: Status 404 returned error can't find the container with id b1c137ecb0ac53660b5b7932436c4bae7132d29254bb1a5893cc305fc35b0325
Oct 30 22:17:05.011504 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:05.011477    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"]
Oct 30 22:17:05.516904 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:05.516858    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj" event={"ID":"cd38dc35-09e7-4deb-b418-bb5a6a667d93","Type":"ContainerStarted","Data":"a420daf8bbe7b21e4d2768e4cb0db40981b41108505c71176a2dee6de66503b5"}
Oct 30 22:17:05.517112 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:05.516943    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"
Oct 30 22:17:05.517112 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:05.516969    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj" event={"ID":"cd38dc35-09e7-4deb-b418-bb5a6a667d93","Type":"ContainerStarted","Data":"96a01d0eda1dbbf79141c90082a7ddaf25cd11a3b51f046964ea03d524d8aa55"}
Oct 30 22:17:05.518752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:05.518720    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw" event={"ID":"844e6de8-25be-467f-a7f5-492b77d45bb8","Type":"ContainerStarted","Data":"1e3d080b13fc20cffc85a2f707912d7fa6c47980727f158920a15a243f336fb9"}
Oct 30 22:17:05.518878 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:05.518776    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw" event={"ID":"844e6de8-25be-467f-a7f5-492b77d45bb8","Type":"ContainerStarted","Data":"b1c137ecb0ac53660b5b7932436c4bae7132d29254bb1a5893cc305fc35b0325"}
Oct 30 22:17:05.518878 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:05.518826    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"
Oct 30 22:17:05.635579 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:05.635521    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj" podStartSLOduration=2.635505618 podStartE2EDuration="2.635505618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:05.632034056 +0000 UTC m=+1963.680641750" watchObservedRunningTime="2026-10-30 22:17:05.635505618 +0000 UTC m=+1963.684113359"
Oct 30 22:17:08.867481 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:08.867442    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:11.928145 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:11.928112    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:12.708325 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:12.708285    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:12.992582 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:12.992503    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:13.768893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:13.768845    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:16.530513 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:16.530482    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"
Oct 30 22:17:16.530964 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:16.530562    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"
Oct 30 22:17:16.683565 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:16.683503    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw" podStartSLOduration=14.683489019 podStartE2EDuration="14.683489019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:05.768266928 +0000 UTC m=+1963.816874624" watchObservedRunningTime="2026-10-30 22:17:16.683489019 +0000 UTC m=+1974.732096716"
Oct 30 22:17:18.568187 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:18.567401    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:23.439771 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:23.439733    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:23.941714 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:23.941667    4918 scope.go:122] "RemoveContainer" containerID="04e72b2c08c691660968833fdbe7f15543506bea3e375ea18149fb56dad834cb"
Oct 30 22:17:24.155912 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:24.155879    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:25.107905 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:25.107875    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:25.409256 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:25.409226    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:28.367724 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:28.362957    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:28.633202 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:28.633114    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:29.100900 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:29.100797    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:32.159591 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:17:32.159558    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:17:33.993064 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:33.993026    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:36.310291 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:36.310257    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"]
Oct 30 22:17:36.310747 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:36.310472    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk" podUID="2eb6b33c-2a62-4cc6-8190-f920964955b0" containerName="istio-proxy" containerID="cri-o://8ed0b7864a7932580bf8ab1e55700900fd8b1da8d3a4a69fa2afc18335d15157" gracePeriod=30
Oct 30 22:17:36.360233 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:36.360203    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"]
Oct 30 22:17:36.360435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:36.360408    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy" containerID="cri-o://8b66ea26f8e72abbcd0d67d901b57e5cb724f454f17cb1a6f7e6730b9b3fdd4c" gracePeriod=30
Oct 30 22:17:36.363827 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:36.363803    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"]
Oct 30 22:17:36.364039 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:36.364016    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d" podUID="ec6596d8-bdf7-40fc-8836-ebc001f5b55c" containerName="istio-proxy" containerID="cri-o://a7ea6c131b78fd224e77037d1dfeff05da4c48dce5da8d1b25bcec77a34ace2a" gracePeriod=30
Oct 30 22:17:36.410230 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:36.410192    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"]
Oct 30 22:17:36.410930 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:36.410745    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb" podUID="8a2a9ec5-5965-4729-97de-52256fafc765" containerName="istio-proxy" containerID="cri-o://6683a4ec9e10279450dd9f7cae81a03f1dca4e23e1f8797788b503894958c4fb" gracePeriod=30
Oct 30 22:17:37.631782 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:37.631748    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:38.300707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:38.300413    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:17:38.300707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:38.300486    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk" podUID="2eb6b33c-2a62-4cc6-8190-f920964955b0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:17:38.865139 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:38.865044    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:39.134761 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:39.130805    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:39.418874 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:39.418833    4918 patch_prober.go:29] interesting pod/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:17:39.419094 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:39.418898    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb" podUID="8a2a9ec5-5965-4729-97de-52256fafc765" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:17:41.837750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.837718    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:17:41.864973 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.864947    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:17:41.929722 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.897876    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:17:41.942339 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.942307    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-data\") pod \"2eb6b33c-2a62-4cc6-8190-f920964955b0\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") "
Oct 30 22:17:41.942501 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.942350    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-token\" (UniqueName: \"kubernetes.io/projected/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-token\") pod \"e8048205-f020-49db-90e0-2c581f8cbc3f\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") "
Oct 30 22:17:41.942501 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.942399    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-workload-socket\") pod \"2eb6b33c-2a62-4cc6-8190-f920964955b0\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") "
Oct 30 22:17:41.942501 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.942438    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-podinfo\") pod \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") "
Oct 30 22:17:41.942501 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.942498    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-workload-certs\") pod \"2eb6b33c-2a62-4cc6-8190-f920964955b0\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") "
Oct 30 22:17:41.942775 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.942574    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-envoy\") pod \"e8048205-f020-49db-90e0-2c581f8cbc3f\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") "
Oct 30 22:17:41.942775 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.942614    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e8048205-f020-49db-90e0-2c581f8cbc3f-kube-api-access-vd2hv\" (UniqueName: \"kubernetes.io/projected/e8048205-f020-49db-90e0-2c581f8cbc3f-kube-api-access-vd2hv\") pod \"e8048205-f020-49db-90e0-2c581f8cbc3f\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") "
Oct 30 22:17:41.942775 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.942648    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-workload-certs\") pod \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") "
Oct 30 22:17:41.942775 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.942674    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2eb6b33c-2a62-4cc6-8190-f920964955b0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eb6b33c-2a62-4cc6-8190-f920964955b0-istiod-ca-cert\") pod \"2eb6b33c-2a62-4cc6-8190-f920964955b0\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") "
Oct 30 22:17:41.942775 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.942769    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-token\" (UniqueName: \"kubernetes.io/projected/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-token\") pod \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") "
Oct 30 22:17:41.943045 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.942770    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-data" pod "2eb6b33c-2a62-4cc6-8190-f920964955b0" (UID: "2eb6b33c-2a62-4cc6-8190-f920964955b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.943045 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.942806    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-token\" (UniqueName: \"kubernetes.io/projected/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-token\") pod \"2eb6b33c-2a62-4cc6-8190-f920964955b0\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") "
Oct 30 22:17:41.943045 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.942851    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istiod-ca-cert\") pod \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") "
Oct 30 22:17:41.943045 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.942881    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-data\") pod \"e8048205-f020-49db-90e0-2c581f8cbc3f\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") "
Oct 30 22:17:41.943045 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.942942    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-podinfo\") pod \"2eb6b33c-2a62-4cc6-8190-f920964955b0\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") "
Oct 30 22:17:41.943045 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.942974    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-envoy\") pod \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") "
Oct 30 22:17:41.943045 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.943005    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-podinfo\") pod \"e8048205-f020-49db-90e0-2c581f8cbc3f\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") "
Oct 30 22:17:41.943390 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.943063    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-credential-socket\") pod \"2eb6b33c-2a62-4cc6-8190-f920964955b0\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") "
Oct 30 22:17:41.943390 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.943168    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-credential-socket\") pod \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") "
Oct 30 22:17:41.943390 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.943198    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2eb6b33c-2a62-4cc6-8190-f920964955b0-kube-api-access-4nch2\" (UniqueName: \"kubernetes.io/projected/2eb6b33c-2a62-4cc6-8190-f920964955b0-kube-api-access-4nch2\") pod \"2eb6b33c-2a62-4cc6-8190-f920964955b0\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") "
Oct 30 22:17:41.943390 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.943265    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-workload-socket\") pod \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") "
Oct 30 22:17:41.943390 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.943294    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e8048205-f020-49db-90e0-2c581f8cbc3f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8048205-f020-49db-90e0-2c581f8cbc3f-istiod-ca-cert\") pod \"e8048205-f020-49db-90e0-2c581f8cbc3f\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") "
Oct 30 22:17:41.943390 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.943338    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-data\") pod \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") "
Oct 30 22:17:41.943390 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.943379    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-workload-socket\") pod \"e8048205-f020-49db-90e0-2c581f8cbc3f\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") "
Oct 30 22:17:41.943817 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.943457    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-workload-certs\") pod \"e8048205-f020-49db-90e0-2c581f8cbc3f\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") "
Oct 30 22:17:41.943817 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.943498    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-workload-socket" pod "2eb6b33c-2a62-4cc6-8190-f920964955b0" (UID: "2eb6b33c-2a62-4cc6-8190-f920964955b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.943817 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.943506    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-envoy\") pod \"2eb6b33c-2a62-4cc6-8190-f920964955b0\" (UID: \"2eb6b33c-2a62-4cc6-8190-f920964955b0\") "
Oct 30 22:17:41.943817 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.943552    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-kube-api-access-fhqj9\" (UniqueName: \"kubernetes.io/projected/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-kube-api-access-fhqj9\") pod \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\" (UID: \"ec6596d8-bdf7-40fc-8836-ebc001f5b55c\") "
Oct 30 22:17:41.943817 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.943591    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-credential-socket\") pod \"e8048205-f020-49db-90e0-2c581f8cbc3f\" (UID: \"e8048205-f020-49db-90e0-2c581f8cbc3f\") "
Oct 30 22:17:41.945717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.944570    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-workload-certs" pod "2eb6b33c-2a62-4cc6-8190-f920964955b0" (UID: "2eb6b33c-2a62-4cc6-8190-f920964955b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.945717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.944741    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:41.945717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.944763    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:41.945717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.944777    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:41.945717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.944841    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-data" pod "e8048205-f020-49db-90e0-2c581f8cbc3f" (UID: "e8048205-f020-49db-90e0-2c581f8cbc3f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.945717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.944980    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-data" pod "ec6596d8-bdf7-40fc-8836-ebc001f5b55c" (UID: "ec6596d8-bdf7-40fc-8836-ebc001f5b55c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.945717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.945071    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-credential-socket" pod "ec6596d8-bdf7-40fc-8836-ebc001f5b55c" (UID: "ec6596d8-bdf7-40fc-8836-ebc001f5b55c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.945717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.945101    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istiod-ca-cert" pod "ec6596d8-bdf7-40fc-8836-ebc001f5b55c" (UID: "ec6596d8-bdf7-40fc-8836-ebc001f5b55c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:17:41.945717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.945176    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-workload-socket" pod "e8048205-f020-49db-90e0-2c581f8cbc3f" (UID: "e8048205-f020-49db-90e0-2c581f8cbc3f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.945717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.945282    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-credential-socket" pod "2eb6b33c-2a62-4cc6-8190-f920964955b0" (UID: "2eb6b33c-2a62-4cc6-8190-f920964955b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.945717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.945372    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-workload-certs" pod "e8048205-f020-49db-90e0-2c581f8cbc3f" (UID: "e8048205-f020-49db-90e0-2c581f8cbc3f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.945717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.945443    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8048205-f020-49db-90e0-2c581f8cbc3f-istiod-ca-cert" pod "e8048205-f020-49db-90e0-2c581f8cbc3f" (UID: "e8048205-f020-49db-90e0-2c581f8cbc3f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:17:41.946417 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.945916    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-workload-certs" pod "ec6596d8-bdf7-40fc-8836-ebc001f5b55c" (UID: "ec6596d8-bdf7-40fc-8836-ebc001f5b55c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.946417 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.945933    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-workload-socket" pod "ec6596d8-bdf7-40fc-8836-ebc001f5b55c" (UID: "ec6596d8-bdf7-40fc-8836-ebc001f5b55c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.946417 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.946061    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eb6b33c-2a62-4cc6-8190-f920964955b0-istiod-ca-cert" pod "2eb6b33c-2a62-4cc6-8190-f920964955b0" (UID: "2eb6b33c-2a62-4cc6-8190-f920964955b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:17:41.946586 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.946504    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-credential-socket" pod "e8048205-f020-49db-90e0-2c581f8cbc3f" (UID: "e8048205-f020-49db-90e0-2c581f8cbc3f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.946748 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.946722    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-envoy" pod "e8048205-f020-49db-90e0-2c581f8cbc3f" (UID: "e8048205-f020-49db-90e0-2c581f8cbc3f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.948227 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.947616    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-token" pod "e8048205-f020-49db-90e0-2c581f8cbc3f" (UID: "e8048205-f020-49db-90e0-2c581f8cbc3f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:41.948395 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.948369    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eb6b33c-2a62-4cc6-8190-f920964955b0-kube-api-access-4nch2" pod "2eb6b33c-2a62-4cc6-8190-f920964955b0" (UID: "2eb6b33c-2a62-4cc6-8190-f920964955b0"). InnerVolumeSpecName "kube-api-access-4nch2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:41.951053 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.951027    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-envoy" pod "2eb6b33c-2a62-4cc6-8190-f920964955b0" (UID: "2eb6b33c-2a62-4cc6-8190-f920964955b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.951162 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.951093    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-token" pod "ec6596d8-bdf7-40fc-8836-ebc001f5b55c" (UID: "ec6596d8-bdf7-40fc-8836-ebc001f5b55c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:41.951228 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.951180    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-token" pod "2eb6b33c-2a62-4cc6-8190-f920964955b0" (UID: "2eb6b33c-2a62-4cc6-8190-f920964955b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:41.952277 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.952146    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-podinfo" pod "e8048205-f020-49db-90e0-2c581f8cbc3f" (UID: "e8048205-f020-49db-90e0-2c581f8cbc3f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:17:41.952277 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.952190    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-podinfo" pod "ec6596d8-bdf7-40fc-8836-ebc001f5b55c" (UID: "ec6596d8-bdf7-40fc-8836-ebc001f5b55c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:17:41.952524 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.952329    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-kube-api-access-fhqj9" pod "ec6596d8-bdf7-40fc-8836-ebc001f5b55c" (UID: "ec6596d8-bdf7-40fc-8836-ebc001f5b55c"). InnerVolumeSpecName "kube-api-access-fhqj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:41.952970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.952657    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8048205-f020-49db-90e0-2c581f8cbc3f-kube-api-access-vd2hv" pod "e8048205-f020-49db-90e0-2c581f8cbc3f" (UID: "e8048205-f020-49db-90e0-2c581f8cbc3f"). InnerVolumeSpecName "kube-api-access-vd2hv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:41.952970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.952867    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-envoy" pod "ec6596d8-bdf7-40fc-8836-ebc001f5b55c" (UID: "ec6596d8-bdf7-40fc-8836-ebc001f5b55c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:41.953765 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.953737    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-podinfo" pod "2eb6b33c-2a62-4cc6-8190-f920964955b0" (UID: "2eb6b33c-2a62-4cc6-8190-f920964955b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:17:41.965896 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:41.965771    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:17:42.043076 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.043045    4918 generic.go:356] "Generic (PLEG): container finished" podID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerID="8b66ea26f8e72abbcd0d67d901b57e5cb724f454f17cb1a6f7e6730b9b3fdd4c" exitCode=0
Oct 30 22:17:42.043261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.043108    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"
Oct 30 22:17:42.043261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.043128    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" event={"ID":"e8048205-f020-49db-90e0-2c581f8cbc3f","Type":"ContainerDied","Data":"8b66ea26f8e72abbcd0d67d901b57e5cb724f454f17cb1a6f7e6730b9b3fdd4c"}
Oct 30 22:17:42.043261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.043229    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf" event={"ID":"e8048205-f020-49db-90e0-2c581f8cbc3f","Type":"ContainerDied","Data":"6896e3b4477ac239bf7e1a6b1e5fb1f975d30d9209e3fa6754314332082a1c1f"}
Oct 30 22:17:42.043435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.043262    4918 scope.go:122] "RemoveContainer" containerID="8b66ea26f8e72abbcd0d67d901b57e5cb724f454f17cb1a6f7e6730b9b3fdd4c"
Oct 30 22:17:42.045538 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.045187    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a2a9ec5-5965-4729-97de-52256fafc765-kube-api-access-7jlk5\" (UniqueName: \"kubernetes.io/projected/8a2a9ec5-5965-4729-97de-52256fafc765-kube-api-access-7jlk5\") pod \"8a2a9ec5-5965-4729-97de-52256fafc765\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") "
Oct 30 22:17:42.045538 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.045233    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a2a9ec5-5965-4729-97de-52256fafc765-istio-token\" (UniqueName: \"kubernetes.io/projected/8a2a9ec5-5965-4729-97de-52256fafc765-istio-token\") pod \"8a2a9ec5-5965-4729-97de-52256fafc765\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") "
Oct 30 22:17:42.045538 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.045293    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-workload-certs\") pod \"8a2a9ec5-5965-4729-97de-52256fafc765\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") "
Oct 30 22:17:42.045538 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.045504    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-istio-data\") pod \"8a2a9ec5-5965-4729-97de-52256fafc765\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") "
Oct 30 22:17:42.045958 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.045571    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-credential-socket\") pod \"8a2a9ec5-5965-4729-97de-52256fafc765\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") "
Oct 30 22:17:42.045958 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.045752    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-istio-envoy\") pod \"8a2a9ec5-5965-4729-97de-52256fafc765\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") "
Oct 30 22:17:42.045958 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.045813    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8a2a9ec5-5965-4729-97de-52256fafc765-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a2a9ec5-5965-4729-97de-52256fafc765-istiod-ca-cert\") pod \"8a2a9ec5-5965-4729-97de-52256fafc765\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") "
Oct 30 22:17:42.045958 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.045839    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-istio-data" pod "8a2a9ec5-5965-4729-97de-52256fafc765" (UID: "8a2a9ec5-5965-4729-97de-52256fafc765"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:42.045958 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.045900    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-workload-socket\") pod \"8a2a9ec5-5965-4729-97de-52256fafc765\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") "
Oct 30 22:17:42.045958 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.045911    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-credential-socket" pod "8a2a9ec5-5965-4729-97de-52256fafc765" (UID: "8a2a9ec5-5965-4729-97de-52256fafc765"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:42.045958 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.045936    4918 generic.go:356] "Generic (PLEG): container finished" podID="8a2a9ec5-5965-4729-97de-52256fafc765" containerID="6683a4ec9e10279450dd9f7cae81a03f1dca4e23e1f8797788b503894958c4fb" exitCode=0
Oct 30 22:17:42.046422 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.045998    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8a2a9ec5-5965-4729-97de-52256fafc765-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a2a9ec5-5965-4729-97de-52256fafc765-istio-podinfo\") pod \"8a2a9ec5-5965-4729-97de-52256fafc765\" (UID: \"8a2a9ec5-5965-4729-97de-52256fafc765\") "
Oct 30 22:17:42.046422 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046016    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"
Oct 30 22:17:42.046422 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046048    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb" event={"ID":"8a2a9ec5-5965-4729-97de-52256fafc765","Type":"ContainerDied","Data":"6683a4ec9e10279450dd9f7cae81a03f1dca4e23e1f8797788b503894958c4fb"}
Oct 30 22:17:42.046422 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046088    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb" event={"ID":"8a2a9ec5-5965-4729-97de-52256fafc765","Type":"ContainerDied","Data":"fe2e69b3af1a5b77f77119bf2f52d56f5f8aaf1a7886c9eed35f1f72fde48d8b"}
Oct 30 22:17:42.046422 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046154    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-workload-certs" pod "8a2a9ec5-5965-4729-97de-52256fafc765" (UID: "8a2a9ec5-5965-4729-97de-52256fafc765"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:42.046422 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046351    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-workload-socket" pod "8a2a9ec5-5965-4729-97de-52256fafc765" (UID: "8a2a9ec5-5965-4729-97de-52256fafc765"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:42.046876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046432    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a2a9ec5-5965-4729-97de-52256fafc765-istiod-ca-cert" pod "8a2a9ec5-5965-4729-97de-52256fafc765" (UID: "8a2a9ec5-5965-4729-97de-52256fafc765"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:17:42.046876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046667    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.046876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046710    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.046876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046726    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.046876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046742    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.046876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046756    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.046876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046770    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.046876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046783    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.046876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046798    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.046876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046814    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nch2\" (UniqueName: \"kubernetes.io/projected/2eb6b33c-2a62-4cc6-8190-f920964955b0-kube-api-access-4nch2\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.046876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046829    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.046876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046842    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8048205-f020-49db-90e0-2c581f8cbc3f-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.046876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046856    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.046876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046869    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.046876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046883    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.048423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046897    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.048423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046912    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhqj9\" (UniqueName: \"kubernetes.io/projected/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-kube-api-access-fhqj9\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.048423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046924    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.048423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046938    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.048423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046951    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.048423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046964    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.048423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046977    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.048423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.046990    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8048205-f020-49db-90e0-2c581f8cbc3f-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.048423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.047004    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a2a9ec5-5965-4729-97de-52256fafc765-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.048423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.047017    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd2hv\" (UniqueName: \"kubernetes.io/projected/e8048205-f020-49db-90e0-2c581f8cbc3f-kube-api-access-vd2hv\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.048423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.047030    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.048423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.047043    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2eb6b33c-2a62-4cc6-8190-f920964955b0-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.048423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.047055    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.048423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.047069    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2eb6b33c-2a62-4cc6-8190-f920964955b0-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.048423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.047081    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec6596d8-bdf7-40fc-8836-ebc001f5b55c-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.049260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.048736    4918 generic.go:356] "Generic (PLEG): container finished" podID="2eb6b33c-2a62-4cc6-8190-f920964955b0" containerID="8ed0b7864a7932580bf8ab1e55700900fd8b1da8d3a4a69fa2afc18335d15157" exitCode=0
Oct 30 22:17:42.049260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.048915    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk" event={"ID":"2eb6b33c-2a62-4cc6-8190-f920964955b0","Type":"ContainerDied","Data":"8ed0b7864a7932580bf8ab1e55700900fd8b1da8d3a4a69fa2afc18335d15157"}
Oct 30 22:17:42.049260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.048935    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a2a9ec5-5965-4729-97de-52256fafc765-istio-token" pod "8a2a9ec5-5965-4729-97de-52256fafc765" (UID: "8a2a9ec5-5965-4729-97de-52256fafc765"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:42.049260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.048955    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk" event={"ID":"2eb6b33c-2a62-4cc6-8190-f920964955b0","Type":"ContainerDied","Data":"04c322a620ad537f2a4e7501a618e72aa20c142bfdd234a5a9aa06dadb6806c1"}
Oct 30 22:17:42.049260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.048970    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a2a9ec5-5965-4729-97de-52256fafc765-istio-podinfo" pod "8a2a9ec5-5965-4729-97de-52256fafc765" (UID: "8a2a9ec5-5965-4729-97de-52256fafc765"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:17:42.049260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.049002    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"
Oct 30 22:17:42.051283 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.051256    4918 generic.go:356] "Generic (PLEG): container finished" podID="ec6596d8-bdf7-40fc-8836-ebc001f5b55c" containerID="a7ea6c131b78fd224e77037d1dfeff05da4c48dce5da8d1b25bcec77a34ace2a" exitCode=0
Oct 30 22:17:42.051397 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.051304    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"
Oct 30 22:17:42.051397 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.051378    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d" event={"ID":"ec6596d8-bdf7-40fc-8836-ebc001f5b55c","Type":"ContainerDied","Data":"a7ea6c131b78fd224e77037d1dfeff05da4c48dce5da8d1b25bcec77a34ace2a"}
Oct 30 22:17:42.051508 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.051416    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d" event={"ID":"ec6596d8-bdf7-40fc-8836-ebc001f5b55c","Type":"ContainerDied","Data":"a03e64488a8ab18a46e2bdb2841a075bdf11d7e32ac8a3a036eaa22ebd9f5dac"}
Oct 30 22:17:42.055136 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.055113    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-istio-envoy" pod "8a2a9ec5-5965-4729-97de-52256fafc765" (UID: "8a2a9ec5-5965-4729-97de-52256fafc765"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:17:42.055136 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.055122    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a2a9ec5-5965-4729-97de-52256fafc765-kube-api-access-7jlk5" pod "8a2a9ec5-5965-4729-97de-52256fafc765" (UID: "8a2a9ec5-5965-4729-97de-52256fafc765"). InnerVolumeSpecName "kube-api-access-7jlk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:17:42.057328 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.057311    4918 scope.go:122] "RemoveContainer" containerID="8b66ea26f8e72abbcd0d67d901b57e5cb724f454f17cb1a6f7e6730b9b3fdd4c"
Oct 30 22:17:42.057614 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:17:42.057590    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b66ea26f8e72abbcd0d67d901b57e5cb724f454f17cb1a6f7e6730b9b3fdd4c\": container with ID starting with 8b66ea26f8e72abbcd0d67d901b57e5cb724f454f17cb1a6f7e6730b9b3fdd4c not found: ID does not exist" containerID="8b66ea26f8e72abbcd0d67d901b57e5cb724f454f17cb1a6f7e6730b9b3fdd4c"
Oct 30 22:17:42.057739 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.057627    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b66ea26f8e72abbcd0d67d901b57e5cb724f454f17cb1a6f7e6730b9b3fdd4c"} err="failed to get container status \"8b66ea26f8e72abbcd0d67d901b57e5cb724f454f17cb1a6f7e6730b9b3fdd4c\": rpc error: code = NotFound desc = could not find container \"8b66ea26f8e72abbcd0d67d901b57e5cb724f454f17cb1a6f7e6730b9b3fdd4c\": container with ID starting with 8b66ea26f8e72abbcd0d67d901b57e5cb724f454f17cb1a6f7e6730b9b3fdd4c not found: ID does not exist"
Oct 30 22:17:42.057739 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.057651    4918 scope.go:122] "RemoveContainer" containerID="6683a4ec9e10279450dd9f7cae81a03f1dca4e23e1f8797788b503894958c4fb"
Oct 30 22:17:42.076301 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.076278    4918 scope.go:122] "RemoveContainer" containerID="6683a4ec9e10279450dd9f7cae81a03f1dca4e23e1f8797788b503894958c4fb"
Oct 30 22:17:42.076613 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:17:42.076586    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6683a4ec9e10279450dd9f7cae81a03f1dca4e23e1f8797788b503894958c4fb\": container with ID starting with 6683a4ec9e10279450dd9f7cae81a03f1dca4e23e1f8797788b503894958c4fb not found: ID does not exist" containerID="6683a4ec9e10279450dd9f7cae81a03f1dca4e23e1f8797788b503894958c4fb"
Oct 30 22:17:42.076845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.076621    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6683a4ec9e10279450dd9f7cae81a03f1dca4e23e1f8797788b503894958c4fb"} err="failed to get container status \"6683a4ec9e10279450dd9f7cae81a03f1dca4e23e1f8797788b503894958c4fb\": rpc error: code = NotFound desc = could not find container \"6683a4ec9e10279450dd9f7cae81a03f1dca4e23e1f8797788b503894958c4fb\": container with ID starting with 6683a4ec9e10279450dd9f7cae81a03f1dca4e23e1f8797788b503894958c4fb not found: ID does not exist"
Oct 30 22:17:42.076845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.076643    4918 scope.go:122] "RemoveContainer" containerID="8ed0b7864a7932580bf8ab1e55700900fd8b1da8d3a4a69fa2afc18335d15157"
Oct 30 22:17:42.088044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.088017    4918 scope.go:122] "RemoveContainer" containerID="8ed0b7864a7932580bf8ab1e55700900fd8b1da8d3a4a69fa2afc18335d15157"
Oct 30 22:17:42.088364 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:17:42.088322    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ed0b7864a7932580bf8ab1e55700900fd8b1da8d3a4a69fa2afc18335d15157\": container with ID starting with 8ed0b7864a7932580bf8ab1e55700900fd8b1da8d3a4a69fa2afc18335d15157 not found: ID does not exist" containerID="8ed0b7864a7932580bf8ab1e55700900fd8b1da8d3a4a69fa2afc18335d15157"
Oct 30 22:17:42.088364 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.088347    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ed0b7864a7932580bf8ab1e55700900fd8b1da8d3a4a69fa2afc18335d15157"} err="failed to get container status \"8ed0b7864a7932580bf8ab1e55700900fd8b1da8d3a4a69fa2afc18335d15157\": rpc error: code = NotFound desc = could not find container \"8ed0b7864a7932580bf8ab1e55700900fd8b1da8d3a4a69fa2afc18335d15157\": container with ID starting with 8ed0b7864a7932580bf8ab1e55700900fd8b1da8d3a4a69fa2afc18335d15157 not found: ID does not exist"
Oct 30 22:17:42.088517 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.088369    4918 scope.go:122] "RemoveContainer" containerID="a7ea6c131b78fd224e77037d1dfeff05da4c48dce5da8d1b25bcec77a34ace2a"
Oct 30 22:17:42.139496 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.139466    4918 scope.go:122] "RemoveContainer" containerID="a7ea6c131b78fd224e77037d1dfeff05da4c48dce5da8d1b25bcec77a34ace2a"
Oct 30 22:17:42.139992 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:17:42.139933    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7ea6c131b78fd224e77037d1dfeff05da4c48dce5da8d1b25bcec77a34ace2a\": container with ID starting with a7ea6c131b78fd224e77037d1dfeff05da4c48dce5da8d1b25bcec77a34ace2a not found: ID does not exist" containerID="a7ea6c131b78fd224e77037d1dfeff05da4c48dce5da8d1b25bcec77a34ace2a"
Oct 30 22:17:42.139992 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.139979    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7ea6c131b78fd224e77037d1dfeff05da4c48dce5da8d1b25bcec77a34ace2a"} err="failed to get container status \"a7ea6c131b78fd224e77037d1dfeff05da4c48dce5da8d1b25bcec77a34ace2a\": rpc error: code = NotFound desc = could not find container \"a7ea6c131b78fd224e77037d1dfeff05da4c48dce5da8d1b25bcec77a34ace2a\": container with ID starting with a7ea6c131b78fd224e77037d1dfeff05da4c48dce5da8d1b25bcec77a34ace2a not found: ID does not exist"
Oct 30 22:17:42.148503 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.148479    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a2a9ec5-5965-4729-97de-52256fafc765-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.148614 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.148516    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a2a9ec5-5965-4729-97de-52256fafc765-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.148614 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.148531    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jlk5\" (UniqueName: \"kubernetes.io/projected/8a2a9ec5-5965-4729-97de-52256fafc765-kube-api-access-7jlk5\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.148614 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.148544    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a2a9ec5-5965-4729-97de-52256fafc765-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:17:42.549958 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.549919    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"]
Oct 30 22:17:42.556596 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.556566    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-nfj7d"]
Oct 30 22:17:42.672160 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.672121    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"]
Oct 30 22:17:42.676486 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.676454    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-klkpk"]
Oct 30 22:17:42.785330 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.785296    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"]
Oct 30 22:17:42.789535 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.789509    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-4zplf"]
Oct 30 22:17:42.923127 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.923092    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"]
Oct 30 22:17:42.928199 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:42.928176    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-a7b06b-openshift-default-d79c4d5dc-jhrdb"]
Oct 30 22:17:43.261914 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:43.261838    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:43.568959 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:43.568876    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:43.835715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:43.835605    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:44.075506 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.075470    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2eb6b33c-2a62-4cc6-8190-f920964955b0" path="/var/lib/kubelet/pods/2eb6b33c-2a62-4cc6-8190-f920964955b0/volumes"
Oct 30 22:17:44.076080 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.076062    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a2a9ec5-5965-4729-97de-52256fafc765" path="/var/lib/kubelet/pods/8a2a9ec5-5965-4729-97de-52256fafc765/volumes"
Oct 30 22:17:44.076503 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.076490    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" path="/var/lib/kubelet/pods/e8048205-f020-49db-90e0-2c581f8cbc3f/volumes"
Oct 30 22:17:44.077417 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.077395    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ec6596d8-bdf7-40fc-8836-ebc001f5b55c" path="/var/lib/kubelet/pods/ec6596d8-bdf7-40fc-8836-ebc001f5b55c/volumes"
Oct 30 22:17:44.099598 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.099539    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"]
Oct 30 22:17:44.100451 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.100435    4918 cpu_manager.go:414] "containerMap: removing container" podUID="8a2a9ec5-5965-4729-97de-52256fafc765" containerName="istio-proxy"
Oct 30 22:17:44.100504 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.100454    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a2a9ec5-5965-4729-97de-52256fafc765" containerName="istio-proxy"
Oct 30 22:17:44.100504 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.100479    4918 cpu_manager.go:414] "containerMap: removing container" podUID="2eb6b33c-2a62-4cc6-8190-f920964955b0" containerName="istio-proxy"
Oct 30 22:17:44.100504 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.100487    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2eb6b33c-2a62-4cc6-8190-f920964955b0" containerName="istio-proxy"
Oct 30 22:17:44.100598 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.100506    4918 cpu_manager.go:414] "containerMap: removing container" podUID="ec6596d8-bdf7-40fc-8836-ebc001f5b55c" containerName="istio-proxy"
Oct 30 22:17:44.100598 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.100514    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ec6596d8-bdf7-40fc-8836-ebc001f5b55c" containerName="istio-proxy"
Oct 30 22:17:44.100598 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.100545    4918 cpu_manager.go:414] "containerMap: removing container" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy"
Oct 30 22:17:44.100598 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.100552    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy"
Oct 30 22:17:44.100749 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.100698    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a2a9ec5-5965-4729-97de-52256fafc765" containerName="istio-proxy"
Oct 30 22:17:44.100749 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.100714    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="2eb6b33c-2a62-4cc6-8190-f920964955b0" containerName="istio-proxy"
Oct 30 22:17:44.100749 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.100724    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="ec6596d8-bdf7-40fc-8836-ebc001f5b55c" containerName="istio-proxy"
Oct 30 22:17:44.100749 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.100738    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="e8048205-f020-49db-90e0-2c581f8cbc3f" containerName="istio-proxy"
Oct 30 22:17:44.106366 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.106348    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:44.160317 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.160292    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-b8a091-serving-cert\""
Oct 30 22:17:44.164625 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.164602    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"]
Oct 30 22:17:44.182537 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.182501    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt6mh\" (UniqueName: \"kubernetes.io/projected/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-kube-api-access-rt6mh\") pod \"maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:44.183054 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.182845    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:44.183054 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.182884    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:44.183054 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.183000    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:44.284204 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.284167    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt6mh\" (UniqueName: \"kubernetes.io/projected/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-kube-api-access-rt6mh\") pod \"maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:44.284333 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.284309    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:44.284381 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.284332    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:44.284422 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.284406    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:44.284484 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:17:44.284468    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-serving-cert: secret "maas-api-e2e-shared-b-w3-b8a091-serving-cert" not found
Oct 30 22:17:44.284549 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:17:44.284538    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-maas-api-tls podName:cbd3d21b-6f89-4eaa-98eb-d83a9de11d64 nodeName:}" failed. No retries permitted until 2026-10-30 22:17:44.784516158 +0000 UTC m=+2002.833123851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-maas-api-tls") pod "maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m" (UID: "cbd3d21b-6f89-4eaa-98eb-d83a9de11d64") : secret "maas-api-e2e-shared-b-w3-b8a091-serving-cert" not found
Oct 30 22:17:44.285055 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.285032    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:44.287226 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.287206    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:44.351535 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.351457    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt6mh\" (UniqueName: \"kubernetes.io/projected/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-kube-api-access-rt6mh\") pod \"maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:44.697710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.695259    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:44.795546 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.795513    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:44.798449 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.798422    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:44.944532 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:44.944499    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:45.020215 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.020149    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:45.247658 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.247614    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:45.446960 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.446870    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"]
Oct 30 22:17:45.762279 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.762204    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"]
Oct 30 22:17:45.767953 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.767929    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.821735 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.820798    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w4-d1ca4b-openshift-default-dockercfg-8dwbj\""
Oct 30 22:17:45.838379 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.838346    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-token\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.838566 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.838454    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-data\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.838566 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.838485    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-envoy\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.838649 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.838589    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-workload-certs\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.838649 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.838640    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvfc5\" (UniqueName: \"kubernetes.io/projected/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-kube-api-access-fvfc5\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.838759 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.838671    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istiod-ca-cert\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.838810 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.838796    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-workload-socket\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.838846 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.838836    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-podinfo\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.838883 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.838859    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-credential-socket\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.874509 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.874467    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"]
Oct 30 22:17:45.946710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.943025    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-data\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.946710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.943094    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-envoy\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.946710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.943200    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-workload-certs\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.985845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.972501    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-data\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.985845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.981424    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-workload-certs\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.985845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.981619    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvfc5\" (UniqueName: \"kubernetes.io/projected/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-kube-api-access-fvfc5\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.985845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.981667    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istiod-ca-cert\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.985845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.981742    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-workload-socket\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.985845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.981790    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-podinfo\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.985845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.981827    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-credential-socket\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.985845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.982011    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-token\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.987591 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.986824    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-credential-socket\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.987591 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.987096    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-workload-socket\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:45.990906 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:45.989365    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istiod-ca-cert\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:46.026845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:46.002184    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:46.026845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:46.020556    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-envoy\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:46.036362 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:46.036286    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-podinfo\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:46.057989 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:46.057887    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-token\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:46.110753 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:46.097382    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvfc5\" (UniqueName: \"kubernetes.io/projected/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-kube-api-access-fvfc5\") pod \"e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") " pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:46.159975 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:46.159929    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m" event={"ID":"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64","Type":"ContainerStarted","Data":"46ee00a42e4be4d63e049d7ee9f1eea8980e0631ed096042e51488aea1659efd"}
Oct 30 22:17:46.267727 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:46.267692    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:46.383638 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:46.383605    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:46.919641 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:46.917333    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"]
Oct 30 22:17:46.933816 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:46.928066    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:46.933816 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:17:46.932365    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4ed359a_7eea_49c4_b2b9_0c9ca46393d6.slice/crio-d7888a9f398a593b77cd6aa53078254579f52c9f735317ee83b704a3290a0749 WatchSource:0}: Error finding container d7888a9f398a593b77cd6aa53078254579f52c9f735317ee83b704a3290a0749: Status 404 returned error can't find the container with id d7888a9f398a593b77cd6aa53078254579f52c9f735317ee83b704a3290a0749
Oct 30 22:17:46.935839 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:46.935657    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:17:46.935839 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:46.935779    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:17:46.935839 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:46.935827    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:17:47.173114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.173033    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m" event={"ID":"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64","Type":"ContainerStarted","Data":"b3ae914d7fea898cb855300f8babab093924c0f26987258456cc0e5df6d29717"}
Oct 30 22:17:47.173672 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.173651    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:47.175556 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.175538    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n" event={"ID":"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6","Type":"ContainerStarted","Data":"a9f5102059e43d895d91cae02c3deafbbb925ba13fdd048b326573ebf11dbe6a"}
Oct 30 22:17:47.175721 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.175675    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n" event={"ID":"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6","Type":"ContainerStarted","Data":"d7888a9f398a593b77cd6aa53078254579f52c9f735317ee83b704a3290a0749"}
Oct 30 22:17:47.200799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.200768    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:47.221503 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.221476    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"]
Oct 30 22:17:47.237128 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.237100    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"
Oct 30 22:17:47.300363 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.300332    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-a1024a\""
Oct 30 22:17:47.301140 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.301093    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-a1024a-dockercfg-b9g5m\""
Oct 30 22:17:47.369373 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.350190    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/304dcc1f-95a3-4265-addf-52fcd249ea24-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b\" (UID: \"304dcc1f-95a3-4265-addf-52fcd249ea24\") " pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"
Oct 30 22:17:47.369373 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.350377    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cndk6\" (UniqueName: \"kubernetes.io/projected/304dcc1f-95a3-4265-addf-52fcd249ea24-kube-api-access-cndk6\") pod \"payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b\" (UID: \"304dcc1f-95a3-4265-addf-52fcd249ea24\") " pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"
Oct 30 22:17:47.390624 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.390595    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"]
Oct 30 22:17:47.398172 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.398133    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:47.399997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.399947    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m" podStartSLOduration=2.455668244 podStartE2EDuration="3.327657132s" totalImagesPullingTime="871.988888ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:47.305025496 +0000 UTC m=+2005.353633192" watchObservedRunningTime="2026-10-30 22:17:47.327657132 +0000 UTC m=+2005.376264832"
Oct 30 22:17:47.471789 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.459872    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/304dcc1f-95a3-4265-addf-52fcd249ea24-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b\" (UID: \"304dcc1f-95a3-4265-addf-52fcd249ea24\") " pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"
Oct 30 22:17:47.471789 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.459992    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cndk6\" (UniqueName: \"kubernetes.io/projected/304dcc1f-95a3-4265-addf-52fcd249ea24-kube-api-access-cndk6\") pod \"payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b\" (UID: \"304dcc1f-95a3-4265-addf-52fcd249ea24\") " pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"
Oct 30 22:17:47.471789 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.461197    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/304dcc1f-95a3-4265-addf-52fcd249ea24-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b\" (UID: \"304dcc1f-95a3-4265-addf-52fcd249ea24\") " pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"
Oct 30 22:17:47.685621 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.685577    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"]
Oct 30 22:17:47.722974 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.715946    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cndk6\" (UniqueName: \"kubernetes.io/projected/304dcc1f-95a3-4265-addf-52fcd249ea24-kube-api-access-cndk6\") pod \"payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b\" (UID: \"304dcc1f-95a3-4265-addf-52fcd249ea24\") " pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"
Oct 30 22:17:47.736702 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.734242    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n" podStartSLOduration=2.734221179 podStartE2EDuration="2.734221179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:47.57967293 +0000 UTC m=+2005.628280650" watchObservedRunningTime="2026-10-30 22:17:47.734221179 +0000 UTC m=+2005.782828875"
Oct 30 22:17:47.836441 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.831653    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"]
Oct 30 22:17:47.836441 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.832088    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"
Oct 30 22:17:47.861101 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.854342    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkpzw\" (UniqueName: \"kubernetes.io/projected/cf72b38f-08c1-495f-bb7b-7b555ffa89cb-kube-api-access-nkpzw\") pod \"payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh\" (UID: \"cf72b38f-08c1-495f-bb7b-7b555ffa89cb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"
Oct 30 22:17:47.861101 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.854413    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf72b38f-08c1-495f-bb7b-7b555ffa89cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh\" (UID: \"cf72b38f-08c1-495f-bb7b-7b555ffa89cb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"
Oct 30 22:17:47.862008 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.861954    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"
Oct 30 22:17:47.966974 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.964262    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkpzw\" (UniqueName: \"kubernetes.io/projected/cf72b38f-08c1-495f-bb7b-7b555ffa89cb-kube-api-access-nkpzw\") pod \"payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh\" (UID: \"cf72b38f-08c1-495f-bb7b-7b555ffa89cb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"
Oct 30 22:17:47.966974 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.964337    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf72b38f-08c1-495f-bb7b-7b555ffa89cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh\" (UID: \"cf72b38f-08c1-495f-bb7b-7b555ffa89cb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"
Oct 30 22:17:47.966974 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:47.965416    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf72b38f-08c1-495f-bb7b-7b555ffa89cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh\" (UID: \"cf72b38f-08c1-495f-bb7b-7b555ffa89cb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"
Oct 30 22:17:48.025649 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:48.025569    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkpzw\" (UniqueName: \"kubernetes.io/projected/cf72b38f-08c1-495f-bb7b-7b555ffa89cb-kube-api-access-nkpzw\") pod \"payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh\" (UID: \"cf72b38f-08c1-495f-bb7b-7b555ffa89cb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"
Oct 30 22:17:48.192168 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:48.192136    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"
Oct 30 22:17:48.281722 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:48.280862    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"]
Oct 30 22:17:48.391830 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:48.391793    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:48.588398 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:48.588369    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"]
Oct 30 22:17:48.589513 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:17:48.589478    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf72b38f_08c1_495f_bb7b_7b555ffa89cb.slice/crio-c4a3095e396c1a6b2c6b7d43cbb621514322975f8048e242efa680925e16c10b WatchSource:0}: Error finding container c4a3095e396c1a6b2c6b7d43cbb621514322975f8048e242efa680925e16c10b: Status 404 returned error can't find the container with id c4a3095e396c1a6b2c6b7d43cbb621514322975f8048e242efa680925e16c10b
Oct 30 22:17:49.190896 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:49.189874    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh" event={"ID":"cf72b38f-08c1-495f-bb7b-7b555ffa89cb","Type":"ContainerStarted","Data":"273f5f2dc2eaf6af4523b6e73a02621d72a3d2cc5e0417248444e78926f4c541"}
Oct 30 22:17:49.190896 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:49.189920    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh" event={"ID":"cf72b38f-08c1-495f-bb7b-7b555ffa89cb","Type":"ContainerStarted","Data":"c4a3095e396c1a6b2c6b7d43cbb621514322975f8048e242efa680925e16c10b"}
Oct 30 22:17:49.190896 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:49.189978    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"
Oct 30 22:17:49.192277 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:49.191918    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b" event={"ID":"304dcc1f-95a3-4265-addf-52fcd249ea24","Type":"ContainerStarted","Data":"02ea766770084059df22413e36484c543aa13700ca9015536d4fe2026957aab3"}
Oct 30 22:17:49.192277 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:49.191959    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b" event={"ID":"304dcc1f-95a3-4265-addf-52fcd249ea24","Type":"ContainerStarted","Data":"562558d33fce0859631c6434fe429e8b3d8832ad53522c860878731f09ffc255"}
Oct 30 22:17:49.192277 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:49.191992    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"
Oct 30 22:17:49.192445 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:49.192317    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:49.193162 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:49.193143    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:17:49.307114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:49.307067    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh" podStartSLOduration=2.307053369 podStartE2EDuration="2.307053369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:49.305702304 +0000 UTC m=+2007.354310000" watchObservedRunningTime="2026-10-30 22:17:49.307053369 +0000 UTC m=+2007.355661063"
Oct 30 22:17:49.572848 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:49.572713    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b" podStartSLOduration=2.572695253 podStartE2EDuration="2.572695253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:49.5688747 +0000 UTC m=+2007.617482395" watchObservedRunningTime="2026-10-30 22:17:49.572695253 +0000 UTC m=+2007.621302943"
Oct 30 22:17:49.838844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:49.838765    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 22:17:49.838844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:49.838816    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj" podUID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 22:17:49.974048 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:49.974009    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:50.201803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:50.201771    4918 generic.go:356] "Generic (PLEG): container finished" podID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" containerID="52225e022e7e6f029c7e29b23ea35a12b30bac220b8f82bfdf277819e3ccacae" exitCode=0
Oct 30 22:17:50.202008 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:50.201836    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj" event={"ID":"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a","Type":"ContainerDied","Data":"52225e022e7e6f029c7e29b23ea35a12b30bac220b8f82bfdf277819e3ccacae"}
Oct 30 22:17:50.202399 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:50.202377    4918 scope.go:122] "RemoveContainer" containerID="52225e022e7e6f029c7e29b23ea35a12b30bac220b8f82bfdf277819e3ccacae"
Oct 30 22:17:50.203850 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:50.203824    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:17:50.203941 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:50.203890    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:17:50.203941 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:50.203924    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:17:50.509426 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:50.509326    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:50.772807 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:50.772708    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:51.226554 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:51.226525    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj" event={"ID":"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a","Type":"ContainerStarted","Data":"ba118fd408eb5b2cd5a20376e51df7dac7bd3315e19653bd42a9adcc331ecc00"}
Oct 30 22:17:51.227007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:51.226968    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:17:51.227007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:51.226992    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 22:17:51.227228 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:51.227037    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj" podUID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 22:17:52.227583 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:52.227541    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 22:17:52.228078 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:52.227598    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj" podUID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 22:17:53.227197 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:53.227162    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 22:17:53.227389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:53.227224    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj" podUID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 22:17:54.220036 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:54.220007    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:17:54.227940 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:54.227916    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 22:17:54.228068 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:54.227962    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj" podUID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 22:17:55.232759 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:55.232296    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 22:17:55.232759 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:55.232356    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj" podUID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 22:17:55.282260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:55.281085    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:55.614566 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:55.614472    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:55.885593 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:55.885505    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:55.955147 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:55.955108    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"]
Oct 30 22:17:55.971703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:55.964829    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"
Oct 30 22:17:56.020474 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.001450    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"]
Oct 30 22:17:56.061480 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.060538    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w4-d1ca4b-dockercfg-q9kgz\""
Oct 30 22:17:56.061480 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.060623    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w4-d1ca4b\""
Oct 30 22:17:56.079153 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.042668    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"]
Oct 30 22:17:56.283706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.227055    4918 patch_prober.go:29] interesting pod/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 22:17:56.283706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.227110    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj" podUID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 22:17:56.283706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.228486    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33219300-9dcb-4ae5-9511-900ff02b91ef-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv\" (UID: \"33219300-9dcb-4ae5-9511-900ff02b91ef\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"
Oct 30 22:17:56.344507 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.307013    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsbcb\" (UniqueName: \"kubernetes.io/projected/33219300-9dcb-4ae5-9511-900ff02b91ef-kube-api-access-zsbcb\") pod \"payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv\" (UID: \"33219300-9dcb-4ae5-9511-900ff02b91ef\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"
Oct 30 22:17:56.344507 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.342970    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"]
Oct 30 22:17:56.346877 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.346844    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"
Oct 30 22:17:56.408061 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.408026    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06314e3b-fd5b-4f37-8ec0-f4b187a635e9-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4\" (UID: \"06314e3b-fd5b-4f37-8ec0-f4b187a635e9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"
Oct 30 22:17:56.408242 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.408190    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33219300-9dcb-4ae5-9511-900ff02b91ef-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv\" (UID: \"33219300-9dcb-4ae5-9511-900ff02b91ef\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"
Oct 30 22:17:56.408343 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.408317    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjzhg\" (UniqueName: \"kubernetes.io/projected/06314e3b-fd5b-4f37-8ec0-f4b187a635e9-kube-api-access-kjzhg\") pod \"payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4\" (UID: \"06314e3b-fd5b-4f37-8ec0-f4b187a635e9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"
Oct 30 22:17:56.408581 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.408556    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsbcb\" (UniqueName: \"kubernetes.io/projected/33219300-9dcb-4ae5-9511-900ff02b91ef-kube-api-access-zsbcb\") pod \"payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv\" (UID: \"33219300-9dcb-4ae5-9511-900ff02b91ef\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"
Oct 30 22:17:56.409890 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.409863    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33219300-9dcb-4ae5-9511-900ff02b91ef-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv\" (UID: \"33219300-9dcb-4ae5-9511-900ff02b91ef\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"
Oct 30 22:17:56.470168 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.470131    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsbcb\" (UniqueName: \"kubernetes.io/projected/33219300-9dcb-4ae5-9511-900ff02b91ef-kube-api-access-zsbcb\") pod \"payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv\" (UID: \"33219300-9dcb-4ae5-9511-900ff02b91ef\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"
Oct 30 22:17:56.511478 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.511426    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjzhg\" (UniqueName: \"kubernetes.io/projected/06314e3b-fd5b-4f37-8ec0-f4b187a635e9-kube-api-access-kjzhg\") pod \"payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4\" (UID: \"06314e3b-fd5b-4f37-8ec0-f4b187a635e9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"
Oct 30 22:17:56.512108 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.512075    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06314e3b-fd5b-4f37-8ec0-f4b187a635e9-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4\" (UID: \"06314e3b-fd5b-4f37-8ec0-f4b187a635e9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"
Oct 30 22:17:56.513657 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.513623    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06314e3b-fd5b-4f37-8ec0-f4b187a635e9-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4\" (UID: \"06314e3b-fd5b-4f37-8ec0-f4b187a635e9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"
Oct 30 22:17:56.573428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.573354    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjzhg\" (UniqueName: \"kubernetes.io/projected/06314e3b-fd5b-4f37-8ec0-f4b187a635e9-kube-api-access-kjzhg\") pod \"payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4\" (UID: \"06314e3b-fd5b-4f37-8ec0-f4b187a635e9\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"
Oct 30 22:17:56.683098 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.683064    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"
Oct 30 22:17:56.699585 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:56.699558    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"
Oct 30 22:17:57.073983 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:57.073953    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"]
Oct 30 22:17:57.075440 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:17:57.075415    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06314e3b_fd5b_4f37_8ec0_f4b187a635e9.slice/crio-e2b3b893f40e12c0b51846ca4c5f3a099d9e5e574579c4763cc7269f4bb5ae92 WatchSource:0}: Error finding container e2b3b893f40e12c0b51846ca4c5f3a099d9e5e574579c4763cc7269f4bb5ae92: Status 404 returned error can't find the container with id e2b3b893f40e12c0b51846ca4c5f3a099d9e5e574579c4763cc7269f4bb5ae92
Oct 30 22:17:57.124240 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:57.124216    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"]
Oct 30 22:17:57.134890 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:17:57.134865    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33219300_9dcb_4ae5_9511_900ff02b91ef.slice/crio-5d120ef3a414f1910d73f4898628a217cfc05b19163341db5340d46ac7a75177 WatchSource:0}: Error finding container 5d120ef3a414f1910d73f4898628a217cfc05b19163341db5340d46ac7a75177: Status 404 returned error can't find the container with id 5d120ef3a414f1910d73f4898628a217cfc05b19163341db5340d46ac7a75177
Oct 30 22:17:57.232272 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:57.232242    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:17:57.232791 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:57.232772    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:17:57.233413 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:57.233392    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:17:57.377764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:57.377662    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv" event={"ID":"33219300-9dcb-4ae5-9511-900ff02b91ef","Type":"ContainerStarted","Data":"ba23044fa6d508f6a9e6387a2471109d401f4eefaea9725cbca24f58d258ab68"}
Oct 30 22:17:57.377764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:57.377745    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv" event={"ID":"33219300-9dcb-4ae5-9511-900ff02b91ef","Type":"ContainerStarted","Data":"5d120ef3a414f1910d73f4898628a217cfc05b19163341db5340d46ac7a75177"}
Oct 30 22:17:57.378186 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:57.377773    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"
Oct 30 22:17:57.379463 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:57.379439    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4" event={"ID":"06314e3b-fd5b-4f37-8ec0-f4b187a635e9","Type":"ContainerStarted","Data":"549489d9f01da714bc762ecf66f09a62ae999e4bf6625f950f7180f3f83aca0a"}
Oct 30 22:17:57.379574 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:57.379478    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4" event={"ID":"06314e3b-fd5b-4f37-8ec0-f4b187a635e9","Type":"ContainerStarted","Data":"e2b3b893f40e12c0b51846ca4c5f3a099d9e5e574579c4763cc7269f4bb5ae92"}
Oct 30 22:17:57.379574 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:57.379497    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"
Oct 30 22:17:57.595888 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:57.593955    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4" podStartSLOduration=2.593926948 podStartE2EDuration="2.593926948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:57.591596256 +0000 UTC m=+2015.640203953" watchObservedRunningTime="2026-10-30 22:17:57.593926948 +0000 UTC m=+2015.642534645"
Oct 30 22:17:57.718544 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:57.718478    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv" podStartSLOduration=2.718458148 podStartE2EDuration="2.718458148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:17:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:17:57.715041843 +0000 UTC m=+2015.763649544" watchObservedRunningTime="2026-10-30 22:17:57.718458148 +0000 UTC m=+2015.767065844"
Oct 30 22:17:59.345240 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:59.345203    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:59.755796 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:17:59.755755    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:00.204898 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:00.204870    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"
Oct 30 22:18:00.205069 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:00.204948    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"
Oct 30 22:18:01.638976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:01.638939    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:02.092949 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:02.092907    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:02.158928 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:18:02.158895    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:18:05.290743 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.289410    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"]
Oct 30 22:18:05.301715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.299391    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:05.352158 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.352121    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"]
Oct 30 22:18:05.384096 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.384059    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxtxx\" (UniqueName: \"kubernetes.io/projected/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-kube-api-access-zxtxx\") pod \"maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:05.384323 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.384302    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:05.384451 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.384430    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-metrics-certs\") pod \"maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:05.384505 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.384494    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-maas-api-tls\") pod \"maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:05.401866 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.401831    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w5-2b7317-serving-cert\""
Oct 30 22:18:05.486561 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.486510    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:05.486772 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.486633    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-metrics-certs\") pod \"maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:05.486772 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.486751    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-maas-api-tls\") pod \"maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:05.487041 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.486830    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxtxx\" (UniqueName: \"kubernetes.io/projected/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-kube-api-access-zxtxx\") pod \"maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:05.487258 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:18:05.487235    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-serving-cert: secret "maas-api-e2e-shared-b-w5-2b7317-serving-cert" not found
Oct 30 22:18:05.487383 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.487347    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:05.487506 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:18:05.487436    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-maas-api-tls podName:67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc nodeName:}" failed. No retries permitted until 2026-10-30 22:18:05.987408981 +0000 UTC m=+2024.036016668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-maas-api-tls") pod "maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9" (UID: "67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc") : secret "maas-api-e2e-shared-b-w5-2b7317-serving-cert" not found
Oct 30 22:18:05.490097 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.490071    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-metrics-certs\") pod \"maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:05.548351 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.548278    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxtxx\" (UniqueName: \"kubernetes.io/projected/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-kube-api-access-zxtxx\") pod \"maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:05.632422 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.632383    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:05.909489 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:05.907628    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:06.019791 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:06.019745    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-maas-api-tls\") pod \"maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:06.022585 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:06.022552    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-maas-api-tls\") pod \"maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:06.235454 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:06.235361    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:06.627730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:06.627695    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"]
Oct 30 22:18:07.452489 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:07.452453    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9" event={"ID":"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc","Type":"ContainerStarted","Data":"465abdd14a2f99784dfe30548e7500c3ef72698d518497d51f154e494e2a4099"}
Oct 30 22:18:08.390182 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:08.390153    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"
Oct 30 22:18:08.390586 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:08.390224    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"
Oct 30 22:18:08.461424 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:08.461386    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9" event={"ID":"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc","Type":"ContainerStarted","Data":"da473659ad78d7eff40cd4978eae5dfb6472bf2cc7d9ad3758ed05055655d974"}
Oct 30 22:18:08.461582 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:08.461512    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:08.836735 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:08.836596    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9" podStartSLOduration=2.928024837 podStartE2EDuration="3.836577306s" totalImagesPullingTime="908.552469ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:08.756168075 +0000 UTC m=+2026.804775771" watchObservedRunningTime="2026-10-30 22:18:08.836577306 +0000 UTC m=+2026.885185003"
Oct 30 22:18:11.055376 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:11.055341    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:14.474915 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:14.474891    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:18:14.507462 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:14.507439    4918 generic.go:356] "Generic (PLEG): container finished" podID="b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" containerID="1de595c912a8dac9e34664e2158c69d3cdb08fb0967f713f253f7c15cb6f95ac" exitCode=0
Oct 30 22:18:14.507573 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:14.507512    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5" event={"ID":"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f","Type":"ContainerDied","Data":"1de595c912a8dac9e34664e2158c69d3cdb08fb0967f713f253f7c15cb6f95ac"}
Oct 30 22:18:14.507912 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:14.507898    4918 scope.go:122] "RemoveContainer" containerID="1de595c912a8dac9e34664e2158c69d3cdb08fb0967f713f253f7c15cb6f95ac"
Oct 30 22:18:14.509573 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:14.509544    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:18:14.509673 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:14.509631    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:18:14.509673 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:14.509699    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:18:15.524978 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:15.524940    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5" event={"ID":"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f","Type":"ContainerStarted","Data":"d1f00502d2017bbdcd658387f4e5478238eeffc528c1d8ff6b4a79c97d189df7"}
Oct 30 22:18:16.351703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:16.345058    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:18:16.351703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:16.345228    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:18:16.351703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:16.345290    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5" podUID="b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 22:18:16.395709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:16.393008    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:16.957528 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:16.943452    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:17.218812 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:17.218698    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:17.340752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:17.340717    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:18:17.340917 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:17.340781    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5" podUID="b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 22:18:18.344425 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:18.344388    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:18:18.345066 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:18.345031    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5" podUID="b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 22:18:19.340731 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:19.340659    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:18:19.340917 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:19.340754    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5" podUID="b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 22:18:20.341171 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:20.341131    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 22:18:20.341639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:20.341192    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5" podUID="b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 22:18:21.345057 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:21.345025    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:18:21.345489 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:21.345405    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:18:21.346097 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:21.346080    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:18:21.926359 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:21.926324    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:23.502875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:23.502840    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:23.994393 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:23.994362    4918 scope.go:122] "RemoveContainer" containerID="c8c3c73be3177a6bdf71cdac0e71cefeb4dd2d6311cc179e453011487110293c"
Oct 30 22:18:24.531887 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:24.531857    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:27.269856 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:27.269824    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:30.347209 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:30.347169    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:32.158606 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:18:32.158571    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:18:32.518241 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:32.517014    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:37.313179 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.313136    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"]
Oct 30 22:18:37.318784 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.318762    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:37.420725 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.420698    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w0-ec058c-serving-cert\""
Oct 30 22:18:37.424566 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.424540    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"]
Oct 30 22:18:37.433657 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.433631    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:37.433792 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.433767    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b84ddf8-b9a7-4b38-911a-956bf8348821-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:37.433897 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.433875    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:37.434136 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.434096    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn2tb\" (UniqueName: \"kubernetes.io/projected/6b84ddf8-b9a7-4b38-911a-956bf8348821-kube-api-access-cn2tb\") pod \"maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:37.535105 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.535075    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn2tb\" (UniqueName: \"kubernetes.io/projected/6b84ddf8-b9a7-4b38-911a-956bf8348821-kube-api-access-cn2tb\") pod \"maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:37.535288 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.535272    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:37.535364 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.535344    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b84ddf8-b9a7-4b38-911a-956bf8348821-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:37.535479 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:18:37.535417    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-serving-cert: secret "maas-api-e2e-shared-a-w0-ec058c-serving-cert" not found
Oct 30 22:18:37.535479 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.535462    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:37.535590 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:18:37.535490    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-maas-api-tls podName:6b84ddf8-b9a7-4b38-911a-956bf8348821 nodeName:}" failed. No retries permitted until 2026-10-30 22:18:38.035472491 +0000 UTC m=+2056.084080206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-maas-api-tls") pod "maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp" (UID: "6b84ddf8-b9a7-4b38-911a-956bf8348821") : secret "maas-api-e2e-shared-a-w0-ec058c-serving-cert" not found
Oct 30 22:18:37.535974 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.535951    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b84ddf8-b9a7-4b38-911a-956bf8348821-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:37.537898 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.537878    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-metrics-certs\") pod \"maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:37.595471 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.595409    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn2tb\" (UniqueName: \"kubernetes.io/projected/6b84ddf8-b9a7-4b38-911a-956bf8348821-kube-api-access-cn2tb\") pod \"maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:37.698266 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.698179    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:37.952098 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:37.952064    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:38.046121 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:38.046087    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:38.048646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:38.048622    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-maas-api-tls\") pod \"maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:38.231664 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:38.231602    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:38.613976 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:18:38.613938    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b84ddf8_b9a7_4b38_911a_956bf8348821.slice/crio-ce4c99f617ae8102e604d933d04ba04df926bd5176721408093b8a56af41f170 WatchSource:0}: Error finding container ce4c99f617ae8102e604d933d04ba04df926bd5176721408093b8a56af41f170: Status 404 returned error can't find the container with id ce4c99f617ae8102e604d933d04ba04df926bd5176721408093b8a56af41f170
Oct 30 22:18:38.660033 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:38.660004    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"]
Oct 30 22:18:38.708972 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:38.708936    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp" event={"ID":"6b84ddf8-b9a7-4b38-911a-956bf8348821","Type":"ContainerStarted","Data":"ce4c99f617ae8102e604d933d04ba04df926bd5176721408093b8a56af41f170"}
Oct 30 22:18:39.717565 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:39.717528    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp" event={"ID":"6b84ddf8-b9a7-4b38-911a-956bf8348821","Type":"ContainerStarted","Data":"e2f716136e50f43b6867140ca9e7d1b8d1de814d67ebaaee612c152a5ddaa5c3"}
Oct 30 22:18:39.717980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:39.717636    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:39.836639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:39.836547    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp" podStartSLOduration=1.967777596 podStartE2EDuration="2.836533452s" totalImagesPullingTime="868.755856ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:39.834124985 +0000 UTC m=+2057.882732679" watchObservedRunningTime="2026-10-30 22:18:39.836533452 +0000 UTC m=+2057.885141147"
Oct 30 22:18:42.798453 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:42.798406    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:45.760866 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:45.760833    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:18:47.236718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:47.228107    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:48.778140 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:48.778103    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:49.155537 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:49.155503    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:49.734737 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:49.734666    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:54.106618 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:54.106585    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:55.928069 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:55.928032    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:56.175292 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:56.175261    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"]
Oct 30 22:18:56.175569 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:56.175468    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w" podUID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerName="istio-proxy" containerID="cri-o://b276be5f35f45623f912508b6bc36752e5e66a41aa82074fb4a5048f5fc52700" gracePeriod=30
Oct 30 22:18:56.193515 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:56.193431    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:56.476787 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:56.476671    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:58.863159 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:58.863096    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:59.118540 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:59.118464    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:59.512374 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:59.512343    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"]
Oct 30 22:18:59.512579 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:18:59.512557    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h" podUID="0a926b1b-b3d0-4e0b-9198-e5479766f1db" containerName="istio-proxy" containerID="cri-o://a3e5b4d38cd481314ee8003ac60d050b0d739f64549045b27759bd41dfc83b35" gracePeriod=30
Oct 30 22:19:01.190972 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.190929    4918 patch_prober.go:29] interesting pod/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.105:15021/healthz/ready\": read tcp 10.132.0.2:35730->10.132.0.105:15021: read: connection reset by peer" start-of-body=
Oct 30 22:19:01.191373 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.191041    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w" podUID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.105:15021/healthz/ready\": read tcp 10.132.0.2:35730->10.132.0.105:15021: read: connection reset by peer"
Oct 30 22:19:01.535531 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.535502    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:19:01.683320 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.683275    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-token\" (UniqueName: \"kubernetes.io/projected/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-token\") pod \"100bc157-e8bd-4b34-811d-c857cd4e8640\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") "
Oct 30 22:19:01.683600 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.683580    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-podinfo\") pod \"100bc157-e8bd-4b34-811d-c857cd4e8640\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") "
Oct 30 22:19:01.683870 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.683843    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-workload-socket\") pod \"100bc157-e8bd-4b34-811d-c857cd4e8640\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") "
Oct 30 22:19:01.684010 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.683996    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-credential-socket\") pod \"100bc157-e8bd-4b34-811d-c857cd4e8640\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") "
Oct 30 22:19:01.684118 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.684104    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-data\") pod \"100bc157-e8bd-4b34-811d-c857cd4e8640\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") "
Oct 30 22:19:01.684252 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.684239    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-envoy\") pod \"100bc157-e8bd-4b34-811d-c857cd4e8640\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") "
Oct 30 22:19:01.684369 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.684356    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/100bc157-e8bd-4b34-811d-c857cd4e8640-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/100bc157-e8bd-4b34-811d-c857cd4e8640-istiod-ca-cert\") pod \"100bc157-e8bd-4b34-811d-c857cd4e8640\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") "
Oct 30 22:19:01.684603 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.684581    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/100bc157-e8bd-4b34-811d-c857cd4e8640-kube-api-access-44fc5\" (UniqueName: \"kubernetes.io/projected/100bc157-e8bd-4b34-811d-c857cd4e8640-kube-api-access-44fc5\") pod \"100bc157-e8bd-4b34-811d-c857cd4e8640\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") "
Oct 30 22:19:01.684861 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.684828    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-workload-certs\") pod \"100bc157-e8bd-4b34-811d-c857cd4e8640\" (UID: \"100bc157-e8bd-4b34-811d-c857cd4e8640\") "
Oct 30 22:19:01.694924 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.694538    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-credential-socket" pod "100bc157-e8bd-4b34-811d-c857cd4e8640" (UID: "100bc157-e8bd-4b34-811d-c857cd4e8640"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:01.700523 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.696934    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-data" pod "100bc157-e8bd-4b34-811d-c857cd4e8640" (UID: "100bc157-e8bd-4b34-811d-c857cd4e8640"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:01.700523 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.697261    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-workload-certs" pod "100bc157-e8bd-4b34-811d-c857cd4e8640" (UID: "100bc157-e8bd-4b34-811d-c857cd4e8640"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:01.700523 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.697892    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/100bc157-e8bd-4b34-811d-c857cd4e8640-istiod-ca-cert" pod "100bc157-e8bd-4b34-811d-c857cd4e8640" (UID: "100bc157-e8bd-4b34-811d-c857cd4e8640"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:19:01.700523 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.698565    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-workload-socket" pod "100bc157-e8bd-4b34-811d-c857cd4e8640" (UID: "100bc157-e8bd-4b34-811d-c857cd4e8640"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:01.722451 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.721900    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-podinfo" pod "100bc157-e8bd-4b34-811d-c857cd4e8640" (UID: "100bc157-e8bd-4b34-811d-c857cd4e8640"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:19:01.729857 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.729476    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-envoy" pod "100bc157-e8bd-4b34-811d-c857cd4e8640" (UID: "100bc157-e8bd-4b34-811d-c857cd4e8640"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:01.733435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.733374    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/100bc157-e8bd-4b34-811d-c857cd4e8640-kube-api-access-44fc5" pod "100bc157-e8bd-4b34-811d-c857cd4e8640" (UID: "100bc157-e8bd-4b34-811d-c857cd4e8640"). InnerVolumeSpecName "kube-api-access-44fc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:19:01.733870 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.733840    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-token" pod "100bc157-e8bd-4b34-811d-c857cd4e8640" (UID: "100bc157-e8bd-4b34-811d-c857cd4e8640"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:19:01.787825 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.787786    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:01.787825 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.787818    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/100bc157-e8bd-4b34-811d-c857cd4e8640-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:01.788031 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.787834    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44fc5\" (UniqueName: \"kubernetes.io/projected/100bc157-e8bd-4b34-811d-c857cd4e8640-kube-api-access-44fc5\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:01.788031 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.787845    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:01.788031 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.787854    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:01.788031 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.787863    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:01.788031 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.787871    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:01.788031 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.787880    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:01.788031 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.787889    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/100bc157-e8bd-4b34-811d-c857cd4e8640-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:01.995747 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.995644    4918 generic.go:356] "Generic (PLEG): container finished" podID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerID="b276be5f35f45623f912508b6bc36752e5e66a41aa82074fb4a5048f5fc52700" exitCode=0
Oct 30 22:19:01.995747 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.995731    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"
Oct 30 22:19:01.995747 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.995732    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w" event={"ID":"100bc157-e8bd-4b34-811d-c857cd4e8640","Type":"ContainerDied","Data":"b276be5f35f45623f912508b6bc36752e5e66a41aa82074fb4a5048f5fc52700"}
Oct 30 22:19:01.996044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.995814    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w" event={"ID":"100bc157-e8bd-4b34-811d-c857cd4e8640","Type":"ContainerDied","Data":"0ccba0ae3f36e2be98b153990d63b51bf9e728c24c96be32e424f4703a80d924"}
Oct 30 22:19:01.996044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:01.995846    4918 scope.go:122] "RemoveContainer" containerID="b276be5f35f45623f912508b6bc36752e5e66a41aa82074fb4a5048f5fc52700"
Oct 30 22:19:02.007210 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:02.007190    4918 scope.go:122] "RemoveContainer" containerID="924952bcfd3712aa07ea3c70804f87cc723ebbaaa14b57ee96b5996d88e3eb07"
Oct 30 22:19:02.017423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:02.017403    4918 scope.go:122] "RemoveContainer" containerID="b276be5f35f45623f912508b6bc36752e5e66a41aa82074fb4a5048f5fc52700"
Oct 30 22:19:02.017721 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:19:02.017676    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b276be5f35f45623f912508b6bc36752e5e66a41aa82074fb4a5048f5fc52700\": container with ID starting with b276be5f35f45623f912508b6bc36752e5e66a41aa82074fb4a5048f5fc52700 not found: ID does not exist" containerID="b276be5f35f45623f912508b6bc36752e5e66a41aa82074fb4a5048f5fc52700"
Oct 30 22:19:02.017813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:02.017727    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b276be5f35f45623f912508b6bc36752e5e66a41aa82074fb4a5048f5fc52700"} err="failed to get container status \"b276be5f35f45623f912508b6bc36752e5e66a41aa82074fb4a5048f5fc52700\": rpc error: code = NotFound desc = could not find container \"b276be5f35f45623f912508b6bc36752e5e66a41aa82074fb4a5048f5fc52700\": container with ID starting with b276be5f35f45623f912508b6bc36752e5e66a41aa82074fb4a5048f5fc52700 not found: ID does not exist"
Oct 30 22:19:02.017813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:02.017760    4918 scope.go:122] "RemoveContainer" containerID="924952bcfd3712aa07ea3c70804f87cc723ebbaaa14b57ee96b5996d88e3eb07"
Oct 30 22:19:02.018065 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:19:02.018048    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"924952bcfd3712aa07ea3c70804f87cc723ebbaaa14b57ee96b5996d88e3eb07\": container with ID starting with 924952bcfd3712aa07ea3c70804f87cc723ebbaaa14b57ee96b5996d88e3eb07 not found: ID does not exist" containerID="924952bcfd3712aa07ea3c70804f87cc723ebbaaa14b57ee96b5996d88e3eb07"
Oct 30 22:19:02.018123 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:02.018069    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"924952bcfd3712aa07ea3c70804f87cc723ebbaaa14b57ee96b5996d88e3eb07"} err="failed to get container status \"924952bcfd3712aa07ea3c70804f87cc723ebbaaa14b57ee96b5996d88e3eb07\": rpc error: code = NotFound desc = could not find container \"924952bcfd3712aa07ea3c70804f87cc723ebbaaa14b57ee96b5996d88e3eb07\": container with ID starting with 924952bcfd3712aa07ea3c70804f87cc723ebbaaa14b57ee96b5996d88e3eb07 not found: ID does not exist"
Oct 30 22:19:02.159073 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:19:02.159033    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:19:02.180832 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:02.180803    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"]
Oct 30 22:19:02.229846 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:02.229815    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3b355441-openshift-default-8d7866cc7-fpp7w"]
Oct 30 22:19:03.963271 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:03.963235    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:04.076474 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.076441    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="100bc157-e8bd-4b34-811d-c857cd4e8640" path="/var/lib/kubelet/pods/100bc157-e8bd-4b34-811d-c857cd4e8640/volumes"
Oct 30 22:19:04.789635 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.789575    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:19:04.934388 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.934356    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-credential-socket\") pod \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") "
Oct 30 22:19:04.934593 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.934421    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-data\") pod \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") "
Oct 30 22:19:04.934593 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.934471    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0a926b1b-b3d0-4e0b-9198-e5479766f1db-kube-api-access-js5hq\" (UniqueName: \"kubernetes.io/projected/0a926b1b-b3d0-4e0b-9198-e5479766f1db-kube-api-access-js5hq\") pod \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") "
Oct 30 22:19:04.934733 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.934625    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-workload-certs\") pod \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") "
Oct 30 22:19:04.934733 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.934675    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-credential-socket" pod "0a926b1b-b3d0-4e0b-9198-e5479766f1db" (UID: "0a926b1b-b3d0-4e0b-9198-e5479766f1db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:04.934831 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.934731    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-data" pod "0a926b1b-b3d0-4e0b-9198-e5479766f1db" (UID: "0a926b1b-b3d0-4e0b-9198-e5479766f1db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:04.934831 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.934716    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-envoy\") pod \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") "
Oct 30 22:19:04.934967 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.934851    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-podinfo\") pod \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") "
Oct 30 22:19:04.934967 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.934929    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istiod-ca-cert\") pod \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") "
Oct 30 22:19:04.934967 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.934930    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-workload-certs" pod "0a926b1b-b3d0-4e0b-9198-e5479766f1db" (UID: "0a926b1b-b3d0-4e0b-9198-e5479766f1db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:04.935112 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.934970    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-workload-socket\") pod \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") "
Oct 30 22:19:04.935112 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.935020    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-token\" (UniqueName: \"kubernetes.io/projected/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-token\") pod \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\" (UID: \"0a926b1b-b3d0-4e0b-9198-e5479766f1db\") "
Oct 30 22:19:04.935471 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.935273    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istiod-ca-cert" pod "0a926b1b-b3d0-4e0b-9198-e5479766f1db" (UID: "0a926b1b-b3d0-4e0b-9198-e5479766f1db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:19:04.935471 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.935430    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-workload-socket" pod "0a926b1b-b3d0-4e0b-9198-e5479766f1db" (UID: "0a926b1b-b3d0-4e0b-9198-e5479766f1db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:04.936375 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.935919    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:04.936375 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.935946    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:04.936375 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.935962    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:04.936375 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.935976    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:04.936375 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.935991    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:04.937557 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.937530    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a926b1b-b3d0-4e0b-9198-e5479766f1db-kube-api-access-js5hq" pod "0a926b1b-b3d0-4e0b-9198-e5479766f1db" (UID: "0a926b1b-b3d0-4e0b-9198-e5479766f1db"). InnerVolumeSpecName "kube-api-access-js5hq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:19:04.937693 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.937622    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-podinfo" pod "0a926b1b-b3d0-4e0b-9198-e5479766f1db" (UID: "0a926b1b-b3d0-4e0b-9198-e5479766f1db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:19:04.937693 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.937659    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-envoy" pod "0a926b1b-b3d0-4e0b-9198-e5479766f1db" (UID: "0a926b1b-b3d0-4e0b-9198-e5479766f1db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:04.938254 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:04.938226    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-token" pod "0a926b1b-b3d0-4e0b-9198-e5479766f1db" (UID: "0a926b1b-b3d0-4e0b-9198-e5479766f1db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:19:05.019856 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:05.019817    4918 generic.go:356] "Generic (PLEG): container finished" podID="0a926b1b-b3d0-4e0b-9198-e5479766f1db" containerID="a3e5b4d38cd481314ee8003ac60d050b0d739f64549045b27759bd41dfc83b35" exitCode=0
Oct 30 22:19:05.020269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:05.019870    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"
Oct 30 22:19:05.020269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:05.019884    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h" event={"ID":"0a926b1b-b3d0-4e0b-9198-e5479766f1db","Type":"ContainerDied","Data":"a3e5b4d38cd481314ee8003ac60d050b0d739f64549045b27759bd41dfc83b35"}
Oct 30 22:19:05.020269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:05.019952    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h" event={"ID":"0a926b1b-b3d0-4e0b-9198-e5479766f1db","Type":"ContainerDied","Data":"c077b0790cb0f84d44d39b10f174096ae0d6a20bf5a272deba20b51bdeea7d6e"}
Oct 30 22:19:05.020269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:05.019982    4918 scope.go:122] "RemoveContainer" containerID="a3e5b4d38cd481314ee8003ac60d050b0d739f64549045b27759bd41dfc83b35"
Oct 30 22:19:05.033672 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:05.033649    4918 scope.go:122] "RemoveContainer" containerID="a3e5b4d38cd481314ee8003ac60d050b0d739f64549045b27759bd41dfc83b35"
Oct 30 22:19:05.033995 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:19:05.033975    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3e5b4d38cd481314ee8003ac60d050b0d739f64549045b27759bd41dfc83b35\": container with ID starting with a3e5b4d38cd481314ee8003ac60d050b0d739f64549045b27759bd41dfc83b35 not found: ID does not exist" containerID="a3e5b4d38cd481314ee8003ac60d050b0d739f64549045b27759bd41dfc83b35"
Oct 30 22:19:05.034066 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:05.034008    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3e5b4d38cd481314ee8003ac60d050b0d739f64549045b27759bd41dfc83b35"} err="failed to get container status \"a3e5b4d38cd481314ee8003ac60d050b0d739f64549045b27759bd41dfc83b35\": rpc error: code = NotFound desc = could not find container \"a3e5b4d38cd481314ee8003ac60d050b0d739f64549045b27759bd41dfc83b35\": container with ID starting with a3e5b4d38cd481314ee8003ac60d050b0d739f64549045b27759bd41dfc83b35 not found: ID does not exist"
Oct 30 22:19:05.036949 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:05.036928    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:05.036949 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:05.036950    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:05.037062 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:05.036960    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a926b1b-b3d0-4e0b-9198-e5479766f1db-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:05.037062 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:05.036969    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js5hq\" (UniqueName: \"kubernetes.io/projected/0a926b1b-b3d0-4e0b-9198-e5479766f1db-kube-api-access-js5hq\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:05.188549 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:05.188252    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"]
Oct 30 22:19:05.193911 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:05.193882    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-jfl8h"]
Oct 30 22:19:06.095705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:06.077650    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0a926b1b-b3d0-4e0b-9198-e5479766f1db" path="/var/lib/kubelet/pods/0a926b1b-b3d0-4e0b-9198-e5479766f1db/volumes"
Oct 30 22:19:06.095705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:06.081837    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"]
Oct 30 22:19:06.095705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:06.082056    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n" podUID="05857f11-e5bc-4236-8811-0b43c6661c1f" containerName="istio-proxy" containerID="cri-o://943af6e61bc26b50d9ada36421581aaeb9698aaec00a9c3208efc09fb889ca4e" gracePeriod=30
Oct 30 22:19:06.968717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:06.968667    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:08.480970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.480940    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"]
Oct 30 22:19:08.481607 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.481592    4918 cpu_manager.go:414] "containerMap: removing container" podUID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerName="istio-proxy"
Oct 30 22:19:08.481651 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.481608    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerName="istio-proxy"
Oct 30 22:19:08.481651 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.481638    4918 cpu_manager.go:414] "containerMap: removing container" podUID="0a926b1b-b3d0-4e0b-9198-e5479766f1db" containerName="istio-proxy"
Oct 30 22:19:08.481651 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.481643    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0a926b1b-b3d0-4e0b-9198-e5479766f1db" containerName="istio-proxy"
Oct 30 22:19:08.481769 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.481661    4918 cpu_manager.go:414] "containerMap: removing container" podUID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerName="istio-proxy"
Oct 30 22:19:08.481769 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.481667    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerName="istio-proxy"
Oct 30 22:19:08.481836 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.481807    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerName="istio-proxy"
Oct 30 22:19:08.481836 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.481819    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="0a926b1b-b3d0-4e0b-9198-e5479766f1db" containerName="istio-proxy"
Oct 30 22:19:08.481836 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.481828    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="100bc157-e8bd-4b34-811d-c857cd4e8640" containerName="istio-proxy"
Oct 30 22:19:08.487098 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.487081    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:08.544801 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.544770    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"]
Oct 30 22:19:08.552193 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.552160    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:08.552374 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.552218    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:08.552374 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.552320    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4skgk\" (UniqueName: \"kubernetes.io/projected/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-kube-api-access-4skgk\") pod \"maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:08.552510 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.552487    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-metrics-certs\") pod \"maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:08.588738 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.588640    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w4-d1ca4b-serving-cert\""
Oct 30 22:19:08.654082 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.654047    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:08.654254 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.654090    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:08.654254 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.654175    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4skgk\" (UniqueName: \"kubernetes.io/projected/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-kube-api-access-4skgk\") pod \"maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:08.654254 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:19:08.654199    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-serving-cert: secret "maas-api-e2e-shared-b-w4-d1ca4b-serving-cert" not found
Oct 30 22:19:08.654408 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:19:08.654271    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-maas-api-tls podName:74f7d9ce-7772-4b84-8a7b-c0612ad81e8f nodeName:}" failed. No retries permitted until 2026-10-30 22:19:09.154251179 +0000 UTC m=+2087.202858853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-maas-api-tls") pod "maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5" (UID: "74f7d9ce-7772-4b84-8a7b-c0612ad81e8f") : secret "maas-api-e2e-shared-b-w4-d1ca4b-serving-cert" not found
Oct 30 22:19:08.654408 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.654363    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-metrics-certs\") pod \"maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:08.654845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.654816    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:08.657279 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.657247    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-metrics-certs\") pod \"maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:08.718594 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.718531    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:08.718779 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.718656    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4skgk\" (UniqueName: \"kubernetes.io/projected/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-kube-api-access-4skgk\") pod \"maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:08.983963 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:08.983913    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:09.165455 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:09.165419    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:09.168336 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:09.168310    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:09.401611 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:09.401575    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:09.788753 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:19:09.788722    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f7d9ce_7772_4b84_8a7b_c0612ad81e8f.slice/crio-6c21a7743cb6d07744e0e640eaafaf95cbeb57ad8b7464d1447fd4cbbc1dba25 WatchSource:0}: Error finding container 6c21a7743cb6d07744e0e640eaafaf95cbeb57ad8b7464d1447fd4cbbc1dba25: Status 404 returned error can't find the container with id 6c21a7743cb6d07744e0e640eaafaf95cbeb57ad8b7464d1447fd4cbbc1dba25
Oct 30 22:19:09.859758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:09.859724    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"]
Oct 30 22:19:10.077769 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:10.077694    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5" event={"ID":"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f","Type":"ContainerStarted","Data":"6c21a7743cb6d07744e0e640eaafaf95cbeb57ad8b7464d1447fd4cbbc1dba25"}
Oct 30 22:19:11.087395 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.087354    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5" event={"ID":"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f","Type":"ContainerStarted","Data":"f7787fc64d63f2b0e10e29729c83d643f7dda876f4067fa2c847205bc8e581cb"}
Oct 30 22:19:11.087964 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.087451    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:11.274918 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.270333    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5" podStartSLOduration=2.448903305 podStartE2EDuration="3.270311039s" totalImagesPullingTime="821.407734ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:19:11.226196828 +0000 UTC m=+2089.274804515" watchObservedRunningTime="2026-10-30 22:19:11.270311039 +0000 UTC m=+2089.318918735"
Oct 30 22:19:11.700161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.700129    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:19:11.738564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.738531    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-workload-certs\") pod \"05857f11-e5bc-4236-8811-0b43c6661c1f\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") "
Oct 30 22:19:11.738907 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.738881    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-workload-certs" pod "05857f11-e5bc-4236-8811-0b43c6661c1f" (UID: "05857f11-e5bc-4236-8811-0b43c6661c1f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:11.739006 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.738918    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/05857f11-e5bc-4236-8811-0b43c6661c1f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05857f11-e5bc-4236-8811-0b43c6661c1f-istiod-ca-cert\") pod \"05857f11-e5bc-4236-8811-0b43c6661c1f\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") "
Oct 30 22:19:11.739006 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.738984    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-podinfo\") pod \"05857f11-e5bc-4236-8811-0b43c6661c1f\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") "
Oct 30 22:19:11.739123 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.739027    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-data\") pod \"05857f11-e5bc-4236-8811-0b43c6661c1f\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") "
Oct 30 22:19:11.739177 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.739161    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-credential-socket\") pod \"05857f11-e5bc-4236-8811-0b43c6661c1f\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") "
Oct 30 22:19:11.739237 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.739200    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-envoy\") pod \"05857f11-e5bc-4236-8811-0b43c6661c1f\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") "
Oct 30 22:19:11.739293 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.739276    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-token\" (UniqueName: \"kubernetes.io/projected/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-token\") pod \"05857f11-e5bc-4236-8811-0b43c6661c1f\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") "
Oct 30 22:19:11.739382 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.739364    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-workload-socket\") pod \"05857f11-e5bc-4236-8811-0b43c6661c1f\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") "
Oct 30 22:19:11.739449 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.739415    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05857f11-e5bc-4236-8811-0b43c6661c1f-kube-api-access-tkk5l\" (UniqueName: \"kubernetes.io/projected/05857f11-e5bc-4236-8811-0b43c6661c1f-kube-api-access-tkk5l\") pod \"05857f11-e5bc-4236-8811-0b43c6661c1f\" (UID: \"05857f11-e5bc-4236-8811-0b43c6661c1f\") "
Oct 30 22:19:11.739813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.739364    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-data" pod "05857f11-e5bc-4236-8811-0b43c6661c1f" (UID: "05857f11-e5bc-4236-8811-0b43c6661c1f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:11.739813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.739712    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-workload-socket" pod "05857f11-e5bc-4236-8811-0b43c6661c1f" (UID: "05857f11-e5bc-4236-8811-0b43c6661c1f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:11.740196 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.739842    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05857f11-e5bc-4236-8811-0b43c6661c1f-istiod-ca-cert" pod "05857f11-e5bc-4236-8811-0b43c6661c1f" (UID: "05857f11-e5bc-4236-8811-0b43c6661c1f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:19:11.740196 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.740140    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-credential-socket" pod "05857f11-e5bc-4236-8811-0b43c6661c1f" (UID: "05857f11-e5bc-4236-8811-0b43c6661c1f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:11.740319 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.740266    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05857f11-e5bc-4236-8811-0b43c6661c1f-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:11.740319 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.740282    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:11.740319 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.740291    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:11.740319 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.740300    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:11.740319 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.740308    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:11.747718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.743788    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-podinfo" pod "05857f11-e5bc-4236-8811-0b43c6661c1f" (UID: "05857f11-e5bc-4236-8811-0b43c6661c1f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:19:11.747718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.745801    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-envoy" pod "05857f11-e5bc-4236-8811-0b43c6661c1f" (UID: "05857f11-e5bc-4236-8811-0b43c6661c1f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:11.747718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.745840    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-token" pod "05857f11-e5bc-4236-8811-0b43c6661c1f" (UID: "05857f11-e5bc-4236-8811-0b43c6661c1f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:19:11.747718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.745875    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05857f11-e5bc-4236-8811-0b43c6661c1f-kube-api-access-tkk5l" pod "05857f11-e5bc-4236-8811-0b43c6661c1f" (UID: "05857f11-e5bc-4236-8811-0b43c6661c1f"). InnerVolumeSpecName "kube-api-access-tkk5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:19:11.843197 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.843019    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:11.843197 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.843063    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkk5l\" (UniqueName: \"kubernetes.io/projected/05857f11-e5bc-4236-8811-0b43c6661c1f-kube-api-access-tkk5l\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:11.843197 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.843080    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:11.843197 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:11.843094    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05857f11-e5bc-4236-8811-0b43c6661c1f-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:12.120965 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:12.119613    4918 generic.go:356] "Generic (PLEG): container finished" podID="05857f11-e5bc-4236-8811-0b43c6661c1f" containerID="943af6e61bc26b50d9ada36421581aaeb9698aaec00a9c3208efc09fb889ca4e" exitCode=0
Oct 30 22:19:12.120965 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:12.120861    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"
Oct 30 22:19:12.121579 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:12.121553    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n" event={"ID":"05857f11-e5bc-4236-8811-0b43c6661c1f","Type":"ContainerDied","Data":"943af6e61bc26b50d9ada36421581aaeb9698aaec00a9c3208efc09fb889ca4e"}
Oct 30 22:19:12.121783 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:12.121764    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n" event={"ID":"05857f11-e5bc-4236-8811-0b43c6661c1f","Type":"ContainerDied","Data":"f096f2cff246f7e5aed691081af0f1c3bf58eabc3af592c01b47e5914be608f8"}
Oct 30 22:19:12.121892 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:12.121881    4918 scope.go:122] "RemoveContainer" containerID="943af6e61bc26b50d9ada36421581aaeb9698aaec00a9c3208efc09fb889ca4e"
Oct 30 22:19:12.148277 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:12.148194    4918 scope.go:122] "RemoveContainer" containerID="943af6e61bc26b50d9ada36421581aaeb9698aaec00a9c3208efc09fb889ca4e"
Oct 30 22:19:12.148788 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:19:12.148755    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"943af6e61bc26b50d9ada36421581aaeb9698aaec00a9c3208efc09fb889ca4e\": container with ID starting with 943af6e61bc26b50d9ada36421581aaeb9698aaec00a9c3208efc09fb889ca4e not found: ID does not exist" containerID="943af6e61bc26b50d9ada36421581aaeb9698aaec00a9c3208efc09fb889ca4e"
Oct 30 22:19:12.148908 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:12.148798    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"943af6e61bc26b50d9ada36421581aaeb9698aaec00a9c3208efc09fb889ca4e"} err="failed to get container status \"943af6e61bc26b50d9ada36421581aaeb9698aaec00a9c3208efc09fb889ca4e\": rpc error: code = NotFound desc = could not find container \"943af6e61bc26b50d9ada36421581aaeb9698aaec00a9c3208efc09fb889ca4e\": container with ID starting with 943af6e61bc26b50d9ada36421581aaeb9698aaec00a9c3208efc09fb889ca4e not found: ID does not exist"
Oct 30 22:19:12.290483 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:12.290440    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"]
Oct 30 22:19:12.296288 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:12.296256    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-rkh7n"]
Oct 30 22:19:13.443720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:13.443653    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:14.074044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:14.074015    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="05857f11-e5bc-4236-8811-0b43c6661c1f" path="/var/lib/kubelet/pods/05857f11-e5bc-4236-8811-0b43c6661c1f/volumes"
Oct 30 22:19:14.465865 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:14.465823    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:14.861823 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:14.861722    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:15.130676 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:15.130554    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:17.126279 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:17.126242    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:19:18.165354 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:18.165321    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:18.473144 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:18.473039    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:19.770789 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:19.770755    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:22.323559 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:22.323530    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:19:22.354168 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:22.354144    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:19:24.627846 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:24.627801    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:24.895480 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:24.895440    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:29.665844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:29.665522    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:32.158854 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:19:32.158775    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:19:34.680001 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:34.679967    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:35.088203 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:35.088090    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:35.768709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:35.762580    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:36.272365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:36.272300    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:37.523705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:37.523345    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:38.917261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:38.917227    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:39.839454 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.839417    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"]
Oct 30 22:19:39.840200 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.840180    4918 cpu_manager.go:414] "containerMap: removing container" podUID="05857f11-e5bc-4236-8811-0b43c6661c1f" containerName="istio-proxy"
Oct 30 22:19:39.840313 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.840201    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05857f11-e5bc-4236-8811-0b43c6661c1f" containerName="istio-proxy"
Oct 30 22:19:39.840384 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.840366    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="05857f11-e5bc-4236-8811-0b43c6661c1f" containerName="istio-proxy"
Oct 30 22:19:39.845753 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.845728    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:39.871198 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.871169    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:39.912252 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.912219    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"]
Oct 30 22:19:39.915175 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.915140    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/176181fd-429c-45fe-a755-2d97b9bae435-istio-podinfo\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:39.915318 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.915304    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-workload-socket\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:39.915392 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.915373    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/176181fd-429c-45fe-a755-2d97b9bae435-istiod-ca-cert\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:39.915505 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.915483    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-istio-envoy\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:39.915581 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.915530    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvjx9\" (UniqueName: \"kubernetes.io/projected/176181fd-429c-45fe-a755-2d97b9bae435-kube-api-access-gvjx9\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:39.915581 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.915578    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/176181fd-429c-45fe-a755-2d97b9bae435-istio-token\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:39.915715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.915603    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-istio-data\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:39.915715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.915627    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-workload-certs\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:39.915715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.915650    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-credential-socket\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:39.951708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:39.951655    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a78655-openshift-default-dockercfg-k2qx8\""
Oct 30 22:19:40.017264 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.017187    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/176181fd-429c-45fe-a755-2d97b9bae435-istiod-ca-cert\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.017264 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.017246    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-istio-envoy\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.017473 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.017282    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvjx9\" (UniqueName: \"kubernetes.io/projected/176181fd-429c-45fe-a755-2d97b9bae435-kube-api-access-gvjx9\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.017473 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.017324    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/176181fd-429c-45fe-a755-2d97b9bae435-istio-token\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.017473 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.017454    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-istio-data\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.017644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.017491    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-workload-certs\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.017644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.017528    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-credential-socket\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.017644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.017616    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/176181fd-429c-45fe-a755-2d97b9bae435-istio-podinfo\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.017864 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.017777    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-workload-socket\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.017927 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.017854    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-workload-certs\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.018019 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.017997    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/176181fd-429c-45fe-a755-2d97b9bae435-istiod-ca-cert\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.018122 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.018105    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-credential-socket\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.018184 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.018103    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-workload-socket\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.018313 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.018289    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-istio-data\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.020291 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.020267    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/176181fd-429c-45fe-a755-2d97b9bae435-istio-podinfo\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.020405 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.020383    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-istio-envoy\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.120704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.119180    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/176181fd-429c-45fe-a755-2d97b9bae435-istio-token\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.120704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.119255    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvjx9\" (UniqueName: \"kubernetes.io/projected/176181fd-429c-45fe-a755-2d97b9bae435-kube-api-access-gvjx9\") pod \"e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") " pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.169230 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.167974    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:40.243843 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.243808    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:40.552463 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.552406    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:40.697455 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.697427    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"]
Oct 30 22:19:40.698985 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:19:40.698959    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod176181fd_429c_45fe_a755_2d97b9bae435.slice/crio-efd3b96252344fbafb9c39bdb67f86fd66e668787738f6bb951c10d12c8bf824 WatchSource:0}: Error finding container efd3b96252344fbafb9c39bdb67f86fd66e668787738f6bb951c10d12c8bf824: Status 404 returned error can't find the container with id efd3b96252344fbafb9c39bdb67f86fd66e668787738f6bb951c10d12c8bf824
Oct 30 22:19:40.701601 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.701571    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:19:40.701673 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.701634    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:19:40.701673 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:40.701665    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:19:41.432405 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:41.432368    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t" event={"ID":"176181fd-429c-45fe-a755-2d97b9bae435","Type":"ContainerStarted","Data":"48574406e00f4a5bc87b33b2e188c07b24ac6a25eaaf2cd00e66b5aa754a71f7"}
Oct 30 22:19:41.433081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:41.433052    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t" event={"ID":"176181fd-429c-45fe-a755-2d97b9bae435","Type":"ContainerStarted","Data":"efd3b96252344fbafb9c39bdb67f86fd66e668787738f6bb951c10d12c8bf824"}
Oct 30 22:19:41.601020 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:41.600948    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t" podStartSLOduration=2.600930316 podStartE2EDuration="2.600930316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:19:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:19:41.600353354 +0000 UTC m=+2119.648961053" watchObservedRunningTime="2026-10-30 22:19:41.600930316 +0000 UTC m=+2119.649538010"
Oct 30 22:19:42.173347 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:42.173312    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:42.178859 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:42.178837    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:42.439833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:42.439762    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:42.440800 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:42.440777    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:19:43.201842 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:43.201807    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:19:43.202020 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:43.201909    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp" podUID="2f4c3406-75c9-4871-b92f-15676af6e5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:19:43.310145 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:43.310110    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:43.575785 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:43.575699    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:44.828553 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:44.828462    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"]
Oct 30 22:19:44.829074 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:44.828698    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn" podUID="4d1b6193-937c-4cd5-bc88-a29ed981fbe9" containerName="istio-proxy" containerID="cri-o://ba4ae1d61defa686a2ed67741a805e2319eaa3c310a18071adbda62e22e561c5" gracePeriod=30
Oct 30 22:19:45.193787 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:45.193752    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:45.461108 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:45.461023    4918 generic.go:356] "Generic (PLEG): container finished" podID="2f4c3406-75c9-4871-b92f-15676af6e5d7" containerID="b9693ec12e6832b97d37aef15e067b78afd9949d88391123dd480604d5876129" exitCode=0
Oct 30 22:19:45.461255 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:45.461139    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp" event={"ID":"2f4c3406-75c9-4871-b92f-15676af6e5d7","Type":"ContainerDied","Data":"b9693ec12e6832b97d37aef15e067b78afd9949d88391123dd480604d5876129"}
Oct 30 22:19:45.461577 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:45.461560    4918 scope.go:122] "RemoveContainer" containerID="b9693ec12e6832b97d37aef15e067b78afd9949d88391123dd480604d5876129"
Oct 30 22:19:45.463208 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:45.463175    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:19:45.463336 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:45.463261    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:19:45.463336 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:45.463309    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:19:46.471726 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:46.471673    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp" event={"ID":"2f4c3406-75c9-4871-b92f-15676af6e5d7","Type":"ContainerStarted","Data":"ba90dc4c1b7775e2683e9ef50a3aa5b4dddb0982f29fcbd8df4c945c29796860"}
Oct 30 22:19:47.015578 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:47.015543    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:19:47.016045 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:47.015938    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 22:19:47.016246 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:47.016214    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp" podUID="2f4c3406-75c9-4871-b92f-15676af6e5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 22:19:48.018265 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:48.018230    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 22:19:48.018829 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:48.018302    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp" podUID="2f4c3406-75c9-4871-b92f-15676af6e5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 22:19:49.015667 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:49.015630    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 22:19:49.016022 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:49.015992    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp" podUID="2f4c3406-75c9-4871-b92f-15676af6e5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 22:19:49.636955 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:49.636921    4918 patch_prober.go:29] interesting pod/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:19:49.637365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:49.636976    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn" podUID="4d1b6193-937c-4cd5-bc88-a29ed981fbe9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:19:49.885423 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:19:49.885395    4918 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1b6193_937c_4cd5_bc88_a29ed981fbe9.slice/crio-ba4ae1d61defa686a2ed67741a805e2319eaa3c310a18071adbda62e22e561c5.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1b6193_937c_4cd5_bc88_a29ed981fbe9.slice/crio-conmon-ba4ae1d61defa686a2ed67741a805e2319eaa3c310a18071adbda62e22e561c5.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 22:19:50.020149 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.020111    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 22:19:50.020351 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.020188    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp" podUID="2f4c3406-75c9-4871-b92f-15676af6e5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 22:19:50.162648 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.162617    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:19:50.260595 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.260485    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-envoy\") pod \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") "
Oct 30 22:19:50.261033 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.261001    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-workload-certs\") pod \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") "
Oct 30 22:19:50.261229 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.261204    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istiod-ca-cert\") pod \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") "
Oct 30 22:19:50.261416 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.261381    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-podinfo\") pod \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") "
Oct 30 22:19:50.261593 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.261563    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-token\" (UniqueName: \"kubernetes.io/projected/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-token\") pod \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") "
Oct 30 22:19:50.262320 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.262296    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-credential-socket\") pod \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") "
Oct 30 22:19:50.262537 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.262505    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-workload-socket\") pod \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") "
Oct 30 22:19:50.262722 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.262707    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-data\") pod \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") "
Oct 30 22:19:50.262918 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.262887    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-kube-api-access-wvlp5\" (UniqueName: \"kubernetes.io/projected/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-kube-api-access-wvlp5\") pod \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\" (UID: \"4d1b6193-937c-4cd5-bc88-a29ed981fbe9\") "
Oct 30 22:19:50.272350 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.269984    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-workload-certs" pod "4d1b6193-937c-4cd5-bc88-a29ed981fbe9" (UID: "4d1b6193-937c-4cd5-bc88-a29ed981fbe9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:50.272350 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.270333    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istiod-ca-cert" pod "4d1b6193-937c-4cd5-bc88-a29ed981fbe9" (UID: "4d1b6193-937c-4cd5-bc88-a29ed981fbe9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:19:50.272350 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.272154    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-workload-socket" pod "4d1b6193-937c-4cd5-bc88-a29ed981fbe9" (UID: "4d1b6193-937c-4cd5-bc88-a29ed981fbe9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:50.273388 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.272605    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-credential-socket" pod "4d1b6193-937c-4cd5-bc88-a29ed981fbe9" (UID: "4d1b6193-937c-4cd5-bc88-a29ed981fbe9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:50.273388 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.273135    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:50.273548 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.273442    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-envoy" pod "4d1b6193-937c-4cd5-bc88-a29ed981fbe9" (UID: "4d1b6193-937c-4cd5-bc88-a29ed981fbe9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:50.273706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.273647    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-data" pod "4d1b6193-937c-4cd5-bc88-a29ed981fbe9" (UID: "4d1b6193-937c-4cd5-bc88-a29ed981fbe9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:19:50.273795 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.273778    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-token" pod "4d1b6193-937c-4cd5-bc88-a29ed981fbe9" (UID: "4d1b6193-937c-4cd5-bc88-a29ed981fbe9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:19:50.275330 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.275305    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:50.275330 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.275328    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:50.275491 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.275337    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:50.275491 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.275346    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:50.275491 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.275354    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:50.275491 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.275362    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:50.275491 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.275370    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:50.278096 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.278072    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-podinfo" pod "4d1b6193-937c-4cd5-bc88-a29ed981fbe9" (UID: "4d1b6193-937c-4cd5-bc88-a29ed981fbe9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:19:50.280133 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.280098    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-kube-api-access-wvlp5" pod "4d1b6193-937c-4cd5-bc88-a29ed981fbe9" (UID: "4d1b6193-937c-4cd5-bc88-a29ed981fbe9"). InnerVolumeSpecName "kube-api-access-wvlp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:19:50.376616 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.376585    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:50.376616 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.376613    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvlp5\" (UniqueName: \"kubernetes.io/projected/4d1b6193-937c-4cd5-bc88-a29ed981fbe9-kube-api-access-wvlp5\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:19:50.532733 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.532635    4918 generic.go:356] "Generic (PLEG): container finished" podID="4d1b6193-937c-4cd5-bc88-a29ed981fbe9" containerID="ba4ae1d61defa686a2ed67741a805e2319eaa3c310a18071adbda62e22e561c5" exitCode=0
Oct 30 22:19:50.532884 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.532806    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn" event={"ID":"4d1b6193-937c-4cd5-bc88-a29ed981fbe9","Type":"ContainerDied","Data":"ba4ae1d61defa686a2ed67741a805e2319eaa3c310a18071adbda62e22e561c5"}
Oct 30 22:19:50.532884 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.532872    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn" event={"ID":"4d1b6193-937c-4cd5-bc88-a29ed981fbe9","Type":"ContainerDied","Data":"91d2670749b03f2a1f1f8e7851375fff9e2f2ffe947870b8f80e0a230e575aeb"}
Oct 30 22:19:50.532956 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.532892    4918 scope.go:122] "RemoveContainer" containerID="ba4ae1d61defa686a2ed67741a805e2319eaa3c310a18071adbda62e22e561c5"
Oct 30 22:19:50.533044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.533033    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"
Oct 30 22:19:50.545362 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.545342    4918 scope.go:122] "RemoveContainer" containerID="ba4ae1d61defa686a2ed67741a805e2319eaa3c310a18071adbda62e22e561c5"
Oct 30 22:19:50.545667 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:19:50.545647    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba4ae1d61defa686a2ed67741a805e2319eaa3c310a18071adbda62e22e561c5\": container with ID starting with ba4ae1d61defa686a2ed67741a805e2319eaa3c310a18071adbda62e22e561c5 not found: ID does not exist" containerID="ba4ae1d61defa686a2ed67741a805e2319eaa3c310a18071adbda62e22e561c5"
Oct 30 22:19:50.545787 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.545694    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba4ae1d61defa686a2ed67741a805e2319eaa3c310a18071adbda62e22e561c5"} err="failed to get container status \"ba4ae1d61defa686a2ed67741a805e2319eaa3c310a18071adbda62e22e561c5\": rpc error: code = NotFound desc = could not find container \"ba4ae1d61defa686a2ed67741a805e2319eaa3c310a18071adbda62e22e561c5\": container with ID starting with ba4ae1d61defa686a2ed67741a805e2319eaa3c310a18071adbda62e22e561c5 not found: ID does not exist"
Oct 30 22:19:50.721074 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.721006    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"]
Oct 30 22:19:50.724782 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:50.724758    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-xv2xn"]
Oct 30 22:19:51.016709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:51.016040    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 22:19:51.016709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:51.016113    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp" podUID="2f4c3406-75c9-4871-b92f-15676af6e5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 22:19:52.017708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:52.017008    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 22:19:52.017708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:52.017082    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp" podUID="2f4c3406-75c9-4871-b92f-15676af6e5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 22:19:52.074528 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:52.074495    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d1b6193-937c-4cd5-bc88-a29ed981fbe9" path="/var/lib/kubelet/pods/4d1b6193-937c-4cd5-bc88-a29ed981fbe9/volumes"
Oct 30 22:19:53.020470 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:53.020440    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:19:53.020976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:53.020877    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:19:53.021451 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:53.021429    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:19:54.516483 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:54.516446    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:54.871756 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:54.861653    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:55.418187 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:55.418152    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:59.044317 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.044277    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:59.354265 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.354145    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:59.386305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.386270    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"]
Oct 30 22:19:59.387819 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.387789    4918 cpu_manager.go:414] "containerMap: removing container" podUID="4d1b6193-937c-4cd5-bc88-a29ed981fbe9" containerName="istio-proxy"
Oct 30 22:19:59.388002 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.387988    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d1b6193-937c-4cd5-bc88-a29ed981fbe9" containerName="istio-proxy"
Oct 30 22:19:59.388338 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.388322    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d1b6193-937c-4cd5-bc88-a29ed981fbe9" containerName="istio-proxy"
Oct 30 22:19:59.392953 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.392930    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"
Oct 30 22:19:59.482761 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.482729    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-a78655\""
Oct 30 22:19:59.483114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.483085    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-a78655-dockercfg-sb242\""
Oct 30 22:19:59.486105 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.485474    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"]
Oct 30 22:19:59.540732 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.540654    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc99c\" (UniqueName: \"kubernetes.io/projected/38a22d19-473c-4f13-a59a-b6d89b9cb232-kube-api-access-hc99c\") pod \"payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb\" (UID: \"38a22d19-473c-4f13-a59a-b6d89b9cb232\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"
Oct 30 22:19:59.541138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.541115    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38a22d19-473c-4f13-a59a-b6d89b9cb232-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb\" (UID: \"38a22d19-473c-4f13-a59a-b6d89b9cb232\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"
Oct 30 22:19:59.547115 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.547070    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"]
Oct 30 22:19:59.556085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.556053    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"
Oct 30 22:19:59.623049 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.623019    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"]
Oct 30 22:19:59.666709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.646454    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc99c\" (UniqueName: \"kubernetes.io/projected/38a22d19-473c-4f13-a59a-b6d89b9cb232-kube-api-access-hc99c\") pod \"payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb\" (UID: \"38a22d19-473c-4f13-a59a-b6d89b9cb232\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"
Oct 30 22:19:59.666709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.646642    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38a22d19-473c-4f13-a59a-b6d89b9cb232-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb\" (UID: \"38a22d19-473c-4f13-a59a-b6d89b9cb232\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"
Oct 30 22:19:59.668886 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.668796    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38a22d19-473c-4f13-a59a-b6d89b9cb232-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb\" (UID: \"38a22d19-473c-4f13-a59a-b6d89b9cb232\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"
Oct 30 22:19:59.746172 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.746076    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc99c\" (UniqueName: \"kubernetes.io/projected/38a22d19-473c-4f13-a59a-b6d89b9cb232-kube-api-access-hc99c\") pod \"payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb\" (UID: \"38a22d19-473c-4f13-a59a-b6d89b9cb232\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"
Oct 30 22:19:59.754131 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.754097    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxf28\" (UniqueName: \"kubernetes.io/projected/3424cac6-8a47-4d3e-9faf-e79b9175de1f-kube-api-access-kxf28\") pod \"payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4\" (UID: \"3424cac6-8a47-4d3e-9faf-e79b9175de1f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"
Oct 30 22:19:59.754343 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.754325    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3424cac6-8a47-4d3e-9faf-e79b9175de1f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4\" (UID: \"3424cac6-8a47-4d3e-9faf-e79b9175de1f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"
Oct 30 22:19:59.792233 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.792208    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"
Oct 30 22:19:59.855706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.855271    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3424cac6-8a47-4d3e-9faf-e79b9175de1f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4\" (UID: \"3424cac6-8a47-4d3e-9faf-e79b9175de1f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"
Oct 30 22:19:59.855706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.855402    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxf28\" (UniqueName: \"kubernetes.io/projected/3424cac6-8a47-4d3e-9faf-e79b9175de1f-kube-api-access-kxf28\") pod \"payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4\" (UID: \"3424cac6-8a47-4d3e-9faf-e79b9175de1f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"
Oct 30 22:19:59.856267 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.855971    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3424cac6-8a47-4d3e-9faf-e79b9175de1f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4\" (UID: \"3424cac6-8a47-4d3e-9faf-e79b9175de1f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"
Oct 30 22:19:59.923732 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:19:59.923356    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxf28\" (UniqueName: \"kubernetes.io/projected/3424cac6-8a47-4d3e-9faf-e79b9175de1f-kube-api-access-kxf28\") pod \"payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4\" (UID: \"3424cac6-8a47-4d3e-9faf-e79b9175de1f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"
Oct 30 22:20:00.018956 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:00.018565    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"
Oct 30 22:20:00.226564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:00.226533    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"]
Oct 30 22:20:00.227007 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:20:00.226641    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a22d19_473c_4f13_a59a_b6d89b9cb232.slice/crio-36ddba64275a786e4c47d17e922f32958e1fadbe9b67d8123fd5ca5245f2c80c WatchSource:0}: Error finding container 36ddba64275a786e4c47d17e922f32958e1fadbe9b67d8123fd5ca5245f2c80c: Status 404 returned error can't find the container with id 36ddba64275a786e4c47d17e922f32958e1fadbe9b67d8123fd5ca5245f2c80c
Oct 30 22:20:00.425040 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:20:00.425005    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3424cac6_8a47_4d3e_9faf_e79b9175de1f.slice/crio-488e066016ea550b19c7a282baa107c01b2cfedc3ae924964a4cd754994c7418 WatchSource:0}: Error finding container 488e066016ea550b19c7a282baa107c01b2cfedc3ae924964a4cd754994c7418: Status 404 returned error can't find the container with id 488e066016ea550b19c7a282baa107c01b2cfedc3ae924964a4cd754994c7418
Oct 30 22:20:00.425615 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:00.425595    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"]
Oct 30 22:20:00.765901 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:00.765795    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4" event={"ID":"3424cac6-8a47-4d3e-9faf-e79b9175de1f","Type":"ContainerStarted","Data":"dcdf175ec396dbc130c50348a1ef9679d8f5b1e7aa0c5f72b411eeb699e1ab3e"}
Oct 30 22:20:00.765901 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:00.765872    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4" event={"ID":"3424cac6-8a47-4d3e-9faf-e79b9175de1f","Type":"ContainerStarted","Data":"488e066016ea550b19c7a282baa107c01b2cfedc3ae924964a4cd754994c7418"}
Oct 30 22:20:00.766222 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:00.766081    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"
Oct 30 22:20:00.768015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:00.767976    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb" event={"ID":"38a22d19-473c-4f13-a59a-b6d89b9cb232","Type":"ContainerStarted","Data":"4cc09c1c215b626ee34d3d6eb045cf3762b975c0b9500011a061484a76b77418"}
Oct 30 22:20:00.768141 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:00.768023    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb" event={"ID":"38a22d19-473c-4f13-a59a-b6d89b9cb232","Type":"ContainerStarted","Data":"36ddba64275a786e4c47d17e922f32958e1fadbe9b67d8123fd5ca5245f2c80c"}
Oct 30 22:20:00.768141 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:00.768045    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"
Oct 30 22:20:00.954777 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:00.951340    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:01.035811 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:01.032326    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4" podStartSLOduration=2.032298419 podStartE2EDuration="2.032298419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:20:00.904295387 +0000 UTC m=+2138.952903112" watchObservedRunningTime="2026-10-30 22:20:01.032298419 +0000 UTC m=+2139.080906149"
Oct 30 22:20:01.056002 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:01.052991    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb" podStartSLOduration=2.052974141 podStartE2EDuration="2.052974141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:20:01.030129247 +0000 UTC m=+2139.078736943" watchObservedRunningTime="2026-10-30 22:20:01.052974141 +0000 UTC m=+2139.101581838"
Oct 30 22:20:02.159893 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:20:02.159846    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:20:04.597124 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:04.596270    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": read tcp 10.132.0.2:50404->10.132.0.116:15021: read: connection reset by peer" start-of-body=
Oct 30 22:20:04.597124 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:04.596334    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n" podUID="b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": read tcp 10.132.0.2:50404->10.132.0.116:15021: read: connection reset by peer"
Oct 30 22:20:04.803234 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:04.803147    4918 generic.go:356] "Generic (PLEG): container finished" podID="b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" containerID="a9f5102059e43d895d91cae02c3deafbbb925ba13fdd048b326573ebf11dbe6a" exitCode=0
Oct 30 22:20:04.803234 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:04.803212    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n" event={"ID":"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6","Type":"ContainerDied","Data":"a9f5102059e43d895d91cae02c3deafbbb925ba13fdd048b326573ebf11dbe6a"}
Oct 30 22:20:04.803676 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:04.803661    4918 scope.go:122] "RemoveContainer" containerID="a9f5102059e43d895d91cae02c3deafbbb925ba13fdd048b326573ebf11dbe6a"
Oct 30 22:20:04.805963 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:04.805922    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:20:04.806049 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:04.806034    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:20:04.806105 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:04.806089    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:20:05.828948 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:05.828912    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n" event={"ID":"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6","Type":"ContainerStarted","Data":"11f43408dbba68f50ff9a675393ed1bf2919209fcc1d658e026d80e85cbedcb7"}
Oct 30 22:20:06.181705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:06.180941    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:06.384762 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:06.384725    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:20:06.384985 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:06.384959    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Oct 30 22:20:06.385039 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:06.385017    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n" podUID="b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Oct 30 22:20:07.384434 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:07.384403    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Oct 30 22:20:07.384853 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:07.384466    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n" podUID="b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Oct 30 22:20:08.384185 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:08.384145    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Oct 30 22:20:08.384373 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:08.384215    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n" podUID="b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Oct 30 22:20:08.486328 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:08.486284    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:08.951938 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:08.951903    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:09.387763 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:09.385922    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Oct 30 22:20:09.387763 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:09.386001    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n" podUID="b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Oct 30 22:20:09.831361 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:09.831323    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:10.133245 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:10.133151    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:10.384371 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:10.384275    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused" start-of-body=
Oct 30 22:20:10.384371 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:10.384349    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n" podUID="b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.116:15021/healthz/ready\": dial tcp 10.132.0.116:15021: connect: connection refused"
Oct 30 22:20:11.427475 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:11.427438    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:20:11.428814 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:11.428771    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:20:11.430447 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:11.430424    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:20:11.661750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:11.657938    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:11.797607 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:11.797512    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"
Oct 30 22:20:11.799865 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:11.799023    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"
Oct 30 22:20:12.775828 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:12.775779    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:13.022755 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:13.022720    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:13.278575 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:13.278535    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:14.473199 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:14.473163    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:14.869330 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:14.869260    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:15.180107 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:15.180078    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:17.141990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:17.141954    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:18.179526 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:18.176219    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:18.426243 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:18.426212    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:18.582194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:18.582100    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"]
Oct 30 22:20:18.768661 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:18.768606    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"]
Oct 30 22:20:18.768883 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:18.768864    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"
Oct 30 22:20:18.853414 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:18.853318    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzp4d\" (UniqueName: \"kubernetes.io/projected/4b5caa06-ef8f-4250-9928-3b5e5b5ef502-kube-api-access-wzp4d\") pod \"payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd\" (UID: \"4b5caa06-ef8f-4250-9928-3b5e5b5ef502\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"
Oct 30 22:20:18.853414 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:18.853386    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b5caa06-ef8f-4250-9928-3b5e5b5ef502-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd\" (UID: \"4b5caa06-ef8f-4250-9928-3b5e5b5ef502\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"
Oct 30 22:20:18.870574 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:18.870547    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w0-0f3344\""
Oct 30 22:20:18.870574 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:18.870565    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w0-0f3344-dockercfg-mp6wc\""
Oct 30 22:20:18.954637 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:18.954604    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b5caa06-ef8f-4250-9928-3b5e5b5ef502-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd\" (UID: \"4b5caa06-ef8f-4250-9928-3b5e5b5ef502\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"
Oct 30 22:20:18.954958 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:18.954938    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzp4d\" (UniqueName: \"kubernetes.io/projected/4b5caa06-ef8f-4250-9928-3b5e5b5ef502-kube-api-access-wzp4d\") pod \"payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd\" (UID: \"4b5caa06-ef8f-4250-9928-3b5e5b5ef502\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"
Oct 30 22:20:18.955384 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:18.955367    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b5caa06-ef8f-4250-9928-3b5e5b5ef502-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd\" (UID: \"4b5caa06-ef8f-4250-9928-3b5e5b5ef502\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"
Oct 30 22:20:19.015831 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:19.015802    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzp4d\" (UniqueName: \"kubernetes.io/projected/4b5caa06-ef8f-4250-9928-3b5e5b5ef502-kube-api-access-wzp4d\") pod \"payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd\" (UID: \"4b5caa06-ef8f-4250-9928-3b5e5b5ef502\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"
Oct 30 22:20:19.086952 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:19.086928    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"
Oct 30 22:20:19.465926 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:19.465894    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"]
Oct 30 22:20:19.468046 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:20:19.468015    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b5caa06_ef8f_4250_9928_3b5e5b5ef502.slice/crio-8161e48c6ce5bb188c48434f078556e428865727d2620533f9634330eb7741d0 WatchSource:0}: Error finding container 8161e48c6ce5bb188c48434f078556e428865727d2620533f9634330eb7741d0: Status 404 returned error can't find the container with id 8161e48c6ce5bb188c48434f078556e428865727d2620533f9634330eb7741d0
Oct 30 22:20:19.944239 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:19.944200    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd" event={"ID":"4b5caa06-ef8f-4250-9928-3b5e5b5ef502","Type":"ContainerStarted","Data":"f1f41c74717251a18e7b56f4f6d19e2423dbdad0ef6f0cdded9be5d674f294d4"}
Oct 30 22:20:19.944427 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:19.944252    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd" event={"ID":"4b5caa06-ef8f-4250-9928-3b5e5b5ef502","Type":"ContainerStarted","Data":"8161e48c6ce5bb188c48434f078556e428865727d2620533f9634330eb7741d0"}
Oct 30 22:20:19.944427 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:19.944299    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"
Oct 30 22:20:20.063167 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:20.063107    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd" podStartSLOduration=2.063089121 podStartE2EDuration="2.063089121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:20:20.058465133 +0000 UTC m=+2158.107072838" watchObservedRunningTime="2026-10-30 22:20:20.063089121 +0000 UTC m=+2158.111696819"
Oct 30 22:20:21.213521 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:21.213482    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:22.140911 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:22.140867    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:24.076530 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:24.076499    4918 scope.go:122] "RemoveContainer" containerID="6fad0c547bf80ada2a53a01df0af9db911c3f690dd2edbc7c81eea37c5e7c244"
Oct 30 22:20:25.186748 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:25.186694    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:27.054701 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:27.054650    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:30.954651 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:30.954616    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"
Oct 30 22:20:32.160041 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:20:32.160003    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:20:32.307492 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:32.307423    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:34.651205 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:34.651163    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:20:36.883161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:36.883130    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"]
Oct 30 22:20:36.889414 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:36.889394    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:36.990347 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:36.990314    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-maas-api-tls\") pod \"maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:36.990602 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:36.990579    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-metrics-certs\") pod \"maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:36.990732 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:36.990717    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj5xr\" (UniqueName: \"kubernetes.io/projected/0655fa00-4030-4426-aa2d-07636dcc82a3-kube-api-access-xj5xr\") pod \"maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:36.990805 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:36.990750    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0655fa00-4030-4426-aa2d-07636dcc82a3-openshift-service-ca\") pod \"maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:36.991314 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:36.991286    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-bdc5fe-serving-cert\""
Oct 30 22:20:36.995176 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:36.995154    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"]
Oct 30 22:20:37.091824 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:37.091786    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj5xr\" (UniqueName: \"kubernetes.io/projected/0655fa00-4030-4426-aa2d-07636dcc82a3-kube-api-access-xj5xr\") pod \"maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:37.091824 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:37.091817    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0655fa00-4030-4426-aa2d-07636dcc82a3-openshift-service-ca\") pod \"maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:37.092071 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:37.091913    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-maas-api-tls\") pod \"maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:37.092071 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:20:37.092049    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-serving-cert: secret "maas-api-e2e-api-a-bdc5fe-serving-cert" not found
Oct 30 22:20:37.092186 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:20:37.092117    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-maas-api-tls podName:0655fa00-4030-4426-aa2d-07636dcc82a3 nodeName:}" failed. No retries permitted until 2026-10-30 22:20:37.592098724 +0000 UTC m=+2175.640706415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-maas-api-tls") pod "maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc" (UID: "0655fa00-4030-4426-aa2d-07636dcc82a3") : secret "maas-api-e2e-api-a-bdc5fe-serving-cert" not found
Oct 30 22:20:37.092268 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:37.092238    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-metrics-certs\") pod \"maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:37.092605 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:37.092584    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0655fa00-4030-4426-aa2d-07636dcc82a3-openshift-service-ca\") pod \"maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:37.094840 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:37.094820    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-metrics-certs\") pod \"maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:37.196759 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:37.196575    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:37.214617 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:37.214545    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj5xr\" (UniqueName: \"kubernetes.io/projected/0655fa00-4030-4426-aa2d-07636dcc82a3-kube-api-access-xj5xr\") pod \"maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:37.446194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:37.446157    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:37.601581 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:37.601496    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-maas-api-tls\") pod \"maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:37.604213 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:37.604183    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-maas-api-tls\") pod \"maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:37.682066 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:37.682037    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:37.803402 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:37.803363    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:38.184557 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:38.184524    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"]
Oct 30 22:20:38.185393 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:20:38.185368    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0655fa00_4030_4426_aa2d_07636dcc82a3.slice/crio-db7b51cb6a78858226b6d43663939d85ae01dcaef32a999c46a26a2d6a9aba0f WatchSource:0}: Error finding container db7b51cb6a78858226b6d43663939d85ae01dcaef32a999c46a26a2d6a9aba0f: Status 404 returned error can't find the container with id db7b51cb6a78858226b6d43663939d85ae01dcaef32a999c46a26a2d6a9aba0f
Oct 30 22:20:38.201088 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:38.201063    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc" event={"ID":"0655fa00-4030-4426-aa2d-07636dcc82a3","Type":"ContainerStarted","Data":"db7b51cb6a78858226b6d43663939d85ae01dcaef32a999c46a26a2d6a9aba0f"}
Oct 30 22:20:39.209966 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:39.209918    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc" event={"ID":"0655fa00-4030-4426-aa2d-07636dcc82a3","Type":"ContainerStarted","Data":"43130a264e9374b89e01ef7084f01c4cf01970174670737ca2caba5c1712a0e1"}
Oct 30 22:20:39.210312 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:39.210013    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:39.275004 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:39.267473    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:39.336779 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:39.336674    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc" podStartSLOduration=2.481588678 podStartE2EDuration="3.336661167s" totalImagesPullingTime="855.072489ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:20:39.332528805 +0000 UTC m=+2177.381136502" watchObservedRunningTime="2026-10-30 22:20:39.336661167 +0000 UTC m=+2177.385268861"
Oct 30 22:20:41.892165 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:41.891926    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:42.599044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:42.599012    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:42.840556 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:42.840518    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:45.226452 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:45.226422    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:20:47.511299 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:47.511262    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:50.837741 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:50.837694    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:52.449778 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:52.449743    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:52.957242 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:52.957207    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:53.271599 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:53.271522    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:57.307557 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:20:57.307518    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:00.430053 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:00.429977    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"]
Oct 30 22:21:00.430575 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:00.430267    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9" podUID="4e40f78c-3818-40fc-b6c6-f9672b66e2dd" containerName="istio-proxy" containerID="cri-o://d9dff843cb77687ed62c7bacb6a4ae06dc647f2b3445e352695a952baefd2001" gracePeriod=30
Oct 30 22:21:01.899708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:01.899602    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:02.160732 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:21:02.160629    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:21:02.208172 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:02.208138    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:02.400708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:02.400382    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:21:02.400708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:02.400484    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9" podUID="4e40f78c-3818-40fc-b6c6-f9672b66e2dd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:21:02.495304 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:02.495222    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:03.486374 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:03.486112    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:03.845004 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:03.844926    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:05.719504 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.719480    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:21:05.843195 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.843160    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-podinfo\") pod \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") "
Oct 30 22:21:05.843370 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.843310    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-data\") pod \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") "
Oct 30 22:21:05.843421 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.843388    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-token\" (UniqueName: \"kubernetes.io/projected/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-token\") pod \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") "
Oct 30 22:21:05.843464 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.843426    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-workload-certs\") pod \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") "
Oct 30 22:21:05.843507 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.843466    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-kube-api-access-wrlfs\" (UniqueName: \"kubernetes.io/projected/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-kube-api-access-wrlfs\") pod \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") "
Oct 30 22:21:05.843542 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.843523    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-workload-socket\") pod \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") "
Oct 30 22:21:05.843593 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.843570    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istiod-ca-cert\") pod \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") "
Oct 30 22:21:05.843894 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.843645    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-data" pod "4e40f78c-3818-40fc-b6c6-f9672b66e2dd" (UID: "4e40f78c-3818-40fc-b6c6-f9672b66e2dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:05.844062 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.843735    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-workload-certs" pod "4e40f78c-3818-40fc-b6c6-f9672b66e2dd" (UID: "4e40f78c-3818-40fc-b6c6-f9672b66e2dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:05.844147 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.843830    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-workload-socket" pod "4e40f78c-3818-40fc-b6c6-f9672b66e2dd" (UID: "4e40f78c-3818-40fc-b6c6-f9672b66e2dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:05.844229 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.843937    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istiod-ca-cert" pod "4e40f78c-3818-40fc-b6c6-f9672b66e2dd" (UID: "4e40f78c-3818-40fc-b6c6-f9672b66e2dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:21:05.844229 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.844099    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-credential-socket" pod "4e40f78c-3818-40fc-b6c6-f9672b66e2dd" (UID: "4e40f78c-3818-40fc-b6c6-f9672b66e2dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:05.844229 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.843913    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-credential-socket\") pod \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") "
Oct 30 22:21:05.844418 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.844295    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-envoy\") pod \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\" (UID: \"4e40f78c-3818-40fc-b6c6-f9672b66e2dd\") "
Oct 30 22:21:05.844896 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.844873    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:05.844896 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.844896    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:05.845065 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.844905    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:05.845065 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.844917    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:05.845065 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.844925    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:05.845782 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.845759    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-podinfo" pod "4e40f78c-3818-40fc-b6c6-f9672b66e2dd" (UID: "4e40f78c-3818-40fc-b6c6-f9672b66e2dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:21:05.846284 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.846259    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-token" pod "4e40f78c-3818-40fc-b6c6-f9672b66e2dd" (UID: "4e40f78c-3818-40fc-b6c6-f9672b66e2dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:21:05.846363 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.846291    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-kube-api-access-wrlfs" pod "4e40f78c-3818-40fc-b6c6-f9672b66e2dd" (UID: "4e40f78c-3818-40fc-b6c6-f9672b66e2dd"). InnerVolumeSpecName "kube-api-access-wrlfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:21:05.846363 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.846356    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-envoy" pod "4e40f78c-3818-40fc-b6c6-f9672b66e2dd" (UID: "4e40f78c-3818-40fc-b6c6-f9672b66e2dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:21:05.946653 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.946565    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrlfs\" (UniqueName: \"kubernetes.io/projected/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-kube-api-access-wrlfs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:05.946653 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.946597    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:05.946653 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.946606    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:05.946653 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:05.946614    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e40f78c-3818-40fc-b6c6-f9672b66e2dd-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:21:06.077469 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:06.077429    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:06.429792 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:06.429753    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:06.522740 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:06.522701    4918 generic.go:356] "Generic (PLEG): container finished" podID="4e40f78c-3818-40fc-b6c6-f9672b66e2dd" containerID="d9dff843cb77687ed62c7bacb6a4ae06dc647f2b3445e352695a952baefd2001" exitCode=0
Oct 30 22:21:06.522740 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:06.522745    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"
Oct 30 22:21:06.522960 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:06.522780    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9" event={"ID":"4e40f78c-3818-40fc-b6c6-f9672b66e2dd","Type":"ContainerDied","Data":"d9dff843cb77687ed62c7bacb6a4ae06dc647f2b3445e352695a952baefd2001"}
Oct 30 22:21:06.522960 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:06.522836    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9" event={"ID":"4e40f78c-3818-40fc-b6c6-f9672b66e2dd","Type":"ContainerDied","Data":"718af2d1bbfb654b4a4a0ebcc7fef07ab5b5b52180260325aff38e189e51d6d4"}
Oct 30 22:21:06.522960 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:06.522862    4918 scope.go:122] "RemoveContainer" containerID="d9dff843cb77687ed62c7bacb6a4ae06dc647f2b3445e352695a952baefd2001"
Oct 30 22:21:06.534695 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:06.534661    4918 scope.go:122] "RemoveContainer" containerID="d9dff843cb77687ed62c7bacb6a4ae06dc647f2b3445e352695a952baefd2001"
Oct 30 22:21:06.535259 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:21:06.535237    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9dff843cb77687ed62c7bacb6a4ae06dc647f2b3445e352695a952baefd2001\": container with ID starting with d9dff843cb77687ed62c7bacb6a4ae06dc647f2b3445e352695a952baefd2001 not found: ID does not exist" containerID="d9dff843cb77687ed62c7bacb6a4ae06dc647f2b3445e352695a952baefd2001"
Oct 30 22:21:06.535338 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:06.535265    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9dff843cb77687ed62c7bacb6a4ae06dc647f2b3445e352695a952baefd2001"} err="failed to get container status \"d9dff843cb77687ed62c7bacb6a4ae06dc647f2b3445e352695a952baefd2001\": rpc error: code = NotFound desc = could not find container \"d9dff843cb77687ed62c7bacb6a4ae06dc647f2b3445e352695a952baefd2001\": container with ID starting with d9dff843cb77687ed62c7bacb6a4ae06dc647f2b3445e352695a952baefd2001 not found: ID does not exist"
Oct 30 22:21:06.747046 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:06.746967    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"]
Oct 30 22:21:06.762801 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:06.762771    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-k57g9"]
Oct 30 22:21:07.302628 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.302596    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"]
Oct 30 22:21:07.303323 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.303308    4918 cpu_manager.go:414] "containerMap: removing container" podUID="4e40f78c-3818-40fc-b6c6-f9672b66e2dd" containerName="istio-proxy"
Oct 30 22:21:07.303375 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.303324    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4e40f78c-3818-40fc-b6c6-f9672b66e2dd" containerName="istio-proxy"
Oct 30 22:21:07.303479 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.303470    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="4e40f78c-3818-40fc-b6c6-f9672b66e2dd" containerName="istio-proxy"
Oct 30 22:21:07.308483 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.308465    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:07.362025 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.361992    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-2d3647-serving-cert\""
Oct 30 22:21:07.367264 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.367237    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"]
Oct 30 22:21:07.466235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.466201    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-maas-api-tls\") pod \"maas-api-e2e-inf-a-2d3647-855974cbf4-kr247\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:07.466412 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.466324    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mhnb\" (UniqueName: \"kubernetes.io/projected/6153697c-23cc-4777-a34e-afd18d26205c-kube-api-access-2mhnb\") pod \"maas-api-e2e-inf-a-2d3647-855974cbf4-kr247\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:07.466596 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.466574    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6153697c-23cc-4777-a34e-afd18d26205c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2d3647-855974cbf4-kr247\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:07.466669 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.466654    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-metrics-certs\") pod \"maas-api-e2e-inf-a-2d3647-855974cbf4-kr247\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:07.577757 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.571998    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6153697c-23cc-4777-a34e-afd18d26205c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2d3647-855974cbf4-kr247\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:07.577757 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.572095    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-metrics-certs\") pod \"maas-api-e2e-inf-a-2d3647-855974cbf4-kr247\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:07.577757 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.572192    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-maas-api-tls\") pod \"maas-api-e2e-inf-a-2d3647-855974cbf4-kr247\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:07.577757 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.572258    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mhnb\" (UniqueName: \"kubernetes.io/projected/6153697c-23cc-4777-a34e-afd18d26205c-kube-api-access-2mhnb\") pod \"maas-api-e2e-inf-a-2d3647-855974cbf4-kr247\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:07.577757 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.573482    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6153697c-23cc-4777-a34e-afd18d26205c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2d3647-855974cbf4-kr247\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:07.577757 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:21:07.576717    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-serving-cert: secret "maas-api-e2e-inf-a-2d3647-serving-cert" not found
Oct 30 22:21:07.577757 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:21:07.576794    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-maas-api-tls podName:6153697c-23cc-4777-a34e-afd18d26205c nodeName:}" failed. No retries permitted until 2026-10-30 22:21:08.076773195 +0000 UTC m=+2206.125380872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-maas-api-tls") pod "maas-api-e2e-inf-a-2d3647-855974cbf4-kr247" (UID: "6153697c-23cc-4777-a34e-afd18d26205c") : secret "maas-api-e2e-inf-a-2d3647-serving-cert" not found
Oct 30 22:21:07.596856 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.596823    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:07.619749 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.616963    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-metrics-certs\") pod \"maas-api-e2e-inf-a-2d3647-855974cbf4-kr247\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:07.633846 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.633815    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mhnb\" (UniqueName: \"kubernetes.io/projected/6153697c-23cc-4777-a34e-afd18d26205c-kube-api-access-2mhnb\") pod \"maas-api-e2e-inf-a-2d3647-855974cbf4-kr247\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:07.855434 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:07.852870    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:08.076289 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:08.076255    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4e40f78c-3818-40fc-b6c6-f9672b66e2dd" path="/var/lib/kubelet/pods/4e40f78c-3818-40fc-b6c6-f9672b66e2dd/volumes"
Oct 30 22:21:08.082262 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:08.082232    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-maas-api-tls\") pod \"maas-api-e2e-inf-a-2d3647-855974cbf4-kr247\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:08.084810 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:08.084783    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-maas-api-tls\") pod \"maas-api-e2e-inf-a-2d3647-855974cbf4-kr247\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:08.097109 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:08.097077    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:08.222648 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:08.222615    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:08.605976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:08.605938    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"]
Oct 30 22:21:08.607412 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:21:08.607378    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6153697c_23cc_4777_a34e_afd18d26205c.slice/crio-9bfe2b220a1fc150412345a0a59fc9a53b433098a8af1b4b67918c823d6f7eb2 WatchSource:0}: Error finding container 9bfe2b220a1fc150412345a0a59fc9a53b433098a8af1b4b67918c823d6f7eb2: Status 404 returned error can't find the container with id 9bfe2b220a1fc150412345a0a59fc9a53b433098a8af1b4b67918c823d6f7eb2
Oct 30 22:21:09.546505 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:09.546473    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247" event={"ID":"6153697c-23cc-4777-a34e-afd18d26205c","Type":"ContainerStarted","Data":"6441a714610a2a9ed66db6cba4d9969f6925aef626125f4df70363f2f46e3e51"}
Oct 30 22:21:09.546921 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:09.546521    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247" event={"ID":"6153697c-23cc-4777-a34e-afd18d26205c","Type":"ContainerStarted","Data":"9bfe2b220a1fc150412345a0a59fc9a53b433098a8af1b4b67918c823d6f7eb2"}
Oct 30 22:21:09.546921 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:09.546611    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:09.797218 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:09.797118    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:10.112456 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:10.112367    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:13.172397 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:13.172361    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:13.749346 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:13.749296    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:13.993343 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:13.993306    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:15.559715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:15.559671    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:21:15.707573 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:15.707507    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247" podStartSLOduration=7.897919976 podStartE2EDuration="8.707490574s" totalImagesPullingTime="809.570598ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:21:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:21:09.678342558 +0000 UTC m=+2207.726950254" watchObservedRunningTime="2026-10-30 22:21:15.707490574 +0000 UTC m=+2213.756098269"
Oct 30 22:21:17.278439 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:17.278404    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:17.544491 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:17.544399    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:18.491907 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:18.491818    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:20.518427 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:20.518376    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:20.771673 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:20.771589    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:23.990570 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:23.990532    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:24.770493 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:24.770434    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:25.544987 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:25.544936    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:29.129310 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:29.129277    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:29.374094 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:29.374054    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:29.600663 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:29.600631    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:32.212373 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:21:32.212336    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:21:34.317510 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:34.317463    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:34.555370 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:34.555338    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:39.419990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:39.419955    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:44.366335 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:44.366298    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:45.550629 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:45.550598    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:46.362644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:46.362614    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:46.642613 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:46.642573    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:49.394162 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:49.394123    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:49.632906 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:49.632878    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:50.704953 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:50.704916    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:51.002326 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:51.002237    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:54.518353 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:54.518323    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:54.813424 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:54.813332    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:55.194595 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:55.194562    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:55.439407 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:55.439369    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:55.688045 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:21:55.688014    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:00.642706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:00.642655    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:02.159081 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:22:02.159039    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:22:05.515752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:05.515710    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:10.625867 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:10.625762    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:15.556869 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:15.556771    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:20.396510 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:20.396476    4918 generic.go:356] "Generic (PLEG): container finished" podID="176181fd-429c-45fe-a755-2d97b9bae435" containerID="48574406e00f4a5bc87b33b2e188c07b24ac6a25eaaf2cd00e66b5aa754a71f7" exitCode=0
Oct 30 22:22:20.396992 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:20.396516    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t" event={"ID":"176181fd-429c-45fe-a755-2d97b9bae435","Type":"ContainerDied","Data":"48574406e00f4a5bc87b33b2e188c07b24ac6a25eaaf2cd00e66b5aa754a71f7"}
Oct 30 22:22:20.397060 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:20.397042    4918 scope.go:122] "RemoveContainer" containerID="48574406e00f4a5bc87b33b2e188c07b24ac6a25eaaf2cd00e66b5aa754a71f7"
Oct 30 22:22:20.398950 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:20.398920    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:22:20.399060 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:20.398989    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:22:20.399060 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:20.399022    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:22:20.547283 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:20.544580    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:21.424132 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:21.424099    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t" event={"ID":"176181fd-429c-45fe-a755-2d97b9bae435","Type":"ContainerStarted","Data":"de91df0dbecebe1fff8a0369e27c09e1816dcb7e57b486adf6e0784550912531"}
Oct 30 22:22:22.173160 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:22.173128    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:22:22.173335 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:22.173251    4918 patch_prober.go:29] interesting pod/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 30 22:22:22.173335 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:22.173308    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t" podUID="176181fd-429c-45fe-a755-2d97b9bae435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 30 22:22:22.602929 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:22.602834    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"]
Oct 30 22:22:22.608626 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:22.604532    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v" podUID="d3b3fed2-c175-45e5-a36c-a063a3201985" containerName="istio-proxy" containerID="cri-o://97473a1b0d1f1d7d723da34ffab774a15483f06e9ba6a6bfda59bb5ff0eab4da" gracePeriod=30
Oct 30 22:22:23.173060 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:23.173028    4918 patch_prober.go:29] interesting pod/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 30 22:22:23.173238 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:23.173087    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t" podUID="176181fd-429c-45fe-a755-2d97b9bae435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 30 22:22:23.792309 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:23.792272    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:22:23.792748 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:23.792329    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v" podUID="d3b3fed2-c175-45e5-a36c-a063a3201985" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:22:24.173578 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:24.173539    4918 patch_prober.go:29] interesting pod/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 30 22:22:24.173782 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:24.173598    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t" podUID="176181fd-429c-45fe-a755-2d97b9bae435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 30 22:22:25.173318 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:25.173276    4918 patch_prober.go:29] interesting pod/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 30 22:22:25.173757 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:25.173341    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t" podUID="176181fd-429c-45fe-a755-2d97b9bae435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 30 22:22:25.644298 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:25.644250    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:26.024332 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:26.024228    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:26.199721 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:26.199642    4918 patch_prober.go:29] interesting pod/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 30 22:22:26.200300 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:26.200267    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t" podUID="176181fd-429c-45fe-a755-2d97b9bae435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 30 22:22:26.345566 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:26.345486    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:27.255315 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:27.255284    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:22:27.256787 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:27.256763    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:22:27.260077 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:27.260028    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:22:27.887153 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:27.887095    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:22:28.002929 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.002895    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-envoy\") pod \"d3b3fed2-c175-45e5-a36c-a063a3201985\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") "
Oct 30 22:22:28.003088 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.002969    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-workload-certs\") pod \"d3b3fed2-c175-45e5-a36c-a063a3201985\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") "
Oct 30 22:22:28.003088 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.002998    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d3b3fed2-c175-45e5-a36c-a063a3201985-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3b3fed2-c175-45e5-a36c-a063a3201985-istiod-ca-cert\") pod \"d3b3fed2-c175-45e5-a36c-a063a3201985\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") "
Oct 30 22:22:28.003088 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.003045    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-data\") pod \"d3b3fed2-c175-45e5-a36c-a063a3201985\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") "
Oct 30 22:22:28.003088 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.003082    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-token\" (UniqueName: \"kubernetes.io/projected/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-token\") pod \"d3b3fed2-c175-45e5-a36c-a063a3201985\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") "
Oct 30 22:22:28.003301 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.003121    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-workload-socket\") pod \"d3b3fed2-c175-45e5-a36c-a063a3201985\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") "
Oct 30 22:22:28.003301 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.003148    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-credential-socket\") pod \"d3b3fed2-c175-45e5-a36c-a063a3201985\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") "
Oct 30 22:22:28.003301 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.003228    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-podinfo\") pod \"d3b3fed2-c175-45e5-a36c-a063a3201985\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") "
Oct 30 22:22:28.003301 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.003255    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-workload-certs" pod "d3b3fed2-c175-45e5-a36c-a063a3201985" (UID: "d3b3fed2-c175-45e5-a36c-a063a3201985"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:28.003519 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.003353    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3b3fed2-c175-45e5-a36c-a063a3201985-istiod-ca-cert" pod "d3b3fed2-c175-45e5-a36c-a063a3201985" (UID: "d3b3fed2-c175-45e5-a36c-a063a3201985"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:22:28.003519 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.003365    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d3b3fed2-c175-45e5-a36c-a063a3201985-kube-api-access-bfm74\" (UniqueName: \"kubernetes.io/projected/d3b3fed2-c175-45e5-a36c-a063a3201985-kube-api-access-bfm74\") pod \"d3b3fed2-c175-45e5-a36c-a063a3201985\" (UID: \"d3b3fed2-c175-45e5-a36c-a063a3201985\") "
Oct 30 22:22:28.003519 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.003424    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-data" pod "d3b3fed2-c175-45e5-a36c-a063a3201985" (UID: "d3b3fed2-c175-45e5-a36c-a063a3201985"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:28.003519 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.003446    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-workload-socket" pod "d3b3fed2-c175-45e5-a36c-a063a3201985" (UID: "d3b3fed2-c175-45e5-a36c-a063a3201985"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:28.003774 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.003645    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-credential-socket" pod "d3b3fed2-c175-45e5-a36c-a063a3201985" (UID: "d3b3fed2-c175-45e5-a36c-a063a3201985"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:28.004279 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.004251    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.004401 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.004286    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3b3fed2-c175-45e5-a36c-a063a3201985-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.004401 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.004301    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.004401 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.004319    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.004401 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.004334    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.005372 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.005349    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-envoy" pod "d3b3fed2-c175-45e5-a36c-a063a3201985" (UID: "d3b3fed2-c175-45e5-a36c-a063a3201985"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:22:28.005544 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.005526    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-podinfo" pod "d3b3fed2-c175-45e5-a36c-a063a3201985" (UID: "d3b3fed2-c175-45e5-a36c-a063a3201985"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:22:28.005592 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.005537    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-token" pod "d3b3fed2-c175-45e5-a36c-a063a3201985" (UID: "d3b3fed2-c175-45e5-a36c-a063a3201985"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:28.005884 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.005862    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3b3fed2-c175-45e5-a36c-a063a3201985-kube-api-access-bfm74" pod "d3b3fed2-c175-45e5-a36c-a063a3201985" (UID: "d3b3fed2-c175-45e5-a36c-a063a3201985"). InnerVolumeSpecName "kube-api-access-bfm74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:28.105118 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.105092    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfm74\" (UniqueName: \"kubernetes.io/projected/d3b3fed2-c175-45e5-a36c-a063a3201985-kube-api-access-bfm74\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.105118 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.105119    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.105325 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.105129    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.105325 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.105139    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3b3fed2-c175-45e5-a36c-a063a3201985-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:28.501536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.501503    4918 generic.go:356] "Generic (PLEG): container finished" podID="d3b3fed2-c175-45e5-a36c-a063a3201985" containerID="97473a1b0d1f1d7d723da34ffab774a15483f06e9ba6a6bfda59bb5ff0eab4da" exitCode=0
Oct 30 22:22:28.501985 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.501555    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"
Oct 30 22:22:28.501985 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.501593    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v" event={"ID":"d3b3fed2-c175-45e5-a36c-a063a3201985","Type":"ContainerDied","Data":"97473a1b0d1f1d7d723da34ffab774a15483f06e9ba6a6bfda59bb5ff0eab4da"}
Oct 30 22:22:28.501985 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.501649    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v" event={"ID":"d3b3fed2-c175-45e5-a36c-a063a3201985","Type":"ContainerDied","Data":"2129128632cfd922ca591d55fc39dacef56cf18b520b5f8e67d79d89e0a6a54c"}
Oct 30 22:22:28.501985 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.501709    4918 scope.go:122] "RemoveContainer" containerID="97473a1b0d1f1d7d723da34ffab774a15483f06e9ba6a6bfda59bb5ff0eab4da"
Oct 30 22:22:28.512647 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.512631    4918 scope.go:122] "RemoveContainer" containerID="97473a1b0d1f1d7d723da34ffab774a15483f06e9ba6a6bfda59bb5ff0eab4da"
Oct 30 22:22:28.512946 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:22:28.512923    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97473a1b0d1f1d7d723da34ffab774a15483f06e9ba6a6bfda59bb5ff0eab4da\": container with ID starting with 97473a1b0d1f1d7d723da34ffab774a15483f06e9ba6a6bfda59bb5ff0eab4da not found: ID does not exist" containerID="97473a1b0d1f1d7d723da34ffab774a15483f06e9ba6a6bfda59bb5ff0eab4da"
Oct 30 22:22:28.513055 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.512950    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97473a1b0d1f1d7d723da34ffab774a15483f06e9ba6a6bfda59bb5ff0eab4da"} err="failed to get container status \"97473a1b0d1f1d7d723da34ffab774a15483f06e9ba6a6bfda59bb5ff0eab4da\": rpc error: code = NotFound desc = could not find container \"97473a1b0d1f1d7d723da34ffab774a15483f06e9ba6a6bfda59bb5ff0eab4da\": container with ID starting with 97473a1b0d1f1d7d723da34ffab774a15483f06e9ba6a6bfda59bb5ff0eab4da not found: ID does not exist"
Oct 30 22:22:28.667799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.667771    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"]
Oct 30 22:22:28.717127 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:28.717102    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-j926v"]
Oct 30 22:22:30.073674 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:30.073643    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d3b3fed2-c175-45e5-a36c-a063a3201985" path="/var/lib/kubelet/pods/d3b3fed2-c175-45e5-a36c-a063a3201985/volumes"
Oct 30 22:22:30.544602 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:30.544563    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:32.158778 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:22:32.158741    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:22:35.382451 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:35.382414    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:40.294242 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:40.294204    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:45.336432 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:45.336394    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:50.497540 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:50.497500    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:50.879757 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:50.879351    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:54.851615 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:54.851584    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"]
Oct 30 22:22:54.852066 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:54.851804    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247" podUID="6153697c-23cc-4777-a34e-afd18d26205c" containerName="maas-api" containerID="cri-o://6441a714610a2a9ed66db6cba4d9969f6925aef626125f4df70363f2f46e3e51" gracePeriod=30
Oct 30 22:22:55.047649 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.047615    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:55.209003 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.208979    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:22:55.303708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.300325    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-metrics-certs\") pod \"6153697c-23cc-4777-a34e-afd18d26205c\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") "
Oct 30 22:22:55.303708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.300416    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6153697c-23cc-4777-a34e-afd18d26205c-kube-api-access-2mhnb\" (UniqueName: \"kubernetes.io/projected/6153697c-23cc-4777-a34e-afd18d26205c-kube-api-access-2mhnb\") pod \"6153697c-23cc-4777-a34e-afd18d26205c\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") "
Oct 30 22:22:55.303708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.300462    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-maas-api-tls\") pod \"6153697c-23cc-4777-a34e-afd18d26205c\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") "
Oct 30 22:22:55.303708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.300534    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6153697c-23cc-4777-a34e-afd18d26205c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6153697c-23cc-4777-a34e-afd18d26205c-openshift-service-ca\") pod \"6153697c-23cc-4777-a34e-afd18d26205c\" (UID: \"6153697c-23cc-4777-a34e-afd18d26205c\") "
Oct 30 22:22:55.303708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.301623    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6153697c-23cc-4777-a34e-afd18d26205c-openshift-service-ca" pod "6153697c-23cc-4777-a34e-afd18d26205c" (UID: "6153697c-23cc-4777-a34e-afd18d26205c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:22:55.317122 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.317046    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-metrics-certs" pod "6153697c-23cc-4777-a34e-afd18d26205c" (UID: "6153697c-23cc-4777-a34e-afd18d26205c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:22:55.355705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.354805    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6153697c-23cc-4777-a34e-afd18d26205c-kube-api-access-2mhnb" pod "6153697c-23cc-4777-a34e-afd18d26205c" (UID: "6153697c-23cc-4777-a34e-afd18d26205c"). InnerVolumeSpecName "kube-api-access-2mhnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:22:55.357964 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.357905    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-maas-api-tls" pod "6153697c-23cc-4777-a34e-afd18d26205c" (UID: "6153697c-23cc-4777-a34e-afd18d26205c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:22:55.402944 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.402915    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:55.402944 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.402943    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mhnb\" (UniqueName: \"kubernetes.io/projected/6153697c-23cc-4777-a34e-afd18d26205c-kube-api-access-2mhnb\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:55.403143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.402952    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6153697c-23cc-4777-a34e-afd18d26205c-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:55.403143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.402961    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6153697c-23cc-4777-a34e-afd18d26205c-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:22:55.568220 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.568140    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:55.734532 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.734503    4918 generic.go:356] "Generic (PLEG): container finished" podID="6153697c-23cc-4777-a34e-afd18d26205c" containerID="6441a714610a2a9ed66db6cba4d9969f6925aef626125f4df70363f2f46e3e51" exitCode=0
Oct 30 22:22:55.734716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.734575    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"
Oct 30 22:22:55.734716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.734594    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247" event={"ID":"6153697c-23cc-4777-a34e-afd18d26205c","Type":"ContainerDied","Data":"6441a714610a2a9ed66db6cba4d9969f6925aef626125f4df70363f2f46e3e51"}
Oct 30 22:22:55.734716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.734648    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247" event={"ID":"6153697c-23cc-4777-a34e-afd18d26205c","Type":"ContainerDied","Data":"9bfe2b220a1fc150412345a0a59fc9a53b433098a8af1b4b67918c823d6f7eb2"}
Oct 30 22:22:55.734716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.734670    4918 scope.go:122] "RemoveContainer" containerID="6441a714610a2a9ed66db6cba4d9969f6925aef626125f4df70363f2f46e3e51"
Oct 30 22:22:55.745602 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.745580    4918 scope.go:122] "RemoveContainer" containerID="6441a714610a2a9ed66db6cba4d9969f6925aef626125f4df70363f2f46e3e51"
Oct 30 22:22:55.745921 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:22:55.745901    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6441a714610a2a9ed66db6cba4d9969f6925aef626125f4df70363f2f46e3e51\": container with ID starting with 6441a714610a2a9ed66db6cba4d9969f6925aef626125f4df70363f2f46e3e51 not found: ID does not exist" containerID="6441a714610a2a9ed66db6cba4d9969f6925aef626125f4df70363f2f46e3e51"
Oct 30 22:22:55.746010 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.745931    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6441a714610a2a9ed66db6cba4d9969f6925aef626125f4df70363f2f46e3e51"} err="failed to get container status \"6441a714610a2a9ed66db6cba4d9969f6925aef626125f4df70363f2f46e3e51\": rpc error: code = NotFound desc = could not find container \"6441a714610a2a9ed66db6cba4d9969f6925aef626125f4df70363f2f46e3e51\": container with ID starting with 6441a714610a2a9ed66db6cba4d9969f6925aef626125f4df70363f2f46e3e51 not found: ID does not exist"
Oct 30 22:22:55.832395 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.832307    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:55.912075 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.912019    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"]
Oct 30 22:22:55.923107 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:55.923051    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2d3647-855974cbf4-kr247"]
Oct 30 22:22:56.074747 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:56.074715    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6153697c-23cc-4777-a34e-afd18d26205c" path="/var/lib/kubelet/pods/6153697c-23cc-4777-a34e-afd18d26205c/volumes"
Oct 30 22:22:56.918706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:56.914820    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:59.218201 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:59.218167    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:59.585181 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:22:59.585105    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:00.190700 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:00.190591    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:01.810490 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:01.810455    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"]
Oct 30 22:23:01.811303 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:01.811284    4918 cpu_manager.go:414] "containerMap: removing container" podUID="6153697c-23cc-4777-a34e-afd18d26205c" containerName="maas-api"
Oct 30 22:23:01.811359 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:01.811304    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6153697c-23cc-4777-a34e-afd18d26205c" containerName="maas-api"
Oct 30 22:23:01.811359 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:01.811327    4918 cpu_manager.go:414] "containerMap: removing container" podUID="d3b3fed2-c175-45e5-a36c-a063a3201985" containerName="istio-proxy"
Oct 30 22:23:01.811359 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:01.811332    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3b3fed2-c175-45e5-a36c-a063a3201985" containerName="istio-proxy"
Oct 30 22:23:01.811495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:01.811485    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="6153697c-23cc-4777-a34e-afd18d26205c" containerName="maas-api"
Oct 30 22:23:01.811533 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:01.811501    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="d3b3fed2-c175-45e5-a36c-a063a3201985" containerName="istio-proxy"
Oct 30 22:23:01.816793 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:01.816772    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:01.872213 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:01.872173    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"]
Oct 30 22:23:01.899813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:01.899778    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/259f9e64-cfca-4654-bea7-772b31f7021d-openshift-service-ca\") pod \"maas-api-e2e-api-b-67657a-697bd4cf68-x86dg\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:01.900000 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:01.899976    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkrlr\" (UniqueName: \"kubernetes.io/projected/259f9e64-cfca-4654-bea7-772b31f7021d-kube-api-access-gkrlr\") pod \"maas-api-e2e-api-b-67657a-697bd4cf68-x86dg\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:01.900159 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:01.900138    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-maas-api-tls\") pod \"maas-api-e2e-api-b-67657a-697bd4cf68-x86dg\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:01.900270 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:01.900240    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-metrics-certs\") pod \"maas-api-e2e-api-b-67657a-697bd4cf68-x86dg\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:01.916533 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:01.916506    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-67657a-serving-cert\""
Oct 30 22:23:02.001884 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:02.001850    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkrlr\" (UniqueName: \"kubernetes.io/projected/259f9e64-cfca-4654-bea7-772b31f7021d-kube-api-access-gkrlr\") pod \"maas-api-e2e-api-b-67657a-697bd4cf68-x86dg\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:02.002067 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:02.001987    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-maas-api-tls\") pod \"maas-api-e2e-api-b-67657a-697bd4cf68-x86dg\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:02.002113 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:02.002079    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-metrics-certs\") pod \"maas-api-e2e-api-b-67657a-697bd4cf68-x86dg\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:02.002158 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:02.002138    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/259f9e64-cfca-4654-bea7-772b31f7021d-openshift-service-ca\") pod \"maas-api-e2e-api-b-67657a-697bd4cf68-x86dg\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:02.002243 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:23:02.002140    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-serving-cert: secret "maas-api-e2e-api-b-67657a-serving-cert" not found
Oct 30 22:23:02.002302 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:23:02.002290    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-maas-api-tls podName:259f9e64-cfca-4654-bea7-772b31f7021d nodeName:}" failed. No retries permitted until 2026-10-30 22:23:02.50226919 +0000 UTC m=+2320.550876864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-maas-api-tls") pod "maas-api-e2e-api-b-67657a-697bd4cf68-x86dg" (UID: "259f9e64-cfca-4654-bea7-772b31f7021d") : secret "maas-api-e2e-api-b-67657a-serving-cert" not found
Oct 30 22:23:02.002777 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:02.002721    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/259f9e64-cfca-4654-bea7-772b31f7021d-openshift-service-ca\") pod \"maas-api-e2e-api-b-67657a-697bd4cf68-x86dg\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:02.004711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:02.004668    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-metrics-certs\") pod \"maas-api-e2e-api-b-67657a-697bd4cf68-x86dg\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:02.098768 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:02.086791    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkrlr\" (UniqueName: \"kubernetes.io/projected/259f9e64-cfca-4654-bea7-772b31f7021d-kube-api-access-gkrlr\") pod \"maas-api-e2e-api-b-67657a-697bd4cf68-x86dg\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:02.136399 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:02.136365    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:02.161639 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:23:02.161606    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:23:02.434442 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:02.434407    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:02.518992 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:02.518960    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-maas-api-tls\") pod \"maas-api-e2e-api-b-67657a-697bd4cf68-x86dg\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:02.521709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:02.521662    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-maas-api-tls\") pod \"maas-api-e2e-api-b-67657a-697bd4cf68-x86dg\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:02.729735 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:02.729617    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:02.732466 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:02.732442    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:03.118659 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:03.118630    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"]
Oct 30 22:23:03.119432 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:23:03.119401    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod259f9e64_cfca_4654_bea7_772b31f7021d.slice/crio-3342c765ffb3240971f94b1f23d35f4c4e637da2f110a85698d81b7e6dd3d0e5 WatchSource:0}: Error finding container 3342c765ffb3240971f94b1f23d35f4c4e637da2f110a85698d81b7e6dd3d0e5: Status 404 returned error can't find the container with id 3342c765ffb3240971f94b1f23d35f4c4e637da2f110a85698d81b7e6dd3d0e5
Oct 30 22:23:03.120916 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:03.120898    4918 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:23:03.791239 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:03.791196    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg" event={"ID":"259f9e64-cfca-4654-bea7-772b31f7021d","Type":"ContainerStarted","Data":"3342c765ffb3240971f94b1f23d35f4c4e637da2f110a85698d81b7e6dd3d0e5"}
Oct 30 22:23:04.799615 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:04.799575    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg" event={"ID":"259f9e64-cfca-4654-bea7-772b31f7021d","Type":"ContainerStarted","Data":"9c9affeb99fc8e2a3eae3aeb54b54d654862a4ce9ed72574891b39f691031a24"}
Oct 30 22:23:04.800086 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:04.799635    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:04.919594 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:04.919538    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg" podStartSLOduration=3.178383069 podStartE2EDuration="3.919524168s" totalImagesPullingTime="741.141099ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:23:04.915596711 +0000 UTC m=+2322.964204419" watchObservedRunningTime="2026-10-30 22:23:04.919524168 +0000 UTC m=+2322.968131892"
Oct 30 22:23:06.663826 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:06.663790    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:07.060794 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:07.056535    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:07.315716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:07.315601    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:07.649332 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:07.649299    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:08.974521 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:08.974487    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"]
Oct 30 22:23:09.083498 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:09.083465    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"]
Oct 30 22:23:09.458246 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:09.457833    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:09.711518 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:09.711423    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:10.851376 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:10.851340    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:23:12.980095 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:12.980058    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:13.974832 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:13.974797    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4" podUID="3424cac6-8a47-4d3e-9faf-e79b9175de1f" containerName="payload-processing" containerID="cri-o://dcdf175ec396dbc130c50348a1ef9679d8f5b1e7aa0c5f72b411eeb699e1ab3e" gracePeriod=25
Oct 30 22:23:14.083930 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.083894    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb" podUID="38a22d19-473c-4f13-a59a-b6d89b9cb232" containerName="payload-pre-processing" containerID="cri-o://4cc09c1c215b626ee34d3d6eb045cf3762b975c0b9500011a061484a76b77418" gracePeriod=25
Oct 30 22:23:14.269461 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.266959    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"
Oct 30 22:23:14.324230 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.324197    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3424cac6-8a47-4d3e-9faf-e79b9175de1f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3424cac6-8a47-4d3e-9faf-e79b9175de1f-plugins-config-volume\") pod \"3424cac6-8a47-4d3e-9faf-e79b9175de1f\" (UID: \"3424cac6-8a47-4d3e-9faf-e79b9175de1f\") "
Oct 30 22:23:14.324442 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.324314    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3424cac6-8a47-4d3e-9faf-e79b9175de1f-kube-api-access-kxf28\" (UniqueName: \"kubernetes.io/projected/3424cac6-8a47-4d3e-9faf-e79b9175de1f-kube-api-access-kxf28\") pod \"3424cac6-8a47-4d3e-9faf-e79b9175de1f\" (UID: \"3424cac6-8a47-4d3e-9faf-e79b9175de1f\") "
Oct 30 22:23:14.324663 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.324641    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3424cac6-8a47-4d3e-9faf-e79b9175de1f-plugins-config-volume" pod "3424cac6-8a47-4d3e-9faf-e79b9175de1f" (UID: "3424cac6-8a47-4d3e-9faf-e79b9175de1f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:14.325077 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.325054    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3424cac6-8a47-4d3e-9faf-e79b9175de1f-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:14.327208 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.327119    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3424cac6-8a47-4d3e-9faf-e79b9175de1f-kube-api-access-kxf28" pod "3424cac6-8a47-4d3e-9faf-e79b9175de1f" (UID: "3424cac6-8a47-4d3e-9faf-e79b9175de1f"). InnerVolumeSpecName "kube-api-access-kxf28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:14.351291 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.351270    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"
Oct 30 22:23:14.426321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.426295    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/38a22d19-473c-4f13-a59a-b6d89b9cb232-kube-api-access-hc99c\" (UniqueName: \"kubernetes.io/projected/38a22d19-473c-4f13-a59a-b6d89b9cb232-kube-api-access-hc99c\") pod \"38a22d19-473c-4f13-a59a-b6d89b9cb232\" (UID: \"38a22d19-473c-4f13-a59a-b6d89b9cb232\") "
Oct 30 22:23:14.426443 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.426419    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/38a22d19-473c-4f13-a59a-b6d89b9cb232-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38a22d19-473c-4f13-a59a-b6d89b9cb232-plugins-config-volume\") pod \"38a22d19-473c-4f13-a59a-b6d89b9cb232\" (UID: \"38a22d19-473c-4f13-a59a-b6d89b9cb232\") "
Oct 30 22:23:14.426856 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.426831    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38a22d19-473c-4f13-a59a-b6d89b9cb232-plugins-config-volume" pod "38a22d19-473c-4f13-a59a-b6d89b9cb232" (UID: "38a22d19-473c-4f13-a59a-b6d89b9cb232"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:14.427104 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.427070    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38a22d19-473c-4f13-a59a-b6d89b9cb232-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:14.427104 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.427092    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxf28\" (UniqueName: \"kubernetes.io/projected/3424cac6-8a47-4d3e-9faf-e79b9175de1f-kube-api-access-kxf28\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:14.428671 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.428651    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38a22d19-473c-4f13-a59a-b6d89b9cb232-kube-api-access-hc99c" pod "38a22d19-473c-4f13-a59a-b6d89b9cb232" (UID: "38a22d19-473c-4f13-a59a-b6d89b9cb232"). InnerVolumeSpecName "kube-api-access-hc99c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:14.529018 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.528939    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hc99c\" (UniqueName: \"kubernetes.io/projected/38a22d19-473c-4f13-a59a-b6d89b9cb232-kube-api-access-hc99c\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:14.913222 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.913185    4918 generic.go:356] "Generic (PLEG): container finished" podID="3424cac6-8a47-4d3e-9faf-e79b9175de1f" containerID="dcdf175ec396dbc130c50348a1ef9679d8f5b1e7aa0c5f72b411eeb699e1ab3e" exitCode=0
Oct 30 22:23:14.913423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.913236    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"
Oct 30 22:23:14.913423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.913278    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4" event={"ID":"3424cac6-8a47-4d3e-9faf-e79b9175de1f","Type":"ContainerDied","Data":"dcdf175ec396dbc130c50348a1ef9679d8f5b1e7aa0c5f72b411eeb699e1ab3e"}
Oct 30 22:23:14.913423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.913376    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4" event={"ID":"3424cac6-8a47-4d3e-9faf-e79b9175de1f","Type":"ContainerDied","Data":"488e066016ea550b19c7a282baa107c01b2cfedc3ae924964a4cd754994c7418"}
Oct 30 22:23:14.913423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.913409    4918 scope.go:122] "RemoveContainer" containerID="dcdf175ec396dbc130c50348a1ef9679d8f5b1e7aa0c5f72b411eeb699e1ab3e"
Oct 30 22:23:14.915209 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.915176    4918 generic.go:356] "Generic (PLEG): container finished" podID="38a22d19-473c-4f13-a59a-b6d89b9cb232" containerID="4cc09c1c215b626ee34d3d6eb045cf3762b975c0b9500011a061484a76b77418" exitCode=0
Oct 30 22:23:14.915372 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.915352    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb" event={"ID":"38a22d19-473c-4f13-a59a-b6d89b9cb232","Type":"ContainerDied","Data":"4cc09c1c215b626ee34d3d6eb045cf3762b975c0b9500011a061484a76b77418"}
Oct 30 22:23:14.915455 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.915403    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb" event={"ID":"38a22d19-473c-4f13-a59a-b6d89b9cb232","Type":"ContainerDied","Data":"36ddba64275a786e4c47d17e922f32958e1fadbe9b67d8123fd5ca5245f2c80c"}
Oct 30 22:23:14.915455 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.915440    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"
Oct 30 22:23:14.926831 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.926807    4918 scope.go:122] "RemoveContainer" containerID="dcdf175ec396dbc130c50348a1ef9679d8f5b1e7aa0c5f72b411eeb699e1ab3e"
Oct 30 22:23:14.927116 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:23:14.927091    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcdf175ec396dbc130c50348a1ef9679d8f5b1e7aa0c5f72b411eeb699e1ab3e\": container with ID starting with dcdf175ec396dbc130c50348a1ef9679d8f5b1e7aa0c5f72b411eeb699e1ab3e not found: ID does not exist" containerID="dcdf175ec396dbc130c50348a1ef9679d8f5b1e7aa0c5f72b411eeb699e1ab3e"
Oct 30 22:23:14.927194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.927128    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcdf175ec396dbc130c50348a1ef9679d8f5b1e7aa0c5f72b411eeb699e1ab3e"} err="failed to get container status \"dcdf175ec396dbc130c50348a1ef9679d8f5b1e7aa0c5f72b411eeb699e1ab3e\": rpc error: code = NotFound desc = could not find container \"dcdf175ec396dbc130c50348a1ef9679d8f5b1e7aa0c5f72b411eeb699e1ab3e\": container with ID starting with dcdf175ec396dbc130c50348a1ef9679d8f5b1e7aa0c5f72b411eeb699e1ab3e not found: ID does not exist"
Oct 30 22:23:14.927194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.927151    4918 scope.go:122] "RemoveContainer" containerID="4cc09c1c215b626ee34d3d6eb045cf3762b975c0b9500011a061484a76b77418"
Oct 30 22:23:14.937895 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.937804    4918 scope.go:122] "RemoveContainer" containerID="4cc09c1c215b626ee34d3d6eb045cf3762b975c0b9500011a061484a76b77418"
Oct 30 22:23:14.938138 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:23:14.938116    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cc09c1c215b626ee34d3d6eb045cf3762b975c0b9500011a061484a76b77418\": container with ID starting with 4cc09c1c215b626ee34d3d6eb045cf3762b975c0b9500011a061484a76b77418 not found: ID does not exist" containerID="4cc09c1c215b626ee34d3d6eb045cf3762b975c0b9500011a061484a76b77418"
Oct 30 22:23:14.938263 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:14.938144    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc09c1c215b626ee34d3d6eb045cf3762b975c0b9500011a061484a76b77418"} err="failed to get container status \"4cc09c1c215b626ee34d3d6eb045cf3762b975c0b9500011a061484a76b77418\": rpc error: code = NotFound desc = could not find container \"4cc09c1c215b626ee34d3d6eb045cf3762b975c0b9500011a061484a76b77418\": container with ID starting with 4cc09c1c215b626ee34d3d6eb045cf3762b975c0b9500011a061484a76b77418 not found: ID does not exist"
Oct 30 22:23:15.082005 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:15.081972    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"]
Oct 30 22:23:15.132467 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:15.132432    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a78655-569f8599d5-cjwd4"]
Oct 30 22:23:15.195032 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:15.194936    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"]
Oct 30 22:23:15.200286 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:15.200255    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a78655-6ddd8df5b7-76rpb"]
Oct 30 22:23:16.077349 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:16.077312    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3424cac6-8a47-4d3e-9faf-e79b9175de1f" path="/var/lib/kubelet/pods/3424cac6-8a47-4d3e-9faf-e79b9175de1f/volumes"
Oct 30 22:23:16.077863 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:16.077841    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="38a22d19-473c-4f13-a59a-b6d89b9cb232" path="/var/lib/kubelet/pods/38a22d19-473c-4f13-a59a-b6d89b9cb232/volumes"
Oct 30 22:23:16.523751 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:16.523720    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:16.831636 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:16.831548    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:17.601713 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:17.597410    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:19.218226 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:19.218189    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:19.472440 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:19.472352    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:19.814612 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:19.814516    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:20.192360 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:20.192325    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:20.217743 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:20.214262    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"]
Oct 30 22:23:20.545304 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:20.545221    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:20.871076 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:20.870993    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:24.276964 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.276922    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"]
Oct 30 22:23:24.277455 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.277176    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp" podUID="6b84ddf8-b9a7-4b38-911a-956bf8348821" containerName="maas-api" containerID="cri-o://e2f716136e50f43b6867140ca9e7d1b8d1de814d67ebaaee612c152a5ddaa5c3" gracePeriod=30
Oct 30 22:23:24.497591 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.497552    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:24.567527 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.567500    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:23:24.680705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.680478    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-metrics-certs\") pod \"6b84ddf8-b9a7-4b38-911a-956bf8348821\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") "
Oct 30 22:23:24.680705 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.680588    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-maas-api-tls\") pod \"6b84ddf8-b9a7-4b38-911a-956bf8348821\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") "
Oct 30 22:23:24.680969 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.680727    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b84ddf8-b9a7-4b38-911a-956bf8348821-kube-api-access-cn2tb\" (UniqueName: \"kubernetes.io/projected/6b84ddf8-b9a7-4b38-911a-956bf8348821-kube-api-access-cn2tb\") pod \"6b84ddf8-b9a7-4b38-911a-956bf8348821\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") "
Oct 30 22:23:24.680969 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.680770    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6b84ddf8-b9a7-4b38-911a-956bf8348821-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b84ddf8-b9a7-4b38-911a-956bf8348821-openshift-service-ca\") pod \"6b84ddf8-b9a7-4b38-911a-956bf8348821\" (UID: \"6b84ddf8-b9a7-4b38-911a-956bf8348821\") "
Oct 30 22:23:24.684704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.681861    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b84ddf8-b9a7-4b38-911a-956bf8348821-openshift-service-ca" pod "6b84ddf8-b9a7-4b38-911a-956bf8348821" (UID: "6b84ddf8-b9a7-4b38-911a-956bf8348821"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:24.775707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.766669    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-maas-api-tls" pod "6b84ddf8-b9a7-4b38-911a-956bf8348821" (UID: "6b84ddf8-b9a7-4b38-911a-956bf8348821"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:23:24.788874 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.776231    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-metrics-certs" pod "6b84ddf8-b9a7-4b38-911a-956bf8348821" (UID: "6b84ddf8-b9a7-4b38-911a-956bf8348821"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:23:24.788874 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.780122    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b84ddf8-b9a7-4b38-911a-956bf8348821-kube-api-access-cn2tb" pod "6b84ddf8-b9a7-4b38-911a-956bf8348821" (UID: "6b84ddf8-b9a7-4b38-911a-956bf8348821"). InnerVolumeSpecName "kube-api-access-cn2tb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:24.788874 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.783638    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:24.788874 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.783712    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b84ddf8-b9a7-4b38-911a-956bf8348821-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:24.788874 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.783730    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn2tb\" (UniqueName: \"kubernetes.io/projected/6b84ddf8-b9a7-4b38-911a-956bf8348821-kube-api-access-cn2tb\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:24.788874 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.783745    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b84ddf8-b9a7-4b38-911a-956bf8348821-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:24.939802 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:24.939762    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:25.077906 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.077832    4918 generic.go:356] "Generic (PLEG): container finished" podID="6b84ddf8-b9a7-4b38-911a-956bf8348821" containerID="e2f716136e50f43b6867140ca9e7d1b8d1de814d67ebaaee612c152a5ddaa5c3" exitCode=0
Oct 30 22:23:25.077906 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.077878    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"
Oct 30 22:23:25.078086 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.077915    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp" event={"ID":"6b84ddf8-b9a7-4b38-911a-956bf8348821","Type":"ContainerDied","Data":"e2f716136e50f43b6867140ca9e7d1b8d1de814d67ebaaee612c152a5ddaa5c3"}
Oct 30 22:23:25.078086 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.077973    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp" event={"ID":"6b84ddf8-b9a7-4b38-911a-956bf8348821","Type":"ContainerDied","Data":"ce4c99f617ae8102e604d933d04ba04df926bd5176721408093b8a56af41f170"}
Oct 30 22:23:25.078086 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.077999    4918 scope.go:122] "RemoveContainer" containerID="e2f716136e50f43b6867140ca9e7d1b8d1de814d67ebaaee612c152a5ddaa5c3"
Oct 30 22:23:25.088899 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.088881    4918 scope.go:122] "RemoveContainer" containerID="e2f716136e50f43b6867140ca9e7d1b8d1de814d67ebaaee612c152a5ddaa5c3"
Oct 30 22:23:25.089169 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:23:25.089145    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2f716136e50f43b6867140ca9e7d1b8d1de814d67ebaaee612c152a5ddaa5c3\": container with ID starting with e2f716136e50f43b6867140ca9e7d1b8d1de814d67ebaaee612c152a5ddaa5c3 not found: ID does not exist" containerID="e2f716136e50f43b6867140ca9e7d1b8d1de814d67ebaaee612c152a5ddaa5c3"
Oct 30 22:23:25.089224 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.089178    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2f716136e50f43b6867140ca9e7d1b8d1de814d67ebaaee612c152a5ddaa5c3"} err="failed to get container status \"e2f716136e50f43b6867140ca9e7d1b8d1de814d67ebaaee612c152a5ddaa5c3\": rpc error: code = NotFound desc = could not find container \"e2f716136e50f43b6867140ca9e7d1b8d1de814d67ebaaee612c152a5ddaa5c3\": container with ID starting with e2f716136e50f43b6867140ca9e7d1b8d1de814d67ebaaee612c152a5ddaa5c3 not found: ID does not exist"
Oct 30 22:23:25.218975 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.218942    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l" podUID="06c38ed1-2d5f-4d24-94e2-66622e8730b2" containerName="payload-pre-processing" containerID="cri-o://e8f53e7a6c699f1324224df7a8631fd08760bf524bf2fdc821c8873a5aacb89e" gracePeriod=25
Oct 30 22:23:25.243971 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.243948    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"]
Oct 30 22:23:25.295072 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.295042    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w0-ec058c-9f99dfccd-xn4tp"]
Oct 30 22:23:25.636981 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.636950    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"
Oct 30 22:23:25.704471 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.704440    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06c38ed1-2d5f-4d24-94e2-66622e8730b2-kube-api-access-zxd7n\" (UniqueName: \"kubernetes.io/projected/06c38ed1-2d5f-4d24-94e2-66622e8730b2-kube-api-access-zxd7n\") pod \"06c38ed1-2d5f-4d24-94e2-66622e8730b2\" (UID: \"06c38ed1-2d5f-4d24-94e2-66622e8730b2\") "
Oct 30 22:23:25.704612 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.704605    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06c38ed1-2d5f-4d24-94e2-66622e8730b2-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06c38ed1-2d5f-4d24-94e2-66622e8730b2-plugins-config-volume\") pod \"06c38ed1-2d5f-4d24-94e2-66622e8730b2\" (UID: \"06c38ed1-2d5f-4d24-94e2-66622e8730b2\") "
Oct 30 22:23:25.704995 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.704960    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06c38ed1-2d5f-4d24-94e2-66622e8730b2-plugins-config-volume" pod "06c38ed1-2d5f-4d24-94e2-66622e8730b2" (UID: "06c38ed1-2d5f-4d24-94e2-66622e8730b2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:25.705116 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.705038    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06c38ed1-2d5f-4d24-94e2-66622e8730b2-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:25.706731 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.706712    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06c38ed1-2d5f-4d24-94e2-66622e8730b2-kube-api-access-zxd7n" pod "06c38ed1-2d5f-4d24-94e2-66622e8730b2" (UID: "06c38ed1-2d5f-4d24-94e2-66622e8730b2"). InnerVolumeSpecName "kube-api-access-zxd7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:25.806378 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:25.806348    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxd7n\" (UniqueName: \"kubernetes.io/projected/06c38ed1-2d5f-4d24-94e2-66622e8730b2-kube-api-access-zxd7n\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:26.085143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:26.085107    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6b84ddf8-b9a7-4b38-911a-956bf8348821" path="/var/lib/kubelet/pods/6b84ddf8-b9a7-4b38-911a-956bf8348821/volumes"
Oct 30 22:23:26.088859 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:26.088832    4918 generic.go:356] "Generic (PLEG): container finished" podID="06c38ed1-2d5f-4d24-94e2-66622e8730b2" containerID="e8f53e7a6c699f1324224df7a8631fd08760bf524bf2fdc821c8873a5aacb89e" exitCode=0
Oct 30 22:23:26.088988 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:26.088884    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"
Oct 30 22:23:26.088988 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:26.088905    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l" event={"ID":"06c38ed1-2d5f-4d24-94e2-66622e8730b2","Type":"ContainerDied","Data":"e8f53e7a6c699f1324224df7a8631fd08760bf524bf2fdc821c8873a5aacb89e"}
Oct 30 22:23:26.088988 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:26.088948    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l" event={"ID":"06c38ed1-2d5f-4d24-94e2-66622e8730b2","Type":"ContainerDied","Data":"51ce2c6d9d8218236e070907bce771115ebb70d918b089c289237ef16b02c3b9"}
Oct 30 22:23:26.088988 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:26.088969    4918 scope.go:122] "RemoveContainer" containerID="e8f53e7a6c699f1324224df7a8631fd08760bf524bf2fdc821c8873a5aacb89e"
Oct 30 22:23:26.104316 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:26.104294    4918 scope.go:122] "RemoveContainer" containerID="e8f53e7a6c699f1324224df7a8631fd08760bf524bf2fdc821c8873a5aacb89e"
Oct 30 22:23:26.104619 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:23:26.104592    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8f53e7a6c699f1324224df7a8631fd08760bf524bf2fdc821c8873a5aacb89e\": container with ID starting with e8f53e7a6c699f1324224df7a8631fd08760bf524bf2fdc821c8873a5aacb89e not found: ID does not exist" containerID="e8f53e7a6c699f1324224df7a8631fd08760bf524bf2fdc821c8873a5aacb89e"
Oct 30 22:23:26.104704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:26.104631    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8f53e7a6c699f1324224df7a8631fd08760bf524bf2fdc821c8873a5aacb89e"} err="failed to get container status \"e8f53e7a6c699f1324224df7a8631fd08760bf524bf2fdc821c8873a5aacb89e\": rpc error: code = NotFound desc = could not find container \"e8f53e7a6c699f1324224df7a8631fd08760bf524bf2fdc821c8873a5aacb89e\": container with ID starting with e8f53e7a6c699f1324224df7a8631fd08760bf524bf2fdc821c8873a5aacb89e not found: ID does not exist"
Oct 30 22:23:26.288710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:26.288650    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"]
Oct 30 22:23:26.294267 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:26.294238    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2d8852-67c549864c-xls9l"]
Oct 30 22:23:26.352469 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:26.352395    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:26.608540 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:26.608446    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:26.821930 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:26.821889    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"]
Oct 30 22:23:26.822189 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:26.822161    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t" podUID="176181fd-429c-45fe-a755-2d97b9bae435" containerName="istio-proxy" containerID="cri-o://de91df0dbecebe1fff8a0369e27c09e1816dcb7e57b486adf6e0784550912531" gracePeriod=30
Oct 30 22:23:26.982708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:26.972035    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:27.233297 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:27.233200    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:27.258687 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:27.258649    4918 patch_prober.go:29] interesting pod/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:23:27.258791 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:27.258745    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t" podUID="176181fd-429c-45fe-a755-2d97b9bae435" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:23:28.074307 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:28.074278    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="06c38ed1-2d5f-4d24-94e2-66622e8730b2" path="/var/lib/kubelet/pods/06c38ed1-2d5f-4d24-94e2-66622e8730b2/volumes"
Oct 30 22:23:28.936815 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:28.936783    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:29.216294 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:29.216204    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:29.880905 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:29.880872    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:31.765242 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:31.765201    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:32.050157 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.050052    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:32.140067 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.140034    4918 generic.go:356] "Generic (PLEG): container finished" podID="176181fd-429c-45fe-a755-2d97b9bae435" containerID="de91df0dbecebe1fff8a0369e27c09e1816dcb7e57b486adf6e0784550912531" exitCode=0
Oct 30 22:23:32.140233 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.140090    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t" event={"ID":"176181fd-429c-45fe-a755-2d97b9bae435","Type":"ContainerDied","Data":"de91df0dbecebe1fff8a0369e27c09e1816dcb7e57b486adf6e0784550912531"}
Oct 30 22:23:32.140233 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.140150    4918 scope.go:122] "RemoveContainer" containerID="48574406e00f4a5bc87b33b2e188c07b24ac6a25eaaf2cd00e66b5aa754a71f7"
Oct 30 22:23:32.164216 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:23:32.164183    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:23:32.175420 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.175400    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:23:32.248456 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.248435    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/176181fd-429c-45fe-a755-2d97b9bae435-kube-api-access-gvjx9\" (UniqueName: \"kubernetes.io/projected/176181fd-429c-45fe-a755-2d97b9bae435-kube-api-access-gvjx9\") pod \"176181fd-429c-45fe-a755-2d97b9bae435\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") "
Oct 30 22:23:32.248582 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.248526    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/176181fd-429c-45fe-a755-2d97b9bae435-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/176181fd-429c-45fe-a755-2d97b9bae435-istiod-ca-cert\") pod \"176181fd-429c-45fe-a755-2d97b9bae435\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") "
Oct 30 22:23:32.248582 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.248553    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-credential-socket\") pod \"176181fd-429c-45fe-a755-2d97b9bae435\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") "
Oct 30 22:23:32.248582 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.248577    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/176181fd-429c-45fe-a755-2d97b9bae435-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/176181fd-429c-45fe-a755-2d97b9bae435-istio-podinfo\") pod \"176181fd-429c-45fe-a755-2d97b9bae435\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") "
Oct 30 22:23:32.248779 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.248612    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-istio-data\") pod \"176181fd-429c-45fe-a755-2d97b9bae435\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") "
Oct 30 22:23:32.248779 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.248640    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/176181fd-429c-45fe-a755-2d97b9bae435-istio-token\" (UniqueName: \"kubernetes.io/projected/176181fd-429c-45fe-a755-2d97b9bae435-istio-token\") pod \"176181fd-429c-45fe-a755-2d97b9bae435\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") "
Oct 30 22:23:32.248779 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.248667    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-workload-socket\") pod \"176181fd-429c-45fe-a755-2d97b9bae435\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") "
Oct 30 22:23:32.248779 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.248751    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-istio-envoy\") pod \"176181fd-429c-45fe-a755-2d97b9bae435\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") "
Oct 30 22:23:32.248988 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.248900    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-credential-socket" pod "176181fd-429c-45fe-a755-2d97b9bae435" (UID: "176181fd-429c-45fe-a755-2d97b9bae435"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:32.249055 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.248998    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-istio-data" pod "176181fd-429c-45fe-a755-2d97b9bae435" (UID: "176181fd-429c-45fe-a755-2d97b9bae435"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:32.249055 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.249026    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-workload-socket" pod "176181fd-429c-45fe-a755-2d97b9bae435" (UID: "176181fd-429c-45fe-a755-2d97b9bae435"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:32.249181 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.249058    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-workload-certs\") pod \"176181fd-429c-45fe-a755-2d97b9bae435\" (UID: \"176181fd-429c-45fe-a755-2d97b9bae435\") "
Oct 30 22:23:32.249181 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.249087    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/176181fd-429c-45fe-a755-2d97b9bae435-istiod-ca-cert" pod "176181fd-429c-45fe-a755-2d97b9bae435" (UID: "176181fd-429c-45fe-a755-2d97b9bae435"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:32.249324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.249293    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-workload-certs" pod "176181fd-429c-45fe-a755-2d97b9bae435" (UID: "176181fd-429c-45fe-a755-2d97b9bae435"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:32.250007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.249983    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:32.250007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.250011    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:32.250197 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.250028    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:32.250197 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.250044    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/176181fd-429c-45fe-a755-2d97b9bae435-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:32.250197 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.250061    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:32.250981 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.250957    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-istio-envoy" pod "176181fd-429c-45fe-a755-2d97b9bae435" (UID: "176181fd-429c-45fe-a755-2d97b9bae435"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:23:32.251095 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.251061    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/176181fd-429c-45fe-a755-2d97b9bae435-istio-token" pod "176181fd-429c-45fe-a755-2d97b9bae435" (UID: "176181fd-429c-45fe-a755-2d97b9bae435"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:32.251095 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.251089    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/176181fd-429c-45fe-a755-2d97b9bae435-istio-podinfo" pod "176181fd-429c-45fe-a755-2d97b9bae435" (UID: "176181fd-429c-45fe-a755-2d97b9bae435"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:23:32.251295 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.251278    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/176181fd-429c-45fe-a755-2d97b9bae435-kube-api-access-gvjx9" pod "176181fd-429c-45fe-a755-2d97b9bae435" (UID: "176181fd-429c-45fe-a755-2d97b9bae435"). InnerVolumeSpecName "kube-api-access-gvjx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:32.340099 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.340035    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:32.350987 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.350960    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvjx9\" (UniqueName: \"kubernetes.io/projected/176181fd-429c-45fe-a755-2d97b9bae435-kube-api-access-gvjx9\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:32.350987 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.350988    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/176181fd-429c-45fe-a755-2d97b9bae435-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:32.351183 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.351001    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/176181fd-429c-45fe-a755-2d97b9bae435-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:32.351183 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:32.351010    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/176181fd-429c-45fe-a755-2d97b9bae435-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:33.147587 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:33.147559    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"
Oct 30 22:23:33.148063 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:33.147608    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t" event={"ID":"176181fd-429c-45fe-a755-2d97b9bae435","Type":"ContainerDied","Data":"efd3b96252344fbafb9c39bdb67f86fd66e668787738f6bb951c10d12c8bf824"}
Oct 30 22:23:33.148063 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:33.147665    4918 scope.go:122] "RemoveContainer" containerID="de91df0dbecebe1fff8a0369e27c09e1816dcb7e57b486adf6e0784550912531"
Oct 30 22:23:33.436888 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:33.436808    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"]
Oct 30 22:23:33.445874 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:33.445847    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a78655-openshift-default-6f78b6895f-n956t"]
Oct 30 22:23:34.089644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:34.089602    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="176181fd-429c-45fe-a755-2d97b9bae435" path="/var/lib/kubelet/pods/176181fd-429c-45fe-a755-2d97b9bae435/volumes"
Oct 30 22:23:36.495954 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:36.495916    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:36.774354 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:36.774272    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:37.033830 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:37.033728    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:37.623264 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:37.623230    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:43.007538 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:43.007507    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:47.786546 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:47.786514    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"]
Oct 30 22:23:48.275003 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:48.274963    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:48.568429 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:48.568319    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:50.418231 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:50.418195    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"]
Oct 30 22:23:50.797187 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:50.797081    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:51.082213 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:51.082117    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:52.787324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:52.787266    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd" podUID="4b5caa06-ef8f-4250-9928-3b5e5b5ef502" containerName="payload-processing" containerID="cri-o://f1f41c74717251a18e7b56f4f6d19e2423dbdad0ef6f0cdded9be5d674f294d4" gracePeriod=25
Oct 30 22:23:53.082245 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.082218    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"
Oct 30 22:23:53.140716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.140663    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b5caa06-ef8f-4250-9928-3b5e5b5ef502-kube-api-access-wzp4d\" (UniqueName: \"kubernetes.io/projected/4b5caa06-ef8f-4250-9928-3b5e5b5ef502-kube-api-access-wzp4d\") pod \"4b5caa06-ef8f-4250-9928-3b5e5b5ef502\" (UID: \"4b5caa06-ef8f-4250-9928-3b5e5b5ef502\") "
Oct 30 22:23:53.140849 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.140814    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4b5caa06-ef8f-4250-9928-3b5e5b5ef502-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b5caa06-ef8f-4250-9928-3b5e5b5ef502-plugins-config-volume\") pod \"4b5caa06-ef8f-4250-9928-3b5e5b5ef502\" (UID: \"4b5caa06-ef8f-4250-9928-3b5e5b5ef502\") "
Oct 30 22:23:53.141151 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.141125    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b5caa06-ef8f-4250-9928-3b5e5b5ef502-plugins-config-volume" pod "4b5caa06-ef8f-4250-9928-3b5e5b5ef502" (UID: "4b5caa06-ef8f-4250-9928-3b5e5b5ef502"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:53.141436 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.141405    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b5caa06-ef8f-4250-9928-3b5e5b5ef502-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:53.142931 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.142912    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b5caa06-ef8f-4250-9928-3b5e5b5ef502-kube-api-access-wzp4d" pod "4b5caa06-ef8f-4250-9928-3b5e5b5ef502" (UID: "4b5caa06-ef8f-4250-9928-3b5e5b5ef502"). InnerVolumeSpecName "kube-api-access-wzp4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:53.242216 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.242188    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzp4d\" (UniqueName: \"kubernetes.io/projected/4b5caa06-ef8f-4250-9928-3b5e5b5ef502-kube-api-access-wzp4d\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:53.340949 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.340874    4918 generic.go:356] "Generic (PLEG): container finished" podID="4b5caa06-ef8f-4250-9928-3b5e5b5ef502" containerID="f1f41c74717251a18e7b56f4f6d19e2423dbdad0ef6f0cdded9be5d674f294d4" exitCode=0
Oct 30 22:23:53.340949 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.340919    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"
Oct 30 22:23:53.341168 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.340958    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd" event={"ID":"4b5caa06-ef8f-4250-9928-3b5e5b5ef502","Type":"ContainerDied","Data":"f1f41c74717251a18e7b56f4f6d19e2423dbdad0ef6f0cdded9be5d674f294d4"}
Oct 30 22:23:53.341168 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.341008    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd" event={"ID":"4b5caa06-ef8f-4250-9928-3b5e5b5ef502","Type":"ContainerDied","Data":"8161e48c6ce5bb188c48434f078556e428865727d2620533f9634330eb7741d0"}
Oct 30 22:23:53.341168 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.341030    4918 scope.go:122] "RemoveContainer" containerID="f1f41c74717251a18e7b56f4f6d19e2423dbdad0ef6f0cdded9be5d674f294d4"
Oct 30 22:23:53.354174 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.352728    4918 scope.go:122] "RemoveContainer" containerID="f1f41c74717251a18e7b56f4f6d19e2423dbdad0ef6f0cdded9be5d674f294d4"
Oct 30 22:23:53.354497 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:23:53.354473    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1f41c74717251a18e7b56f4f6d19e2423dbdad0ef6f0cdded9be5d674f294d4\": container with ID starting with f1f41c74717251a18e7b56f4f6d19e2423dbdad0ef6f0cdded9be5d674f294d4 not found: ID does not exist" containerID="f1f41c74717251a18e7b56f4f6d19e2423dbdad0ef6f0cdded9be5d674f294d4"
Oct 30 22:23:53.354586 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.354501    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1f41c74717251a18e7b56f4f6d19e2423dbdad0ef6f0cdded9be5d674f294d4"} err="failed to get container status \"f1f41c74717251a18e7b56f4f6d19e2423dbdad0ef6f0cdded9be5d674f294d4\": rpc error: code = NotFound desc = could not find container \"f1f41c74717251a18e7b56f4f6d19e2423dbdad0ef6f0cdded9be5d674f294d4\": container with ID starting with f1f41c74717251a18e7b56f4f6d19e2423dbdad0ef6f0cdded9be5d674f294d4 not found: ID does not exist"
Oct 30 22:23:53.507193 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.507163    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"]
Oct 30 22:23:53.512794 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.512771    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w0-0f3344-6987d95b99-4qpcd"]
Oct 30 22:23:53.864647 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:53.864617    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:54.073432 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:54.073405    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4b5caa06-ef8f-4250-9928-3b5e5b5ef502" path="/var/lib/kubelet/pods/4b5caa06-ef8f-4250-9928-3b5e5b5ef502/volumes"
Oct 30 22:23:55.418881 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:55.418835    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62" podUID="b87b4e20-3e41-4364-a89e-f92ef042a0db" containerName="payload-pre-processing" containerID="cri-o://045db80882fd633c86401413e442a677ea2529a0321397ece4c5cf9d90f4ac87" gracePeriod=25
Oct 30 22:23:55.681475 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:55.681418    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"
Oct 30 22:23:55.769974 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:55.769933    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b87b4e20-3e41-4364-a89e-f92ef042a0db-kube-api-access-kf7t6\" (UniqueName: \"kubernetes.io/projected/b87b4e20-3e41-4364-a89e-f92ef042a0db-kube-api-access-kf7t6\") pod \"b87b4e20-3e41-4364-a89e-f92ef042a0db\" (UID: \"b87b4e20-3e41-4364-a89e-f92ef042a0db\") "
Oct 30 22:23:55.770142 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:55.770120    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b87b4e20-3e41-4364-a89e-f92ef042a0db-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b87b4e20-3e41-4364-a89e-f92ef042a0db-plugins-config-volume\") pod \"b87b4e20-3e41-4364-a89e-f92ef042a0db\" (UID: \"b87b4e20-3e41-4364-a89e-f92ef042a0db\") "
Oct 30 22:23:55.770529 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:55.770501    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b87b4e20-3e41-4364-a89e-f92ef042a0db-plugins-config-volume" pod "b87b4e20-3e41-4364-a89e-f92ef042a0db" (UID: "b87b4e20-3e41-4364-a89e-f92ef042a0db"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:23:55.770725 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:55.770703    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b87b4e20-3e41-4364-a89e-f92ef042a0db-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:55.772988 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:55.772926    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b87b4e20-3e41-4364-a89e-f92ef042a0db-kube-api-access-kf7t6" pod "b87b4e20-3e41-4364-a89e-f92ef042a0db" (UID: "b87b4e20-3e41-4364-a89e-f92ef042a0db"). InnerVolumeSpecName "kube-api-access-kf7t6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:23:55.871645 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:55.871613    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf7t6\" (UniqueName: \"kubernetes.io/projected/b87b4e20-3e41-4364-a89e-f92ef042a0db-kube-api-access-kf7t6\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:23:56.373408 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:56.373324    4918 generic.go:356] "Generic (PLEG): container finished" podID="b87b4e20-3e41-4364-a89e-f92ef042a0db" containerID="045db80882fd633c86401413e442a677ea2529a0321397ece4c5cf9d90f4ac87" exitCode=0
Oct 30 22:23:56.373408 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:56.373397    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"
Oct 30 22:23:56.373630 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:56.373396    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62" event={"ID":"b87b4e20-3e41-4364-a89e-f92ef042a0db","Type":"ContainerDied","Data":"045db80882fd633c86401413e442a677ea2529a0321397ece4c5cf9d90f4ac87"}
Oct 30 22:23:56.373630 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:56.373547    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62" event={"ID":"b87b4e20-3e41-4364-a89e-f92ef042a0db","Type":"ContainerDied","Data":"5c0176392aa25c934799bdfe98f18cc693651712715e5b1f27e2c685cb6d9b6c"}
Oct 30 22:23:56.373630 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:56.373569    4918 scope.go:122] "RemoveContainer" containerID="045db80882fd633c86401413e442a677ea2529a0321397ece4c5cf9d90f4ac87"
Oct 30 22:23:56.385076 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:56.385061    4918 scope.go:122] "RemoveContainer" containerID="045db80882fd633c86401413e442a677ea2529a0321397ece4c5cf9d90f4ac87"
Oct 30 22:23:56.385358 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:23:56.385336    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"045db80882fd633c86401413e442a677ea2529a0321397ece4c5cf9d90f4ac87\": container with ID starting with 045db80882fd633c86401413e442a677ea2529a0321397ece4c5cf9d90f4ac87 not found: ID does not exist" containerID="045db80882fd633c86401413e442a677ea2529a0321397ece4c5cf9d90f4ac87"
Oct 30 22:23:56.385427 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:56.385364    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"045db80882fd633c86401413e442a677ea2529a0321397ece4c5cf9d90f4ac87"} err="failed to get container status \"045db80882fd633c86401413e442a677ea2529a0321397ece4c5cf9d90f4ac87\": rpc error: code = NotFound desc = could not find container \"045db80882fd633c86401413e442a677ea2529a0321397ece4c5cf9d90f4ac87\": container with ID starting with 045db80882fd633c86401413e442a677ea2529a0321397ece4c5cf9d90f4ac87 not found: ID does not exist"
Oct 30 22:23:56.537745 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:56.537717    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"]
Oct 30 22:23:56.586845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:56.586819    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w5-9a96b4-5d7b575c6c-jfk62"]
Oct 30 22:23:58.074479 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:58.074445    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b87b4e20-3e41-4364-a89e-f92ef042a0db" path="/var/lib/kubelet/pods/b87b4e20-3e41-4364-a89e-f92ef042a0db/volumes"
Oct 30 22:23:59.322901 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:23:59.322857    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:02.159024 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:24:02.158936    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:24:04.622234 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:04.622190    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:09.014167 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.014133    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"]
Oct 30 22:24:09.014627 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.014380    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc" podUID="0655fa00-4030-4426-aa2d-07636dcc82a3" containerName="maas-api" containerID="cri-o://43130a264e9374b89e01ef7084f01c4cf01970174670737ca2caba5c1712a0e1" gracePeriod=30
Oct 30 22:24:09.259172 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.259071    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:09.354068 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.354040    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:24:09.405380 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.398141    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0655fa00-4030-4426-aa2d-07636dcc82a3-kube-api-access-xj5xr\" (UniqueName: \"kubernetes.io/projected/0655fa00-4030-4426-aa2d-07636dcc82a3-kube-api-access-xj5xr\") pod \"0655fa00-4030-4426-aa2d-07636dcc82a3\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") "
Oct 30 22:24:09.410203 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.410164    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-maas-api-tls\") pod \"0655fa00-4030-4426-aa2d-07636dcc82a3\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") "
Oct 30 22:24:09.410729 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.410507    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0655fa00-4030-4426-aa2d-07636dcc82a3-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0655fa00-4030-4426-aa2d-07636dcc82a3-openshift-service-ca\") pod \"0655fa00-4030-4426-aa2d-07636dcc82a3\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") "
Oct 30 22:24:09.410729 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.410579    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-metrics-certs\") pod \"0655fa00-4030-4426-aa2d-07636dcc82a3\" (UID: \"0655fa00-4030-4426-aa2d-07636dcc82a3\") "
Oct 30 22:24:09.413323 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.412493    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0655fa00-4030-4426-aa2d-07636dcc82a3-kube-api-access-xj5xr" pod "0655fa00-4030-4426-aa2d-07636dcc82a3" (UID: "0655fa00-4030-4426-aa2d-07636dcc82a3"). InnerVolumeSpecName "kube-api-access-xj5xr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:09.418619 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.415092    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0655fa00-4030-4426-aa2d-07636dcc82a3-openshift-service-ca" pod "0655fa00-4030-4426-aa2d-07636dcc82a3" (UID: "0655fa00-4030-4426-aa2d-07636dcc82a3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:09.454546 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.454180    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-metrics-certs" pod "0655fa00-4030-4426-aa2d-07636dcc82a3" (UID: "0655fa00-4030-4426-aa2d-07636dcc82a3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:24:09.457058 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.456642    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-maas-api-tls" pod "0655fa00-4030-4426-aa2d-07636dcc82a3" (UID: "0655fa00-4030-4426-aa2d-07636dcc82a3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:24:09.513462 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.513409    4918 generic.go:356] "Generic (PLEG): container finished" podID="0655fa00-4030-4426-aa2d-07636dcc82a3" containerID="43130a264e9374b89e01ef7084f01c4cf01970174670737ca2caba5c1712a0e1" exitCode=0
Oct 30 22:24:09.513813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.513787    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc" event={"ID":"0655fa00-4030-4426-aa2d-07636dcc82a3","Type":"ContainerDied","Data":"43130a264e9374b89e01ef7084f01c4cf01970174670737ca2caba5c1712a0e1"}
Oct 30 22:24:09.514039 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.514022    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc" event={"ID":"0655fa00-4030-4426-aa2d-07636dcc82a3","Type":"ContainerDied","Data":"db7b51cb6a78858226b6d43663939d85ae01dcaef32a999c46a26a2d6a9aba0f"}
Oct 30 22:24:09.514182 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.514170    4918 scope.go:122] "RemoveContainer" containerID="43130a264e9374b89e01ef7084f01c4cf01970174670737ca2caba5c1712a0e1"
Oct 30 22:24:09.514554 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.514538    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"
Oct 30 22:24:09.519976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.519948    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj5xr\" (UniqueName: \"kubernetes.io/projected/0655fa00-4030-4426-aa2d-07636dcc82a3-kube-api-access-xj5xr\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:09.520071 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.519982    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:09.520071 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.519998    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0655fa00-4030-4426-aa2d-07636dcc82a3-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:09.520071 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.520031    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0655fa00-4030-4426-aa2d-07636dcc82a3-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:09.533876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.533856    4918 scope.go:122] "RemoveContainer" containerID="43130a264e9374b89e01ef7084f01c4cf01970174670737ca2caba5c1712a0e1"
Oct 30 22:24:09.534228 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:24:09.534207    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43130a264e9374b89e01ef7084f01c4cf01970174670737ca2caba5c1712a0e1\": container with ID starting with 43130a264e9374b89e01ef7084f01c4cf01970174670737ca2caba5c1712a0e1 not found: ID does not exist" containerID="43130a264e9374b89e01ef7084f01c4cf01970174670737ca2caba5c1712a0e1"
Oct 30 22:24:09.534299 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.534238    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43130a264e9374b89e01ef7084f01c4cf01970174670737ca2caba5c1712a0e1"} err="failed to get container status \"43130a264e9374b89e01ef7084f01c4cf01970174670737ca2caba5c1712a0e1\": rpc error: code = NotFound desc = could not find container \"43130a264e9374b89e01ef7084f01c4cf01970174670737ca2caba5c1712a0e1\": container with ID starting with 43130a264e9374b89e01ef7084f01c4cf01970174670737ca2caba5c1712a0e1 not found: ID does not exist"
Oct 30 22:24:09.699448 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.699411    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"]
Oct 30 22:24:09.704671 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:09.704645    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bdc5fe-76fd8cf7fd-k7lgc"]
Oct 30 22:24:10.089707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:10.086035    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0655fa00-4030-4426-aa2d-07636dcc82a3" path="/var/lib/kubelet/pods/0655fa00-4030-4426-aa2d-07636dcc82a3/volumes"
Oct 30 22:24:11.088309 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:11.088277    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:11.387535 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:11.387452    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:15.347862 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:15.347775    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:15.617841 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:15.617528    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:15.872500 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:15.872415    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:16.135572 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:16.135482    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:17.359056 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:17.359023    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:17.703103 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:17.698228    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:18.339987 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:18.339957    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:21.844976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:21.844941    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:22.370189 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:22.370162    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:24:22.397990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:22.397968    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:24:22.961652 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:22.961619    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:24.581386 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:24.581299    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:24.832264 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:24.832185    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"]
Oct 30 22:24:24.832440 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:24.832407    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt" podUID="e184fc8f-c462-4f29-bbf0-46ab63033f13" containerName="istio-proxy" containerID="cri-o://fd3fa9ed3d4d83f7207a562059dca395b5708ccf86452aca961e97aa60fd9954" gracePeriod=30
Oct 30 22:24:24.852025 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:24.851987    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:25.104611 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:25.104524    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:26.764767 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:26.764734    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:27.776220 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:27.776185    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:28.191434 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:28.191397    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:28.463466 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:28.463365    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:30.103259 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.103210    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:24:30.186203 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.186172    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-credential-socket\") pod \"e184fc8f-c462-4f29-bbf0-46ab63033f13\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") "
Oct 30 22:24:30.186342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.186228    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-envoy\") pod \"e184fc8f-c462-4f29-bbf0-46ab63033f13\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") "
Oct 30 22:24:30.186416 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.186399    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-token\" (UniqueName: \"kubernetes.io/projected/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-token\") pod \"e184fc8f-c462-4f29-bbf0-46ab63033f13\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") "
Oct 30 22:24:30.186471 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.186440    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e184fc8f-c462-4f29-bbf0-46ab63033f13-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e184fc8f-c462-4f29-bbf0-46ab63033f13-istiod-ca-cert\") pod \"e184fc8f-c462-4f29-bbf0-46ab63033f13\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") "
Oct 30 22:24:30.186471 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.186461    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-credential-socket" pod "e184fc8f-c462-4f29-bbf0-46ab63033f13" (UID: "e184fc8f-c462-4f29-bbf0-46ab63033f13"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:30.186624 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.186599    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-workload-certs\") pod \"e184fc8f-c462-4f29-bbf0-46ab63033f13\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") "
Oct 30 22:24:30.186759 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.186736    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-data\") pod \"e184fc8f-c462-4f29-bbf0-46ab63033f13\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") "
Oct 30 22:24:30.186886 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.186799    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e184fc8f-c462-4f29-bbf0-46ab63033f13-kube-api-access-8j8zn\" (UniqueName: \"kubernetes.io/projected/e184fc8f-c462-4f29-bbf0-46ab63033f13-kube-api-access-8j8zn\") pod \"e184fc8f-c462-4f29-bbf0-46ab63033f13\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") "
Oct 30 22:24:30.186886 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.186806    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e184fc8f-c462-4f29-bbf0-46ab63033f13-istiod-ca-cert" pod "e184fc8f-c462-4f29-bbf0-46ab63033f13" (UID: "e184fc8f-c462-4f29-bbf0-46ab63033f13"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:30.186886 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.186876    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-podinfo\") pod \"e184fc8f-c462-4f29-bbf0-46ab63033f13\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") "
Oct 30 22:24:30.187059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.186912    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-workload-socket\") pod \"e184fc8f-c462-4f29-bbf0-46ab63033f13\" (UID: \"e184fc8f-c462-4f29-bbf0-46ab63033f13\") "
Oct 30 22:24:30.187454 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.187179    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-data" pod "e184fc8f-c462-4f29-bbf0-46ab63033f13" (UID: "e184fc8f-c462-4f29-bbf0-46ab63033f13"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:30.187454 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.187399    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-workload-certs" pod "e184fc8f-c462-4f29-bbf0-46ab63033f13" (UID: "e184fc8f-c462-4f29-bbf0-46ab63033f13"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:30.187454 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.187414    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-workload-socket" pod "e184fc8f-c462-4f29-bbf0-46ab63033f13" (UID: "e184fc8f-c462-4f29-bbf0-46ab63033f13"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:30.187730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.187625    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e184fc8f-c462-4f29-bbf0-46ab63033f13-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:30.187730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.187643    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:30.187730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.187658    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:30.187730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.187672    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:30.187730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.187724    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:30.188745 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.188721    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-envoy" pod "e184fc8f-c462-4f29-bbf0-46ab63033f13" (UID: "e184fc8f-c462-4f29-bbf0-46ab63033f13"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:24:30.188841 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.188820    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-token" pod "e184fc8f-c462-4f29-bbf0-46ab63033f13" (UID: "e184fc8f-c462-4f29-bbf0-46ab63033f13"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:30.190125 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.190100    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-podinfo" pod "e184fc8f-c462-4f29-bbf0-46ab63033f13" (UID: "e184fc8f-c462-4f29-bbf0-46ab63033f13"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:24:30.190217 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.190162    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e184fc8f-c462-4f29-bbf0-46ab63033f13-kube-api-access-8j8zn" pod "e184fc8f-c462-4f29-bbf0-46ab63033f13" (UID: "e184fc8f-c462-4f29-bbf0-46ab63033f13"). InnerVolumeSpecName "kube-api-access-8j8zn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:30.289126 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.289094    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:30.289126 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.289123    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:30.289126 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.289132    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e184fc8f-c462-4f29-bbf0-46ab63033f13-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:30.289388 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.289142    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8j8zn\" (UniqueName: \"kubernetes.io/projected/e184fc8f-c462-4f29-bbf0-46ab63033f13-kube-api-access-8j8zn\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:30.691383 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.691347    4918 generic.go:356] "Generic (PLEG): container finished" podID="e184fc8f-c462-4f29-bbf0-46ab63033f13" containerID="fd3fa9ed3d4d83f7207a562059dca395b5708ccf86452aca961e97aa60fd9954" exitCode=0
Oct 30 22:24:30.691586 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.691410    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"
Oct 30 22:24:30.691586 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.691426    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt" event={"ID":"e184fc8f-c462-4f29-bbf0-46ab63033f13","Type":"ContainerDied","Data":"fd3fa9ed3d4d83f7207a562059dca395b5708ccf86452aca961e97aa60fd9954"}
Oct 30 22:24:30.691586 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.691573    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt" event={"ID":"e184fc8f-c462-4f29-bbf0-46ab63033f13","Type":"ContainerDied","Data":"6a59acb86599e2c5d6d47909c0129c4ecb04667f3e57f01a46a1fbee7fae5ba6"}
Oct 30 22:24:30.691749 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.691596    4918 scope.go:122] "RemoveContainer" containerID="fd3fa9ed3d4d83f7207a562059dca395b5708ccf86452aca961e97aa60fd9954"
Oct 30 22:24:30.703791 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.703765    4918 scope.go:122] "RemoveContainer" containerID="f4bcc12162e521adbaa7871f657160aa28eb34e3ae61a736481008a86d31428d"
Oct 30 22:24:30.714853 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.714832    4918 scope.go:122] "RemoveContainer" containerID="fd3fa9ed3d4d83f7207a562059dca395b5708ccf86452aca961e97aa60fd9954"
Oct 30 22:24:30.715155 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:24:30.715136    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd3fa9ed3d4d83f7207a562059dca395b5708ccf86452aca961e97aa60fd9954\": container with ID starting with fd3fa9ed3d4d83f7207a562059dca395b5708ccf86452aca961e97aa60fd9954 not found: ID does not exist" containerID="fd3fa9ed3d4d83f7207a562059dca395b5708ccf86452aca961e97aa60fd9954"
Oct 30 22:24:30.715223 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.715168    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd3fa9ed3d4d83f7207a562059dca395b5708ccf86452aca961e97aa60fd9954"} err="failed to get container status \"fd3fa9ed3d4d83f7207a562059dca395b5708ccf86452aca961e97aa60fd9954\": rpc error: code = NotFound desc = could not find container \"fd3fa9ed3d4d83f7207a562059dca395b5708ccf86452aca961e97aa60fd9954\": container with ID starting with fd3fa9ed3d4d83f7207a562059dca395b5708ccf86452aca961e97aa60fd9954 not found: ID does not exist"
Oct 30 22:24:30.715223 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.715194    4918 scope.go:122] "RemoveContainer" containerID="f4bcc12162e521adbaa7871f657160aa28eb34e3ae61a736481008a86d31428d"
Oct 30 22:24:30.715463 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:24:30.715447    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4bcc12162e521adbaa7871f657160aa28eb34e3ae61a736481008a86d31428d\": container with ID starting with f4bcc12162e521adbaa7871f657160aa28eb34e3ae61a736481008a86d31428d not found: ID does not exist" containerID="f4bcc12162e521adbaa7871f657160aa28eb34e3ae61a736481008a86d31428d"
Oct 30 22:24:30.715527 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.715473    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4bcc12162e521adbaa7871f657160aa28eb34e3ae61a736481008a86d31428d"} err="failed to get container status \"f4bcc12162e521adbaa7871f657160aa28eb34e3ae61a736481008a86d31428d\": rpc error: code = NotFound desc = could not find container \"f4bcc12162e521adbaa7871f657160aa28eb34e3ae61a736481008a86d31428d\": container with ID starting with f4bcc12162e521adbaa7871f657160aa28eb34e3ae61a736481008a86d31428d not found: ID does not exist"
Oct 30 22:24:30.859079 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.859040    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"]
Oct 30 22:24:30.908279 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:30.908252    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w5-9a96b4-openshift-default-75887447c9-srkrt"]
Oct 30 22:24:31.365929 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:31.365897    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"]
Oct 30 22:24:31.482010 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:31.481961    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"]
Oct 30 22:24:31.848500 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:31.848452    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:32.073526 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:32.073487    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e184fc8f-c462-4f29-bbf0-46ab63033f13" path="/var/lib/kubelet/pods/e184fc8f-c462-4f29-bbf0-46ab63033f13/volumes"
Oct 30 22:24:32.095598 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:32.095566    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:32.159462 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:24:32.159434    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:24:32.909425 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:32.909394    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:34.628777 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:34.628741    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:34.883439 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:34.883351    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:35.139868 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:35.139831    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:35.599130 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:35.599043    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:36.035508 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.035471    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"]
Oct 30 22:24:36.154154 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.154120    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"]
Oct 30 22:24:36.367268 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.367183    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b" podUID="304dcc1f-95a3-4265-addf-52fcd249ea24" containerName="payload-processing" containerID="cri-o://02ea766770084059df22413e36484c543aa13700ca9015536d4fe2026957aab3" gracePeriod=25
Oct 30 22:24:36.485704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.485638    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh" podUID="cf72b38f-08c1-495f-bb7b-7b555ffa89cb" containerName="payload-pre-processing" containerID="cri-o://273f5f2dc2eaf6af4523b6e73a02621d72a3d2cc5e0417248444e78926f4c541" gracePeriod=25
Oct 30 22:24:36.512912 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.512578    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:36.721710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.721668    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"
Oct 30 22:24:36.733584 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.733553    4918 generic.go:356] "Generic (PLEG): container finished" podID="cf72b38f-08c1-495f-bb7b-7b555ffa89cb" containerID="273f5f2dc2eaf6af4523b6e73a02621d72a3d2cc5e0417248444e78926f4c541" exitCode=0
Oct 30 22:24:36.733785 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.733660    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh" event={"ID":"cf72b38f-08c1-495f-bb7b-7b555ffa89cb","Type":"ContainerDied","Data":"273f5f2dc2eaf6af4523b6e73a02621d72a3d2cc5e0417248444e78926f4c541"}
Oct 30 22:24:36.736133 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.736104    4918 generic.go:356] "Generic (PLEG): container finished" podID="304dcc1f-95a3-4265-addf-52fcd249ea24" containerID="02ea766770084059df22413e36484c543aa13700ca9015536d4fe2026957aab3" exitCode=0
Oct 30 22:24:36.736297 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.736280    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b" event={"ID":"304dcc1f-95a3-4265-addf-52fcd249ea24","Type":"ContainerDied","Data":"02ea766770084059df22413e36484c543aa13700ca9015536d4fe2026957aab3"}
Oct 30 22:24:36.736368 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.736327    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b" event={"ID":"304dcc1f-95a3-4265-addf-52fcd249ea24","Type":"ContainerDied","Data":"562558d33fce0859631c6434fe429e8b3d8832ad53522c860878731f09ffc255"}
Oct 30 22:24:36.736368 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.736360    4918 scope.go:122] "RemoveContainer" containerID="02ea766770084059df22413e36484c543aa13700ca9015536d4fe2026957aab3"
Oct 30 22:24:36.736535 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.736519    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"
Oct 30 22:24:36.748259 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.748241    4918 scope.go:122] "RemoveContainer" containerID="02ea766770084059df22413e36484c543aa13700ca9015536d4fe2026957aab3"
Oct 30 22:24:36.748554 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:24:36.748528    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02ea766770084059df22413e36484c543aa13700ca9015536d4fe2026957aab3\": container with ID starting with 02ea766770084059df22413e36484c543aa13700ca9015536d4fe2026957aab3 not found: ID does not exist" containerID="02ea766770084059df22413e36484c543aa13700ca9015536d4fe2026957aab3"
Oct 30 22:24:36.748604 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.748568    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02ea766770084059df22413e36484c543aa13700ca9015536d4fe2026957aab3"} err="failed to get container status \"02ea766770084059df22413e36484c543aa13700ca9015536d4fe2026957aab3\": rpc error: code = NotFound desc = could not find container \"02ea766770084059df22413e36484c543aa13700ca9015536d4fe2026957aab3\": container with ID starting with 02ea766770084059df22413e36484c543aa13700ca9015536d4fe2026957aab3 not found: ID does not exist"
Oct 30 22:24:36.766535 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.766507    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:36.823893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.823864    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/304dcc1f-95a3-4265-addf-52fcd249ea24-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/304dcc1f-95a3-4265-addf-52fcd249ea24-plugins-config-volume\") pod \"304dcc1f-95a3-4265-addf-52fcd249ea24\" (UID: \"304dcc1f-95a3-4265-addf-52fcd249ea24\") "
Oct 30 22:24:36.824060 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.823977    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/304dcc1f-95a3-4265-addf-52fcd249ea24-kube-api-access-cndk6\" (UniqueName: \"kubernetes.io/projected/304dcc1f-95a3-4265-addf-52fcd249ea24-kube-api-access-cndk6\") pod \"304dcc1f-95a3-4265-addf-52fcd249ea24\" (UID: \"304dcc1f-95a3-4265-addf-52fcd249ea24\") "
Oct 30 22:24:36.824260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.824236    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/304dcc1f-95a3-4265-addf-52fcd249ea24-plugins-config-volume" pod "304dcc1f-95a3-4265-addf-52fcd249ea24" (UID: "304dcc1f-95a3-4265-addf-52fcd249ea24"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:36.824512 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.824487    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/304dcc1f-95a3-4265-addf-52fcd249ea24-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:36.826439 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.826417    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/304dcc1f-95a3-4265-addf-52fcd249ea24-kube-api-access-cndk6" pod "304dcc1f-95a3-4265-addf-52fcd249ea24" (UID: "304dcc1f-95a3-4265-addf-52fcd249ea24"). InnerVolumeSpecName "kube-api-access-cndk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:36.852850 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.852823    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"
Oct 30 22:24:36.925190 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.925150    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf72b38f-08c1-495f-bb7b-7b555ffa89cb-kube-api-access-nkpzw\" (UniqueName: \"kubernetes.io/projected/cf72b38f-08c1-495f-bb7b-7b555ffa89cb-kube-api-access-nkpzw\") pod \"cf72b38f-08c1-495f-bb7b-7b555ffa89cb\" (UID: \"cf72b38f-08c1-495f-bb7b-7b555ffa89cb\") "
Oct 30 22:24:36.925336 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.925223    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cf72b38f-08c1-495f-bb7b-7b555ffa89cb-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf72b38f-08c1-495f-bb7b-7b555ffa89cb-plugins-config-volume\") pod \"cf72b38f-08c1-495f-bb7b-7b555ffa89cb\" (UID: \"cf72b38f-08c1-495f-bb7b-7b555ffa89cb\") "
Oct 30 22:24:36.925577 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.925556    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf72b38f-08c1-495f-bb7b-7b555ffa89cb-plugins-config-volume" pod "cf72b38f-08c1-495f-bb7b-7b555ffa89cb" (UID: "cf72b38f-08c1-495f-bb7b-7b555ffa89cb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:36.925764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.925747    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cndk6\" (UniqueName: \"kubernetes.io/projected/304dcc1f-95a3-4265-addf-52fcd249ea24-kube-api-access-cndk6\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:36.925821 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.925767    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf72b38f-08c1-495f-bb7b-7b555ffa89cb-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:36.927440 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:36.927422    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf72b38f-08c1-495f-bb7b-7b555ffa89cb-kube-api-access-nkpzw" pod "cf72b38f-08c1-495f-bb7b-7b555ffa89cb" (UID: "cf72b38f-08c1-495f-bb7b-7b555ffa89cb"). InnerVolumeSpecName "kube-api-access-nkpzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:37.027075 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:37.026997    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkpzw\" (UniqueName: \"kubernetes.io/projected/cf72b38f-08c1-495f-bb7b-7b555ffa89cb-kube-api-access-nkpzw\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:37.162201 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:37.162168    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"]
Oct 30 22:24:37.169437 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:37.169406    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a1024a-66768f8b5-gdr6b"]
Oct 30 22:24:37.793706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:37.793566    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"
Oct 30 22:24:37.793706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:37.793585    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh" event={"ID":"cf72b38f-08c1-495f-bb7b-7b555ffa89cb","Type":"ContainerDied","Data":"c4a3095e396c1a6b2c6b7d43cbb621514322975f8048e242efa680925e16c10b"}
Oct 30 22:24:37.793706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:37.793652    4918 scope.go:122] "RemoveContainer" containerID="273f5f2dc2eaf6af4523b6e73a02621d72a3d2cc5e0417248444e78926f4c541"
Oct 30 22:24:37.966664 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:37.966631    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"]
Oct 30 22:24:38.018275 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:38.018230    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a1024a-c6fcc5d75-4f4bh"]
Oct 30 22:24:38.097391 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:38.097305    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="304dcc1f-95a3-4265-addf-52fcd249ea24" path="/var/lib/kubelet/pods/304dcc1f-95a3-4265-addf-52fcd249ea24/volumes"
Oct 30 22:24:38.098025 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:38.098002    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf72b38f-08c1-495f-bb7b-7b555ffa89cb" path="/var/lib/kubelet/pods/cf72b38f-08c1-495f-bb7b-7b555ffa89cb/volumes"
Oct 30 22:24:40.054565 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:40.054536    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:40.331988 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:40.331887    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:41.036613 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.036569    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj" podUID="cd38dc35-09e7-4deb-b418-bb5a6a667d93" containerName="payload-processing" containerID="cri-o://a420daf8bbe7b21e4d2768e4cb0db40981b41108505c71176a2dee6de66503b5" gracePeriod=25
Oct 30 22:24:41.155070 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.155036    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw" podUID="844e6de8-25be-467f-a7f5-492b77d45bb8" containerName="payload-pre-processing" containerID="cri-o://1e3d080b13fc20cffc85a2f707912d7fa6c47980727f158920a15a243f336fb9" gracePeriod=25
Oct 30 22:24:41.319840 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.319812    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"
Oct 30 22:24:41.410324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.410294    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cd38dc35-09e7-4deb-b418-bb5a6a667d93-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd38dc35-09e7-4deb-b418-bb5a6a667d93-plugins-config-volume\") pod \"cd38dc35-09e7-4deb-b418-bb5a6a667d93\" (UID: \"cd38dc35-09e7-4deb-b418-bb5a6a667d93\") "
Oct 30 22:24:41.410504 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.410415    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cd38dc35-09e7-4deb-b418-bb5a6a667d93-kube-api-access-wrnr9\" (UniqueName: \"kubernetes.io/projected/cd38dc35-09e7-4deb-b418-bb5a6a667d93-kube-api-access-wrnr9\") pod \"cd38dc35-09e7-4deb-b418-bb5a6a667d93\" (UID: \"cd38dc35-09e7-4deb-b418-bb5a6a667d93\") "
Oct 30 22:24:41.410807 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.410781    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd38dc35-09e7-4deb-b418-bb5a6a667d93-plugins-config-volume" pod "cd38dc35-09e7-4deb-b418-bb5a6a667d93" (UID: "cd38dc35-09e7-4deb-b418-bb5a6a667d93"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:41.412652 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.412627    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd38dc35-09e7-4deb-b418-bb5a6a667d93-kube-api-access-wrnr9" pod "cd38dc35-09e7-4deb-b418-bb5a6a667d93" (UID: "cd38dc35-09e7-4deb-b418-bb5a6a667d93"). InnerVolumeSpecName "kube-api-access-wrnr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:41.432887 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.432861    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"
Oct 30 22:24:41.511212 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.511184    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/844e6de8-25be-467f-a7f5-492b77d45bb8-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/844e6de8-25be-467f-a7f5-492b77d45bb8-plugins-config-volume\") pod \"844e6de8-25be-467f-a7f5-492b77d45bb8\" (UID: \"844e6de8-25be-467f-a7f5-492b77d45bb8\") "
Oct 30 22:24:41.511533 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.511501    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/844e6de8-25be-467f-a7f5-492b77d45bb8-kube-api-access-rrvml\" (UniqueName: \"kubernetes.io/projected/844e6de8-25be-467f-a7f5-492b77d45bb8-kube-api-access-rrvml\") pod \"844e6de8-25be-467f-a7f5-492b77d45bb8\" (UID: \"844e6de8-25be-467f-a7f5-492b77d45bb8\") "
Oct 30 22:24:41.511661 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.511580    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/844e6de8-25be-467f-a7f5-492b77d45bb8-plugins-config-volume" pod "844e6de8-25be-467f-a7f5-492b77d45bb8" (UID: "844e6de8-25be-467f-a7f5-492b77d45bb8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:24:41.512042 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.512024    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd38dc35-09e7-4deb-b418-bb5a6a667d93-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:41.512099 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.512046    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrnr9\" (UniqueName: \"kubernetes.io/projected/cd38dc35-09e7-4deb-b418-bb5a6a667d93-kube-api-access-wrnr9\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:41.512099 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.512055    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/844e6de8-25be-467f-a7f5-492b77d45bb8-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:41.513803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.513780    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/844e6de8-25be-467f-a7f5-492b77d45bb8-kube-api-access-rrvml" pod "844e6de8-25be-467f-a7f5-492b77d45bb8" (UID: "844e6de8-25be-467f-a7f5-492b77d45bb8"). InnerVolumeSpecName "kube-api-access-rrvml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:24:41.613306 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.613240    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrvml\" (UniqueName: \"kubernetes.io/projected/844e6de8-25be-467f-a7f5-492b77d45bb8-kube-api-access-rrvml\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:24:41.756716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.756664    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:41.830181 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.830030    4918 generic.go:356] "Generic (PLEG): container finished" podID="cd38dc35-09e7-4deb-b418-bb5a6a667d93" containerID="a420daf8bbe7b21e4d2768e4cb0db40981b41108505c71176a2dee6de66503b5" exitCode=0
Oct 30 22:24:41.830181 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.830113    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj" event={"ID":"cd38dc35-09e7-4deb-b418-bb5a6a667d93","Type":"ContainerDied","Data":"a420daf8bbe7b21e4d2768e4cb0db40981b41108505c71176a2dee6de66503b5"}
Oct 30 22:24:41.830474 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.830223    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"
Oct 30 22:24:41.830663 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.830628    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj" event={"ID":"cd38dc35-09e7-4deb-b418-bb5a6a667d93","Type":"ContainerDied","Data":"96a01d0eda1dbbf79141c90082a7ddaf25cd11a3b51f046964ea03d524d8aa55"}
Oct 30 22:24:41.830842 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.830675    4918 scope.go:122] "RemoveContainer" containerID="a420daf8bbe7b21e4d2768e4cb0db40981b41108505c71176a2dee6de66503b5"
Oct 30 22:24:41.833754 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.832410    4918 generic.go:356] "Generic (PLEG): container finished" podID="844e6de8-25be-467f-a7f5-492b77d45bb8" containerID="1e3d080b13fc20cffc85a2f707912d7fa6c47980727f158920a15a243f336fb9" exitCode=0
Oct 30 22:24:41.833754 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.832443    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw" event={"ID":"844e6de8-25be-467f-a7f5-492b77d45bb8","Type":"ContainerDied","Data":"1e3d080b13fc20cffc85a2f707912d7fa6c47980727f158920a15a243f336fb9"}
Oct 30 22:24:41.833754 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.832477    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"
Oct 30 22:24:41.833754 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.832495    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw" event={"ID":"844e6de8-25be-467f-a7f5-492b77d45bb8","Type":"ContainerDied","Data":"b1c137ecb0ac53660b5b7932436c4bae7132d29254bb1a5893cc305fc35b0325"}
Oct 30 22:24:41.846474 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.846354    4918 scope.go:122] "RemoveContainer" containerID="a420daf8bbe7b21e4d2768e4cb0db40981b41108505c71176a2dee6de66503b5"
Oct 30 22:24:41.846858 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:24:41.846822    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a420daf8bbe7b21e4d2768e4cb0db40981b41108505c71176a2dee6de66503b5\": container with ID starting with a420daf8bbe7b21e4d2768e4cb0db40981b41108505c71176a2dee6de66503b5 not found: ID does not exist" containerID="a420daf8bbe7b21e4d2768e4cb0db40981b41108505c71176a2dee6de66503b5"
Oct 30 22:24:41.846970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.846862    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a420daf8bbe7b21e4d2768e4cb0db40981b41108505c71176a2dee6de66503b5"} err="failed to get container status \"a420daf8bbe7b21e4d2768e4cb0db40981b41108505c71176a2dee6de66503b5\": rpc error: code = NotFound desc = could not find container \"a420daf8bbe7b21e4d2768e4cb0db40981b41108505c71176a2dee6de66503b5\": container with ID starting with a420daf8bbe7b21e4d2768e4cb0db40981b41108505c71176a2dee6de66503b5 not found: ID does not exist"
Oct 30 22:24:41.846970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.846886    4918 scope.go:122] "RemoveContainer" containerID="1e3d080b13fc20cffc85a2f707912d7fa6c47980727f158920a15a243f336fb9"
Oct 30 22:24:41.856755 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.856731    4918 scope.go:122] "RemoveContainer" containerID="1e3d080b13fc20cffc85a2f707912d7fa6c47980727f158920a15a243f336fb9"
Oct 30 22:24:41.857072 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:24:41.857050    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e3d080b13fc20cffc85a2f707912d7fa6c47980727f158920a15a243f336fb9\": container with ID starting with 1e3d080b13fc20cffc85a2f707912d7fa6c47980727f158920a15a243f336fb9 not found: ID does not exist" containerID="1e3d080b13fc20cffc85a2f707912d7fa6c47980727f158920a15a243f336fb9"
Oct 30 22:24:41.857161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:41.857084    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e3d080b13fc20cffc85a2f707912d7fa6c47980727f158920a15a243f336fb9"} err="failed to get container status \"1e3d080b13fc20cffc85a2f707912d7fa6c47980727f158920a15a243f336fb9\": rpc error: code = NotFound desc = could not find container \"1e3d080b13fc20cffc85a2f707912d7fa6c47980727f158920a15a243f336fb9\": container with ID starting with 1e3d080b13fc20cffc85a2f707912d7fa6c47980727f158920a15a243f336fb9 not found: ID does not exist"
Oct 30 22:24:42.043356 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:42.043257    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:42.059718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:42.056785    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"]
Oct 30 22:24:42.120600 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:42.120572    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w5-2b7317-6b6bb6c787-lnjgw"]
Oct 30 22:24:42.141363 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:42.141308    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"]
Oct 30 22:24:42.146395 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:42.146361    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w5-2b7317-75649644b9-29knj"]
Oct 30 22:24:44.073627 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:44.073595    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="844e6de8-25be-467f-a7f5-492b77d45bb8" path="/var/lib/kubelet/pods/844e6de8-25be-467f-a7f5-492b77d45bb8/volumes"
Oct 30 22:24:44.074056 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:44.074017    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cd38dc35-09e7-4deb-b418-bb5a6a667d93" path="/var/lib/kubelet/pods/cd38dc35-09e7-4deb-b418-bb5a6a667d93/volumes"
Oct 30 22:24:45.135708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:45.135314    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:45.395027 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:45.394988    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:46.695969 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:46.695935    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:47.049764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:47.043023    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:47.301143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:47.301066    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:47.738182 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:47.738151    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:51.585816 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:51.585785    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"]
Oct 30 22:24:52.005459 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:52.005416    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:52.282603 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:52.282520    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:52.695997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:52.695955    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:52.983764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:52.982458    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:53.481201 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:53.481040    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:53.933287 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:53.933257    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:54.768148 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:54.768116    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:55.027556 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:55.027478    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:55.033308 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:55.033285    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"]
Oct 30 22:24:55.033517 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:55.033495    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525" podUID="612f3d2b-2897-489a-bb3e-0dc4b00f49e4" containerName="istio-proxy" containerID="cri-o://5473ea7d42662d9478d33958d7f583ac7cc310d57624f9940bc54c97baa2ff2d" gracePeriod=30
Oct 30 22:24:55.289055 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:55.288962    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:56.525095 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:56.525054    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:56.586521 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:56.586473    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf" podUID="34de2b70-307f-4377-81ac-b5e8913dab09" containerName="payload-pre-processing" containerID="cri-o://9baad860919fa5c06094275b64abcc66af2eecfc6de7078d6a1b8278eff354ec" gracePeriod=25
Oct 30 22:24:57.903706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:57.903638    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:58.172606 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:58.172515    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:58.425720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:24:58.425608    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:00.309297 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.309231    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:25:00.353380 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.353345    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-workload-socket\") pod \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") "
Oct 30 22:25:00.353575 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.353437    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-podinfo\") pod \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") "
Oct 30 22:25:00.353575 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.353493    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-workload-certs\") pod \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") "
Oct 30 22:25:00.353575 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.353530    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istiod-ca-cert\") pod \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") "
Oct 30 22:25:00.353816 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.353587    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-token\" (UniqueName: \"kubernetes.io/projected/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-token\") pod \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") "
Oct 30 22:25:00.353816 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.353617    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-kube-api-access-b2f6b\" (UniqueName: \"kubernetes.io/projected/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-kube-api-access-b2f6b\") pod \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") "
Oct 30 22:25:00.353816 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.353666    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-workload-socket" pod "612f3d2b-2897-489a-bb3e-0dc4b00f49e4" (UID: "612f3d2b-2897-489a-bb3e-0dc4b00f49e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:00.354007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.353820    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-data\") pod \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") "
Oct 30 22:25:00.354007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.353850    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-workload-certs" pod "612f3d2b-2897-489a-bb3e-0dc4b00f49e4" (UID: "612f3d2b-2897-489a-bb3e-0dc4b00f49e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:00.354007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.353872    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-envoy\") pod \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") "
Oct 30 22:25:00.354007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.353922    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-credential-socket\") pod \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\" (UID: \"612f3d2b-2897-489a-bb3e-0dc4b00f49e4\") "
Oct 30 22:25:00.354221 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.354007    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istiod-ca-cert" pod "612f3d2b-2897-489a-bb3e-0dc4b00f49e4" (UID: "612f3d2b-2897-489a-bb3e-0dc4b00f49e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:00.354221 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.354092    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-data" pod "612f3d2b-2897-489a-bb3e-0dc4b00f49e4" (UID: "612f3d2b-2897-489a-bb3e-0dc4b00f49e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:00.354327 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.354263    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-credential-socket" pod "612f3d2b-2897-489a-bb3e-0dc4b00f49e4" (UID: "612f3d2b-2897-489a-bb3e-0dc4b00f49e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:00.354620 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.354554    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.354620 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.354580    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.354620 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.354593    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.354620 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.354609    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.354620 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.354621    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.356155 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.356127    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-kube-api-access-b2f6b" pod "612f3d2b-2897-489a-bb3e-0dc4b00f49e4" (UID: "612f3d2b-2897-489a-bb3e-0dc4b00f49e4"). InnerVolumeSpecName "kube-api-access-b2f6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:00.356250 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.356176    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-envoy" pod "612f3d2b-2897-489a-bb3e-0dc4b00f49e4" (UID: "612f3d2b-2897-489a-bb3e-0dc4b00f49e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:00.356421 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.356394    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-podinfo" pod "612f3d2b-2897-489a-bb3e-0dc4b00f49e4" (UID: "612f3d2b-2897-489a-bb3e-0dc4b00f49e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:25:00.356519 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.356426    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-token" pod "612f3d2b-2897-489a-bb3e-0dc4b00f49e4" (UID: "612f3d2b-2897-489a-bb3e-0dc4b00f49e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:00.456333 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.456301    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.456333 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.456331    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.456333 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.456341    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2f6b\" (UniqueName: \"kubernetes.io/projected/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-kube-api-access-b2f6b\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:00.456648 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:00.456352    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/612f3d2b-2897-489a-bb3e-0dc4b00f49e4-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:01.073458 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:01.073423    4918 generic.go:356] "Generic (PLEG): container finished" podID="612f3d2b-2897-489a-bb3e-0dc4b00f49e4" containerID="5473ea7d42662d9478d33958d7f583ac7cc310d57624f9940bc54c97baa2ff2d" exitCode=0
Oct 30 22:25:01.073663 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:01.073478    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"
Oct 30 22:25:01.073663 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:01.073504    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525" event={"ID":"612f3d2b-2897-489a-bb3e-0dc4b00f49e4","Type":"ContainerDied","Data":"5473ea7d42662d9478d33958d7f583ac7cc310d57624f9940bc54c97baa2ff2d"}
Oct 30 22:25:01.073663 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:01.073555    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525" event={"ID":"612f3d2b-2897-489a-bb3e-0dc4b00f49e4","Type":"ContainerDied","Data":"1350479a5af810c6c56a5d3436ed2e6fe458750933003b8990472fd1e0a281a5"}
Oct 30 22:25:01.073663 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:01.073577    4918 scope.go:122] "RemoveContainer" containerID="5473ea7d42662d9478d33958d7f583ac7cc310d57624f9940bc54c97baa2ff2d"
Oct 30 22:25:01.084608 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:01.084593    4918 scope.go:122] "RemoveContainer" containerID="b588a73fedc1289405f56c0abaa9b035e70a309cd255752ab3db3fe84bffcba1"
Oct 30 22:25:01.095644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:01.095615    4918 scope.go:122] "RemoveContainer" containerID="5473ea7d42662d9478d33958d7f583ac7cc310d57624f9940bc54c97baa2ff2d"
Oct 30 22:25:01.096049 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:25:01.096025    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5473ea7d42662d9478d33958d7f583ac7cc310d57624f9940bc54c97baa2ff2d\": container with ID starting with 5473ea7d42662d9478d33958d7f583ac7cc310d57624f9940bc54c97baa2ff2d not found: ID does not exist" containerID="5473ea7d42662d9478d33958d7f583ac7cc310d57624f9940bc54c97baa2ff2d"
Oct 30 22:25:01.096174 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:01.096059    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5473ea7d42662d9478d33958d7f583ac7cc310d57624f9940bc54c97baa2ff2d"} err="failed to get container status \"5473ea7d42662d9478d33958d7f583ac7cc310d57624f9940bc54c97baa2ff2d\": rpc error: code = NotFound desc = could not find container \"5473ea7d42662d9478d33958d7f583ac7cc310d57624f9940bc54c97baa2ff2d\": container with ID starting with 5473ea7d42662d9478d33958d7f583ac7cc310d57624f9940bc54c97baa2ff2d not found: ID does not exist"
Oct 30 22:25:01.096174 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:01.096085    4918 scope.go:122] "RemoveContainer" containerID="b588a73fedc1289405f56c0abaa9b035e70a309cd255752ab3db3fe84bffcba1"
Oct 30 22:25:01.096414 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:25:01.096396    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b588a73fedc1289405f56c0abaa9b035e70a309cd255752ab3db3fe84bffcba1\": container with ID starting with b588a73fedc1289405f56c0abaa9b035e70a309cd255752ab3db3fe84bffcba1 not found: ID does not exist" containerID="b588a73fedc1289405f56c0abaa9b035e70a309cd255752ab3db3fe84bffcba1"
Oct 30 22:25:01.096490 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:01.096421    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b588a73fedc1289405f56c0abaa9b035e70a309cd255752ab3db3fe84bffcba1"} err="failed to get container status \"b588a73fedc1289405f56c0abaa9b035e70a309cd255752ab3db3fe84bffcba1\": rpc error: code = NotFound desc = could not find container \"b588a73fedc1289405f56c0abaa9b035e70a309cd255752ab3db3fe84bffcba1\": container with ID starting with b588a73fedc1289405f56c0abaa9b035e70a309cd255752ab3db3fe84bffcba1 not found: ID does not exist"
Oct 30 22:25:01.240281 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:01.240247    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"]
Oct 30 22:25:01.289472 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:01.289436    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2d8852-openshift-default-745ff7c4f9-9h525"]
Oct 30 22:25:02.074951 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:02.074913    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="612f3d2b-2897-489a-bb3e-0dc4b00f49e4" path="/var/lib/kubelet/pods/612f3d2b-2897-489a-bb3e-0dc4b00f49e4/volumes"
Oct 30 22:25:02.161992 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:25:02.161945    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:25:02.840703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:02.836032    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:03.109127 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:03.109049    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:03.367644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:03.367480    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:04.365661 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:04.365625    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:04.625283 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:04.625187    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:05.822771 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:05.822735    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf" podUID="34de2b70-307f-4377-81ac-b5e8913dab09" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:25:06.356152 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:06.356118    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"]
Oct 30 22:25:06.872282 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:06.872247    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:07.119580 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:07.119550    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:07.876091 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:07.876051    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:09.536617 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:09.536582    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:09.790351 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:09.790254    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:10.048810 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:10.048723    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:10.482252 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:10.482215    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:11.357152 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:11.357104    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q" podUID="061e5396-ce07-46fe-b478-91d10896e249" containerName="payload-processing" containerID="cri-o://0079d1f0c2637645f0c15aa796322e4069f353e685a3011502c5762185008f51" gracePeriod=25
Oct 30 22:25:11.647573 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:11.647546    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"
Oct 30 22:25:11.704521 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:11.704490    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/061e5396-ce07-46fe-b478-91d10896e249-kube-api-access-54kws\" (UniqueName: \"kubernetes.io/projected/061e5396-ce07-46fe-b478-91d10896e249-kube-api-access-54kws\") pod \"061e5396-ce07-46fe-b478-91d10896e249\" (UID: \"061e5396-ce07-46fe-b478-91d10896e249\") "
Oct 30 22:25:11.704668 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:11.704561    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/061e5396-ce07-46fe-b478-91d10896e249-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/061e5396-ce07-46fe-b478-91d10896e249-plugins-config-volume\") pod \"061e5396-ce07-46fe-b478-91d10896e249\" (UID: \"061e5396-ce07-46fe-b478-91d10896e249\") "
Oct 30 22:25:11.705002 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:11.704975    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/061e5396-ce07-46fe-b478-91d10896e249-plugins-config-volume" pod "061e5396-ce07-46fe-b478-91d10896e249" (UID: "061e5396-ce07-46fe-b478-91d10896e249"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:11.705143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:11.705122    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/061e5396-ce07-46fe-b478-91d10896e249-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:11.706889 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:11.706866    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/061e5396-ce07-46fe-b478-91d10896e249-kube-api-access-54kws" pod "061e5396-ce07-46fe-b478-91d10896e249" (UID: "061e5396-ce07-46fe-b478-91d10896e249"). InnerVolumeSpecName "kube-api-access-54kws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:11.805884 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:11.805839    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54kws\" (UniqueName: \"kubernetes.io/projected/061e5396-ce07-46fe-b478-91d10896e249-kube-api-access-54kws\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:12.175966 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:12.175930    4918 generic.go:356] "Generic (PLEG): container finished" podID="061e5396-ce07-46fe-b478-91d10896e249" containerID="0079d1f0c2637645f0c15aa796322e4069f353e685a3011502c5762185008f51" exitCode=0
Oct 30 22:25:12.176206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:12.175983    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"
Oct 30 22:25:12.176206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:12.176015    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q" event={"ID":"061e5396-ce07-46fe-b478-91d10896e249","Type":"ContainerDied","Data":"0079d1f0c2637645f0c15aa796322e4069f353e685a3011502c5762185008f51"}
Oct 30 22:25:12.176206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:12.176072    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q" event={"ID":"061e5396-ce07-46fe-b478-91d10896e249","Type":"ContainerDied","Data":"5f9dbee77946f1f0d0c8b6110e416c474b6c776aa15c20e8792ebf8704197c06"}
Oct 30 22:25:12.176206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:12.176095    4918 scope.go:122] "RemoveContainer" containerID="0079d1f0c2637645f0c15aa796322e4069f353e685a3011502c5762185008f51"
Oct 30 22:25:12.186800 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:12.186774    4918 scope.go:122] "RemoveContainer" containerID="0079d1f0c2637645f0c15aa796322e4069f353e685a3011502c5762185008f51"
Oct 30 22:25:12.187086 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:25:12.187061    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0079d1f0c2637645f0c15aa796322e4069f353e685a3011502c5762185008f51\": container with ID starting with 0079d1f0c2637645f0c15aa796322e4069f353e685a3011502c5762185008f51 not found: ID does not exist" containerID="0079d1f0c2637645f0c15aa796322e4069f353e685a3011502c5762185008f51"
Oct 30 22:25:12.187174 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:12.187095    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0079d1f0c2637645f0c15aa796322e4069f353e685a3011502c5762185008f51"} err="failed to get container status \"0079d1f0c2637645f0c15aa796322e4069f353e685a3011502c5762185008f51\": rpc error: code = NotFound desc = could not find container \"0079d1f0c2637645f0c15aa796322e4069f353e685a3011502c5762185008f51\": container with ID starting with 0079d1f0c2637645f0c15aa796322e4069f353e685a3011502c5762185008f51 not found: ID does not exist"
Oct 30 22:25:12.342468 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:12.342388    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"]
Oct 30 22:25:12.391599 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:12.391567    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-b8a091-69f759cc8c-6tl4q"]
Oct 30 22:25:14.073417 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.073387    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="061e5396-ce07-46fe-b478-91d10896e249" path="/var/lib/kubelet/pods/061e5396-ce07-46fe-b478-91d10896e249/volumes"
Oct 30 22:25:14.191982 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.191948    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"]
Oct 30 22:25:14.192262 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.192226    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m" podUID="cbd3d21b-6f89-4eaa-98eb-d83a9de11d64" containerName="maas-api" containerID="cri-o://b3ae914d7fea898cb855300f8babab093924c0f26987258456cc0e5df6d29717" gracePeriod=30
Oct 30 22:25:14.424328 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.423779    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:14.509063 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.509041    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:25:14.550412 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.550385    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-maas-api-tls\") pod \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") "
Oct 30 22:25:14.550533 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.550450    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-kube-api-access-rt6mh\" (UniqueName: \"kubernetes.io/projected/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-kube-api-access-rt6mh\") pod \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") "
Oct 30 22:25:14.550579 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.550533    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-openshift-service-ca\") pod \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") "
Oct 30 22:25:14.550579 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.550563    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-metrics-certs\") pod \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\" (UID: \"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64\") "
Oct 30 22:25:14.550995 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.550968    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-openshift-service-ca" pod "cbd3d21b-6f89-4eaa-98eb-d83a9de11d64" (UID: "cbd3d21b-6f89-4eaa-98eb-d83a9de11d64"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:14.552724 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.552664    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-kube-api-access-rt6mh" pod "cbd3d21b-6f89-4eaa-98eb-d83a9de11d64" (UID: "cbd3d21b-6f89-4eaa-98eb-d83a9de11d64"). InnerVolumeSpecName "kube-api-access-rt6mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:14.552828 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.552749    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-metrics-certs" pod "cbd3d21b-6f89-4eaa-98eb-d83a9de11d64" (UID: "cbd3d21b-6f89-4eaa-98eb-d83a9de11d64"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:14.552828 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.552775    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-maas-api-tls" pod "cbd3d21b-6f89-4eaa-98eb-d83a9de11d64" (UID: "cbd3d21b-6f89-4eaa-98eb-d83a9de11d64"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:14.652007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.651981    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:14.652007 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.652006    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:14.652238 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.652017    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:14.652238 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:14.652027    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rt6mh\" (UniqueName: \"kubernetes.io/projected/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64-kube-api-access-rt6mh\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:15.200431 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:15.200392    4918 generic.go:356] "Generic (PLEG): container finished" podID="cbd3d21b-6f89-4eaa-98eb-d83a9de11d64" containerID="b3ae914d7fea898cb855300f8babab093924c0f26987258456cc0e5df6d29717" exitCode=0
Oct 30 22:25:15.200860 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:15.200436    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"
Oct 30 22:25:15.200860 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:15.200465    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m" event={"ID":"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64","Type":"ContainerDied","Data":"b3ae914d7fea898cb855300f8babab093924c0f26987258456cc0e5df6d29717"}
Oct 30 22:25:15.200860 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:15.200515    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m" event={"ID":"cbd3d21b-6f89-4eaa-98eb-d83a9de11d64","Type":"ContainerDied","Data":"46ee00a42e4be4d63e049d7ee9f1eea8980e0631ed096042e51488aea1659efd"}
Oct 30 22:25:15.200860 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:15.200536    4918 scope.go:122] "RemoveContainer" containerID="b3ae914d7fea898cb855300f8babab093924c0f26987258456cc0e5df6d29717"
Oct 30 22:25:15.210889 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:15.210873    4918 scope.go:122] "RemoveContainer" containerID="b3ae914d7fea898cb855300f8babab093924c0f26987258456cc0e5df6d29717"
Oct 30 22:25:15.211172 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:25:15.211151    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3ae914d7fea898cb855300f8babab093924c0f26987258456cc0e5df6d29717\": container with ID starting with b3ae914d7fea898cb855300f8babab093924c0f26987258456cc0e5df6d29717 not found: ID does not exist" containerID="b3ae914d7fea898cb855300f8babab093924c0f26987258456cc0e5df6d29717"
Oct 30 22:25:15.211219 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:15.211182    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3ae914d7fea898cb855300f8babab093924c0f26987258456cc0e5df6d29717"} err="failed to get container status \"b3ae914d7fea898cb855300f8babab093924c0f26987258456cc0e5df6d29717\": rpc error: code = NotFound desc = could not find container \"b3ae914d7fea898cb855300f8babab093924c0f26987258456cc0e5df6d29717\": container with ID starting with b3ae914d7fea898cb855300f8babab093924c0f26987258456cc0e5df6d29717 not found: ID does not exist"
Oct 30 22:25:15.376319 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:15.376236    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"]
Oct 30 22:25:15.382198 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:15.382174    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-b8a091-f69645855-mnf4m"]
Oct 30 22:25:15.822968 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:15.822931    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf" podUID="34de2b70-307f-4377-81ac-b5e8913dab09" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:25:16.075286 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:16.075215    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cbd3d21b-6f89-4eaa-98eb-d83a9de11d64" path="/var/lib/kubelet/pods/cbd3d21b-6f89-4eaa-98eb-d83a9de11d64/volumes"
Oct 30 22:25:16.114383 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:16.114352    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:16.430480 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:16.430441    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:16.734880 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:16.734838    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:16.875589 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:16.875560    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"
Oct 30 22:25:16.895994 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:16.895963    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/34de2b70-307f-4377-81ac-b5e8913dab09-kube-api-access-jqm58\" (UniqueName: \"kubernetes.io/projected/34de2b70-307f-4377-81ac-b5e8913dab09-kube-api-access-jqm58\") pod \"34de2b70-307f-4377-81ac-b5e8913dab09\" (UID: \"34de2b70-307f-4377-81ac-b5e8913dab09\") "
Oct 30 22:25:16.896330 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:16.896297    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/34de2b70-307f-4377-81ac-b5e8913dab09-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34de2b70-307f-4377-81ac-b5e8913dab09-plugins-config-volume\") pod \"34de2b70-307f-4377-81ac-b5e8913dab09\" (UID: \"34de2b70-307f-4377-81ac-b5e8913dab09\") "
Oct 30 22:25:16.896675 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:16.896649    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34de2b70-307f-4377-81ac-b5e8913dab09-plugins-config-volume" pod "34de2b70-307f-4377-81ac-b5e8913dab09" (UID: "34de2b70-307f-4377-81ac-b5e8913dab09"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:16.897217 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:16.897194    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34de2b70-307f-4377-81ac-b5e8913dab09-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:16.899222 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:16.899191    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34de2b70-307f-4377-81ac-b5e8913dab09-kube-api-access-jqm58" pod "34de2b70-307f-4377-81ac-b5e8913dab09" (UID: "34de2b70-307f-4377-81ac-b5e8913dab09"). InnerVolumeSpecName "kube-api-access-jqm58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:16.999157 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:16.999087    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqm58\" (UniqueName: \"kubernetes.io/projected/34de2b70-307f-4377-81ac-b5e8913dab09-kube-api-access-jqm58\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:17.038416 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:17.038370    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:17.216305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:17.216272    4918 generic.go:356] "Generic (PLEG): container finished" podID="34de2b70-307f-4377-81ac-b5e8913dab09" containerID="9baad860919fa5c06094275b64abcc66af2eecfc6de7078d6a1b8278eff354ec" exitCode=0
Oct 30 22:25:17.216484 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:17.216326    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf" event={"ID":"34de2b70-307f-4377-81ac-b5e8913dab09","Type":"ContainerDied","Data":"9baad860919fa5c06094275b64abcc66af2eecfc6de7078d6a1b8278eff354ec"}
Oct 30 22:25:17.216484 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:17.216335    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"
Oct 30 22:25:17.216484 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:17.216368    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf" event={"ID":"34de2b70-307f-4377-81ac-b5e8913dab09","Type":"ContainerDied","Data":"e397f4cf054a97626360d7f8f53d8beeba7d26b4a428685c717cad2543631d70"}
Oct 30 22:25:17.216484 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:17.216389    4918 scope.go:122] "RemoveContainer" containerID="9baad860919fa5c06094275b64abcc66af2eecfc6de7078d6a1b8278eff354ec"
Oct 30 22:25:17.228365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:17.228338    4918 scope.go:122] "RemoveContainer" containerID="9baad860919fa5c06094275b64abcc66af2eecfc6de7078d6a1b8278eff354ec"
Oct 30 22:25:17.228720 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:25:17.228664    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9baad860919fa5c06094275b64abcc66af2eecfc6de7078d6a1b8278eff354ec\": container with ID starting with 9baad860919fa5c06094275b64abcc66af2eecfc6de7078d6a1b8278eff354ec not found: ID does not exist" containerID="9baad860919fa5c06094275b64abcc66af2eecfc6de7078d6a1b8278eff354ec"
Oct 30 22:25:17.228813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:17.228723    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9baad860919fa5c06094275b64abcc66af2eecfc6de7078d6a1b8278eff354ec"} err="failed to get container status \"9baad860919fa5c06094275b64abcc66af2eecfc6de7078d6a1b8278eff354ec\": rpc error: code = NotFound desc = could not find container \"9baad860919fa5c06094275b64abcc66af2eecfc6de7078d6a1b8278eff354ec\": container with ID starting with 9baad860919fa5c06094275b64abcc66af2eecfc6de7078d6a1b8278eff354ec not found: ID does not exist"
Oct 30 22:25:17.385032 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:17.384955    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"]
Oct 30 22:25:17.434235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:17.434194    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-bf7cbf-6b6b7778b7-vjlsf"]
Oct 30 22:25:17.451005 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:17.450961    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"]
Oct 30 22:25:17.451316 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:17.451233    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq" podUID="6ab4caf4-843c-46ef-a936-a8eb42f5053f" containerName="istio-proxy" containerID="cri-o://7b57662e18836151ba868a8f451073041661feee85417c5facfeb11cff469a0a" gracePeriod=30
Oct 30 22:25:18.075096 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:18.075066    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="34de2b70-307f-4377-81ac-b5e8913dab09" path="/var/lib/kubelet/pods/34de2b70-307f-4377-81ac-b5e8913dab09/volumes"
Oct 30 22:25:18.248201 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:18.248164    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:18.548803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:18.548773    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:21.540424 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:21.540387    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:21.836539 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:21.836429    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:22.110452 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.110366    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:22.732048 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.731992    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 22:25:22.836421 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.836123    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-token\" (UniqueName: \"kubernetes.io/projected/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-token\") pod \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") "
Oct 30 22:25:22.836421 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.836188    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-podinfo\") pod \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") "
Oct 30 22:25:22.836421 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.836251    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ab4caf4-843c-46ef-a936-a8eb42f5053f-kube-api-access-98ndk\" (UniqueName: \"kubernetes.io/projected/6ab4caf4-843c-46ef-a936-a8eb42f5053f-kube-api-access-98ndk\") pod \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") "
Oct 30 22:25:22.836421 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.836352    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-workload-certs\") pod \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") "
Oct 30 22:25:22.836421 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.836415    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-credential-socket\") pod \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") "
Oct 30 22:25:22.836908 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.836450    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-envoy\") pod \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") "
Oct 30 22:25:22.836908 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.836498    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-data\") pod \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") "
Oct 30 22:25:22.836908 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.836563    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-workload-socket\") pod \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") "
Oct 30 22:25:22.836908 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.836640    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istiod-ca-cert\") pod \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\" (UID: \"6ab4caf4-843c-46ef-a936-a8eb42f5053f\") "
Oct 30 22:25:22.838462 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.837392    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-workload-certs" pod "6ab4caf4-843c-46ef-a936-a8eb42f5053f" (UID: "6ab4caf4-843c-46ef-a936-a8eb42f5053f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:22.838462 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.838057    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istiod-ca-cert" pod "6ab4caf4-843c-46ef-a936-a8eb42f5053f" (UID: "6ab4caf4-843c-46ef-a936-a8eb42f5053f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:22.841203 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.840763    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-credential-socket" pod "6ab4caf4-843c-46ef-a936-a8eb42f5053f" (UID: "6ab4caf4-843c-46ef-a936-a8eb42f5053f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:22.842292 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.842260    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-data" pod "6ab4caf4-843c-46ef-a936-a8eb42f5053f" (UID: "6ab4caf4-843c-46ef-a936-a8eb42f5053f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:22.848617 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.843392    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-workload-socket" pod "6ab4caf4-843c-46ef-a936-a8eb42f5053f" (UID: "6ab4caf4-843c-46ef-a936-a8eb42f5053f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:22.850542 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.849617    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-podinfo" pod "6ab4caf4-843c-46ef-a936-a8eb42f5053f" (UID: "6ab4caf4-843c-46ef-a936-a8eb42f5053f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:25:22.859977 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.858485    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-token" pod "6ab4caf4-843c-46ef-a936-a8eb42f5053f" (UID: "6ab4caf4-843c-46ef-a936-a8eb42f5053f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:22.863874 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.863842    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-envoy" pod "6ab4caf4-843c-46ef-a936-a8eb42f5053f" (UID: "6ab4caf4-843c-46ef-a936-a8eb42f5053f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:22.866868 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.866841    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ab4caf4-843c-46ef-a936-a8eb42f5053f-kube-api-access-98ndk" pod "6ab4caf4-843c-46ef-a936-a8eb42f5053f" (UID: "6ab4caf4-843c-46ef-a936-a8eb42f5053f"). InnerVolumeSpecName "kube-api-access-98ndk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:22.938835 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.938800    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:22.938835 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.938828    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:22.938835 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.938837    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:22.939143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.938846    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:22.939143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.938855    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98ndk\" (UniqueName: \"kubernetes.io/projected/6ab4caf4-843c-46ef-a936-a8eb42f5053f-kube-api-access-98ndk\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:22.939143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.938865    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:22.939143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.938874    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:22.939143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.938882    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:22.939143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:22.938892    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ab4caf4-843c-46ef-a936-a8eb42f5053f-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:23.266029 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:23.265990    4918 generic.go:356] "Generic (PLEG): container finished" podID="6ab4caf4-843c-46ef-a936-a8eb42f5053f" containerID="7b57662e18836151ba868a8f451073041661feee85417c5facfeb11cff469a0a" exitCode=0
Oct 30 22:25:23.266198 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:23.266043    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq" event={"ID":"6ab4caf4-843c-46ef-a936-a8eb42f5053f","Type":"ContainerDied","Data":"7b57662e18836151ba868a8f451073041661feee85417c5facfeb11cff469a0a"}
Oct 30 22:25:23.266198 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:23.266097    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq" event={"ID":"6ab4caf4-843c-46ef-a936-a8eb42f5053f","Type":"ContainerDied","Data":"4bdf4e7426498a29dd962dd1178265746f6f17b064e39ecd5e53e92976af6618"}
Oct 30 22:25:23.266198 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:23.266046    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"
Oct 30 22:25:23.266315 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:23.266128    4918 scope.go:122] "RemoveContainer" containerID="7b57662e18836151ba868a8f451073041661feee85417c5facfeb11cff469a0a"
Oct 30 22:25:23.277957 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:23.277933    4918 scope.go:122] "RemoveContainer" containerID="3584487eac3a3cf7cf6cce69e8cfa0aabba580f1b22fec974e403392924bb5dc"
Oct 30 22:25:23.287554 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:23.287538    4918 scope.go:122] "RemoveContainer" containerID="7b57662e18836151ba868a8f451073041661feee85417c5facfeb11cff469a0a"
Oct 30 22:25:23.287826 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:25:23.287796    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b57662e18836151ba868a8f451073041661feee85417c5facfeb11cff469a0a\": container with ID starting with 7b57662e18836151ba868a8f451073041661feee85417c5facfeb11cff469a0a not found: ID does not exist" containerID="7b57662e18836151ba868a8f451073041661feee85417c5facfeb11cff469a0a"
Oct 30 22:25:23.287925 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:23.287835    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b57662e18836151ba868a8f451073041661feee85417c5facfeb11cff469a0a"} err="failed to get container status \"7b57662e18836151ba868a8f451073041661feee85417c5facfeb11cff469a0a\": rpc error: code = NotFound desc = could not find container \"7b57662e18836151ba868a8f451073041661feee85417c5facfeb11cff469a0a\": container with ID starting with 7b57662e18836151ba868a8f451073041661feee85417c5facfeb11cff469a0a not found: ID does not exist"
Oct 30 22:25:23.287925 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:23.287859    4918 scope.go:122] "RemoveContainer" containerID="3584487eac3a3cf7cf6cce69e8cfa0aabba580f1b22fec974e403392924bb5dc"
Oct 30 22:25:23.288083 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:25:23.288065    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3584487eac3a3cf7cf6cce69e8cfa0aabba580f1b22fec974e403392924bb5dc\": container with ID starting with 3584487eac3a3cf7cf6cce69e8cfa0aabba580f1b22fec974e403392924bb5dc not found: ID does not exist" containerID="3584487eac3a3cf7cf6cce69e8cfa0aabba580f1b22fec974e403392924bb5dc"
Oct 30 22:25:23.288125 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:23.288089    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3584487eac3a3cf7cf6cce69e8cfa0aabba580f1b22fec974e403392924bb5dc"} err="failed to get container status \"3584487eac3a3cf7cf6cce69e8cfa0aabba580f1b22fec974e403392924bb5dc\": rpc error: code = NotFound desc = could not find container \"3584487eac3a3cf7cf6cce69e8cfa0aabba580f1b22fec974e403392924bb5dc\": container with ID starting with 3584487eac3a3cf7cf6cce69e8cfa0aabba580f1b22fec974e403392924bb5dc not found: ID does not exist"
Oct 30 22:25:23.437457 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:23.437425    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"]
Oct 30 22:25:23.487296 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:23.487263    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-cef074-openshift-default-569676869-c2wkq"]
Oct 30 22:25:23.537813 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:23.537726    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:24.073836 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:24.073807    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6ab4caf4-843c-46ef-a936-a8eb42f5053f" path="/var/lib/kubelet/pods/6ab4caf4-843c-46ef-a936-a8eb42f5053f/volumes"
Oct 30 22:25:25.048129 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:25.048091    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:25.322201 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:25.322116    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:27.039296 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:27.039252    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:27.288844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:27.288803    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:29.296645 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:29.296605    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:29.609622 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:29.609526    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:31.318738 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:31.318630    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"]
Oct 30 22:25:31.319184 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:31.318884    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9" podUID="67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc" containerName="maas-api" containerID="cri-o://da473659ad78d7eff40cd4978eae5dfb6472bf2cc7d9ad3758ed05055655d974" gracePeriod=30
Oct 30 22:25:31.561881 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:31.561821    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:31.633510 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:31.633487    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:25:31.776833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:31.776803    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-openshift-service-ca\") pod \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") "
Oct 30 22:25:31.777018 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:31.776848    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-metrics-certs\" (UniqueName: \"kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-metrics-certs\") pod \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") "
Oct 30 22:25:31.777018 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:31.776870    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-kube-api-access-zxtxx\" (UniqueName: \"kubernetes.io/projected/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-kube-api-access-zxtxx\") pod \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") "
Oct 30 22:25:31.777018 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:31.776989    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-maas-api-tls\") pod \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\" (UID: \"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc\") "
Oct 30 22:25:31.777250 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:31.777222    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-openshift-service-ca" pod "67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc" (UID: "67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:31.777788 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:31.777703    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:31.779321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:31.779294    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-metrics-certs" pod "67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc" (UID: "67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:31.779420 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:31.779370    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-kube-api-access-zxtxx" pod "67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc" (UID: "67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc"). InnerVolumeSpecName "kube-api-access-zxtxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:31.779963 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:31.779934    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-maas-api-tls" pod "67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc" (UID: "67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:31.879048 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:31.878973    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:31.879048 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:31.879001    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxtxx\" (UniqueName: \"kubernetes.io/projected/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-kube-api-access-zxtxx\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:31.879048 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:31.879012    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:32.157640 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:25:32.157606    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:25:32.390712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:32.389937    4918 generic.go:356] "Generic (PLEG): container finished" podID="67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc" containerID="da473659ad78d7eff40cd4978eae5dfb6472bf2cc7d9ad3758ed05055655d974" exitCode=0
Oct 30 22:25:32.390712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:32.390083    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9" event={"ID":"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc","Type":"ContainerDied","Data":"da473659ad78d7eff40cd4978eae5dfb6472bf2cc7d9ad3758ed05055655d974"}
Oct 30 22:25:32.390712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:32.390136    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9" event={"ID":"67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc","Type":"ContainerDied","Data":"465abdd14a2f99784dfe30548e7500c3ef72698d518497d51f154e494e2a4099"}
Oct 30 22:25:32.390712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:32.390168    4918 scope.go:122] "RemoveContainer" containerID="da473659ad78d7eff40cd4978eae5dfb6472bf2cc7d9ad3758ed05055655d974"
Oct 30 22:25:32.390712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:32.390323    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"
Oct 30 22:25:32.412507 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:32.412480    4918 scope.go:122] "RemoveContainer" containerID="da473659ad78d7eff40cd4978eae5dfb6472bf2cc7d9ad3758ed05055655d974"
Oct 30 22:25:32.412989 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:25:32.412958    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da473659ad78d7eff40cd4978eae5dfb6472bf2cc7d9ad3758ed05055655d974\": container with ID starting with da473659ad78d7eff40cd4978eae5dfb6472bf2cc7d9ad3758ed05055655d974 not found: ID does not exist" containerID="da473659ad78d7eff40cd4978eae5dfb6472bf2cc7d9ad3758ed05055655d974"
Oct 30 22:25:32.413114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:32.412991    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da473659ad78d7eff40cd4978eae5dfb6472bf2cc7d9ad3758ed05055655d974"} err="failed to get container status \"da473659ad78d7eff40cd4978eae5dfb6472bf2cc7d9ad3758ed05055655d974\": rpc error: code = NotFound desc = could not find container \"da473659ad78d7eff40cd4978eae5dfb6472bf2cc7d9ad3758ed05055655d974\": container with ID starting with da473659ad78d7eff40cd4978eae5dfb6472bf2cc7d9ad3758ed05055655d974 not found: ID does not exist"
Oct 30 22:25:32.555431 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:32.555401    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"]
Oct 30 22:25:32.557941 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:32.557910    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w5-2b7317-6f4cdd97d-kv4v9"]
Oct 30 22:25:33.236988 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:33.236956    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:33.502439 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:33.502356    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:34.073618 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:34.073588    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc" path="/var/lib/kubelet/pods/67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc/volumes"
Oct 30 22:25:34.088419 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:34.088380    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:35.248997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:35.248967    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"]
Oct 30 22:25:35.249433 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:35.249158    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5" podUID="b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" containerName="istio-proxy" containerID="cri-o://d1f00502d2017bbdcd658387f4e5478238eeffc528c1d8ff6b4a79c97d189df7" gracePeriod=30
Oct 30 22:25:35.370716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:35.366015    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:35.914297 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:35.914247    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:36.347623 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:36.347550    4918 patch_prober.go:29] interesting pod/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:25:36.347623 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:36.347614    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5" podUID="b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:25:38.582032 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:38.581997    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:38.882986 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:38.882884    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:40.475840 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.475790    4918 generic.go:356] "Generic (PLEG): container finished" podID="b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" containerID="d1f00502d2017bbdcd658387f4e5478238eeffc528c1d8ff6b4a79c97d189df7" exitCode=0
Oct 30 22:25:40.476312 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.475872    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5" event={"ID":"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f","Type":"ContainerDied","Data":"d1f00502d2017bbdcd658387f4e5478238eeffc528c1d8ff6b4a79c97d189df7"}
Oct 30 22:25:40.476312 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.475946    4918 scope.go:122] "RemoveContainer" containerID="1de595c912a8dac9e34664e2158c69d3cdb08fb0967f713f253f7c15cb6f95ac"
Oct 30 22:25:40.532821 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.532767    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:25:40.678413 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.678380    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:40.687364 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.687335    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-podinfo\") pod \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") "
Oct 30 22:25:40.687496 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.687378    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-workload-socket\") pod \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") "
Oct 30 22:25:40.687496 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.687472    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-data\") pod \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") "
Oct 30 22:25:40.687597 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.687581    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-credential-socket\") pod \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") "
Oct 30 22:25:40.687652 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.687630    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-workload-certs\") pod \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") "
Oct 30 22:25:40.687733 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.687703    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-workload-socket" pod "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" (UID: "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:40.687798 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.687731    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-kube-api-access-wshdk\" (UniqueName: \"kubernetes.io/projected/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-kube-api-access-wshdk\") pod \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") "
Oct 30 22:25:40.687798 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.687777    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-data" pod "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" (UID: "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:40.687912 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.687786    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-envoy\") pod \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") "
Oct 30 22:25:40.687912 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.687897    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-workload-certs" pod "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" (UID: "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:40.688037 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.687917    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istiod-ca-cert\") pod \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") "
Oct 30 22:25:40.688037 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.687967    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-token\" (UniqueName: \"kubernetes.io/projected/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-token\") pod \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\" (UID: \"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f\") "
Oct 30 22:25:40.688037 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.687915    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-credential-socket" pod "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" (UID: "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:40.688269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.688240    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istiod-ca-cert" pod "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" (UID: "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:40.688771 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.688746    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:40.688771 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.688774    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:40.688965 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.688790    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:40.688965 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.688803    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:40.688965 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.688820    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:40.689853 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.689826    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-podinfo" pod "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" (UID: "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:25:40.690099 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.690078    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-envoy" pod "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" (UID: "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:40.690755 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.690675    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-token" pod "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" (UID: "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:40.690755 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.690722    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-kube-api-access-wshdk" pod "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" (UID: "b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f"). InnerVolumeSpecName "kube-api-access-wshdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:40.789873 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.789806    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:40.789873 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.789831    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:40.789873 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.789842    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wshdk\" (UniqueName: \"kubernetes.io/projected/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-kube-api-access-wshdk\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:40.789873 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.789852    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:40.885555 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.885519    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"]
Oct 30 22:25:40.885822 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:40.885795    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp" podUID="2f4c3406-75c9-4871-b92f-15676af6e5d7" containerName="istio-proxy" containerID="cri-o://ba90dc4c1b7775e2683e9ef50a3aa5b4dddb0982f29fcbd8df4c945c29796860" gracePeriod=30
Oct 30 22:25:41.025989 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:41.025788    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:41.292347 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:41.292304    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:41.483115 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:41.483083    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"
Oct 30 22:25:41.483115 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:41.483108    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5" event={"ID":"b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f","Type":"ContainerDied","Data":"7f6238c3ee56ad8b888033df51a22d70ec74afb9d2cfd1280542f46b0b8d87b6"}
Oct 30 22:25:41.483578 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:41.483161    4918 scope.go:122] "RemoveContainer" containerID="d1f00502d2017bbdcd658387f4e5478238eeffc528c1d8ff6b4a79c97d189df7"
Oct 30 22:25:41.570855 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:41.570794    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:41.728451 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:41.728420    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"]
Oct 30 22:25:41.777554 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:41.777524    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b8a091-openshift-default-8486dd8885-lsjq5"]
Oct 30 22:25:42.073810 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:42.073778    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" path="/var/lib/kubelet/pods/b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f/volumes"
Oct 30 22:25:44.342918 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:44.342884    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:46.148498 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.148442    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:25:46.246165 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.246139    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-data\") pod \"2f4c3406-75c9-4871-b92f-15676af6e5d7\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") "
Oct 30 22:25:46.246303 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.246219    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-token\" (UniqueName: \"kubernetes.io/projected/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-token\") pod \"2f4c3406-75c9-4871-b92f-15676af6e5d7\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") "
Oct 30 22:25:46.246303 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.246248    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2f4c3406-75c9-4871-b92f-15676af6e5d7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f4c3406-75c9-4871-b92f-15676af6e5d7-istiod-ca-cert\") pod \"2f4c3406-75c9-4871-b92f-15676af6e5d7\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") "
Oct 30 22:25:46.246303 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.246293    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-workload-socket\") pod \"2f4c3406-75c9-4871-b92f-15676af6e5d7\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") "
Oct 30 22:25:46.246487 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.246347    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-credential-socket\") pod \"2f4c3406-75c9-4871-b92f-15676af6e5d7\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") "
Oct 30 22:25:46.246487 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.246382    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-podinfo\") pod \"2f4c3406-75c9-4871-b92f-15676af6e5d7\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") "
Oct 30 22:25:46.246487 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.246420    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-workload-certs\") pod \"2f4c3406-75c9-4871-b92f-15676af6e5d7\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") "
Oct 30 22:25:46.246487 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.246424    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-data" pod "2f4c3406-75c9-4871-b92f-15676af6e5d7" (UID: "2f4c3406-75c9-4871-b92f-15676af6e5d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:46.246724 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.246489    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-envoy\") pod \"2f4c3406-75c9-4871-b92f-15676af6e5d7\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") "
Oct 30 22:25:46.246724 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.246559    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f4c3406-75c9-4871-b92f-15676af6e5d7-kube-api-access-rjxd2\" (UniqueName: \"kubernetes.io/projected/2f4c3406-75c9-4871-b92f-15676af6e5d7-kube-api-access-rjxd2\") pod \"2f4c3406-75c9-4871-b92f-15676af6e5d7\" (UID: \"2f4c3406-75c9-4871-b92f-15676af6e5d7\") "
Oct 30 22:25:46.246724 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.246579    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-workload-socket" pod "2f4c3406-75c9-4871-b92f-15676af6e5d7" (UID: "2f4c3406-75c9-4871-b92f-15676af6e5d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:46.246724 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.246617    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-credential-socket" pod "2f4c3406-75c9-4871-b92f-15676af6e5d7" (UID: "2f4c3406-75c9-4871-b92f-15676af6e5d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:46.246724 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.246649    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f4c3406-75c9-4871-b92f-15676af6e5d7-istiod-ca-cert" pod "2f4c3406-75c9-4871-b92f-15676af6e5d7" (UID: "2f4c3406-75c9-4871-b92f-15676af6e5d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:46.246986 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.246774    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-workload-certs" pod "2f4c3406-75c9-4871-b92f-15676af6e5d7" (UID: "2f4c3406-75c9-4871-b92f-15676af6e5d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:46.247269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.247247    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:46.247356 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.247272    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f4c3406-75c9-4871-b92f-15676af6e5d7-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:46.247356 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.247287    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:46.247356 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.247301    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:46.247356 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.247315    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:46.248659 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.248632    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-token" pod "2f4c3406-75c9-4871-b92f-15676af6e5d7" (UID: "2f4c3406-75c9-4871-b92f-15676af6e5d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:46.248817 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.248801    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f4c3406-75c9-4871-b92f-15676af6e5d7-kube-api-access-rjxd2" pod "2f4c3406-75c9-4871-b92f-15676af6e5d7" (UID: "2f4c3406-75c9-4871-b92f-15676af6e5d7"). InnerVolumeSpecName "kube-api-access-rjxd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:46.249159 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.249138    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-envoy" pod "2f4c3406-75c9-4871-b92f-15676af6e5d7" (UID: "2f4c3406-75c9-4871-b92f-15676af6e5d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:25:46.249159 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.249147    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-podinfo" pod "2f4c3406-75c9-4871-b92f-15676af6e5d7" (UID: "2f4c3406-75c9-4871-b92f-15676af6e5d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:25:46.349268 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.349236    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:46.349389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.349270    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:46.349389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.349284    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f4c3406-75c9-4871-b92f-15676af6e5d7-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:46.349389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.349299    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjxd2\" (UniqueName: \"kubernetes.io/projected/2f4c3406-75c9-4871-b92f-15676af6e5d7-kube-api-access-rjxd2\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:46.516710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.516602    4918 generic.go:356] "Generic (PLEG): container finished" podID="2f4c3406-75c9-4871-b92f-15676af6e5d7" containerID="ba90dc4c1b7775e2683e9ef50a3aa5b4dddb0982f29fcbd8df4c945c29796860" exitCode=0
Oct 30 22:25:46.516710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.516660    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"
Oct 30 22:25:46.516885 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.516707    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp" event={"ID":"2f4c3406-75c9-4871-b92f-15676af6e5d7","Type":"ContainerDied","Data":"ba90dc4c1b7775e2683e9ef50a3aa5b4dddb0982f29fcbd8df4c945c29796860"}
Oct 30 22:25:46.516885 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.516763    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp" event={"ID":"2f4c3406-75c9-4871-b92f-15676af6e5d7","Type":"ContainerDied","Data":"67bcad71457fc7ae3b96c8d73a759b828efdfb632ac0936f90e93abe59d4a914"}
Oct 30 22:25:46.516885 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.516787    4918 scope.go:122] "RemoveContainer" containerID="ba90dc4c1b7775e2683e9ef50a3aa5b4dddb0982f29fcbd8df4c945c29796860"
Oct 30 22:25:46.531056 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.531011    4918 scope.go:122] "RemoveContainer" containerID="b9693ec12e6832b97d37aef15e067b78afd9949d88391123dd480604d5876129"
Oct 30 22:25:46.540528 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.540505    4918 scope.go:122] "RemoveContainer" containerID="ba90dc4c1b7775e2683e9ef50a3aa5b4dddb0982f29fcbd8df4c945c29796860"
Oct 30 22:25:46.540836 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:25:46.540813    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba90dc4c1b7775e2683e9ef50a3aa5b4dddb0982f29fcbd8df4c945c29796860\": container with ID starting with ba90dc4c1b7775e2683e9ef50a3aa5b4dddb0982f29fcbd8df4c945c29796860 not found: ID does not exist" containerID="ba90dc4c1b7775e2683e9ef50a3aa5b4dddb0982f29fcbd8df4c945c29796860"
Oct 30 22:25:46.540892 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.540846    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba90dc4c1b7775e2683e9ef50a3aa5b4dddb0982f29fcbd8df4c945c29796860"} err="failed to get container status \"ba90dc4c1b7775e2683e9ef50a3aa5b4dddb0982f29fcbd8df4c945c29796860\": rpc error: code = NotFound desc = could not find container \"ba90dc4c1b7775e2683e9ef50a3aa5b4dddb0982f29fcbd8df4c945c29796860\": container with ID starting with ba90dc4c1b7775e2683e9ef50a3aa5b4dddb0982f29fcbd8df4c945c29796860 not found: ID does not exist"
Oct 30 22:25:46.540892 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.540863    4918 scope.go:122] "RemoveContainer" containerID="b9693ec12e6832b97d37aef15e067b78afd9949d88391123dd480604d5876129"
Oct 30 22:25:46.541118 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:25:46.541101    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9693ec12e6832b97d37aef15e067b78afd9949d88391123dd480604d5876129\": container with ID starting with b9693ec12e6832b97d37aef15e067b78afd9949d88391123dd480604d5876129 not found: ID does not exist" containerID="b9693ec12e6832b97d37aef15e067b78afd9949d88391123dd480604d5876129"
Oct 30 22:25:46.541160 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.541124    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9693ec12e6832b97d37aef15e067b78afd9949d88391123dd480604d5876129"} err="failed to get container status \"b9693ec12e6832b97d37aef15e067b78afd9949d88391123dd480604d5876129\": rpc error: code = NotFound desc = could not find container \"b9693ec12e6832b97d37aef15e067b78afd9949d88391123dd480604d5876129\": container with ID starting with b9693ec12e6832b97d37aef15e067b78afd9949d88391123dd480604d5876129 not found: ID does not exist"
Oct 30 22:25:46.567847 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.567819    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:46.690019 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.689980    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"]
Oct 30 22:25:46.690181 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:46.690039    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w5-2b7317-openshift-default-5c85f5c75-f7gxp"]
Oct 30 22:25:47.094820 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:47.094764    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:47.346245 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:47.346156    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:48.073825 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:48.073795    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2f4c3406-75c9-4871-b92f-15676af6e5d7" path="/var/lib/kubelet/pods/2f4c3406-75c9-4871-b92f-15676af6e5d7/volumes"
Oct 30 22:25:49.294083 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:49.294045    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:49.660829 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:49.660798    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:49.927920 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:49.927849    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:52.829641 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:52.829600    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:53.081693 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:53.081595    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:53.870712 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:53.870314    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:55.314072 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.314042    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"]
Oct 30 22:25:55.314464 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.314228    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy" containerID="cri-o://65a4f8a9a17794d586ba6057395980c3a8e4f1703f7756e5cea7839d143a5140" gracePeriod=30
Oct 30 22:25:55.363580 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.363550    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"]
Oct 30 22:25:55.363800 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.363784    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w" podUID="dc87536c-72a7-4afb-9a5b-28d69ef186ab" containerName="istio-proxy" containerID="cri-o://443116ea21d242d067fe85128ae0f510c8b886299c7d8779487d9dc42d4c0d4f" gracePeriod=30
Oct 30 22:25:55.367431 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.367366    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"]
Oct 30 22:25:55.367641 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.367613    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497" podUID="3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" containerName="istio-proxy" containerID="cri-o://c41596ee76cb3b26aba0735826c3ad225542f2e0f1a6f0c22d0ed635f5368f87" gracePeriod=30
Oct 30 22:25:55.472350 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.472321    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"]
Oct 30 22:25:55.472915 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.472899    4918 cpu_manager.go:414] "containerMap: removing container" podUID="061e5396-ce07-46fe-b478-91d10896e249" containerName="payload-processing"
Oct 30 22:25:55.472972 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.472917    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="061e5396-ce07-46fe-b478-91d10896e249" containerName="payload-processing"
Oct 30 22:25:55.472972 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.472929    4918 cpu_manager.go:414] "containerMap: removing container" podUID="e184fc8f-c462-4f29-bbf0-46ab63033f13" containerName="istio-proxy"
Oct 30 22:25:55.472972 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.472934    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e184fc8f-c462-4f29-bbf0-46ab63033f13" containerName="istio-proxy"
Oct 30 22:25:55.472972 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.472946    4918 cpu_manager.go:414] "containerMap: removing container" podUID="612f3d2b-2897-489a-bb3e-0dc4b00f49e4" containerName="istio-proxy"
Oct 30 22:25:55.472972 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.472950    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="612f3d2b-2897-489a-bb3e-0dc4b00f49e4" containerName="istio-proxy"
Oct 30 22:25:55.472972 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.472960    4918 cpu_manager.go:414] "containerMap: removing container" podUID="b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" containerName="istio-proxy"
Oct 30 22:25:55.472972 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.472965    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" containerName="istio-proxy"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.472976    4918 cpu_manager.go:414] "containerMap: removing container" podUID="2f4c3406-75c9-4871-b92f-15676af6e5d7" containerName="istio-proxy"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.472981    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f4c3406-75c9-4871-b92f-15676af6e5d7" containerName="istio-proxy"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.472990    4918 cpu_manager.go:414] "containerMap: removing container" podUID="b87b4e20-3e41-4364-a89e-f92ef042a0db" containerName="payload-pre-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.472995    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b87b4e20-3e41-4364-a89e-f92ef042a0db" containerName="payload-pre-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473005    4918 cpu_manager.go:414] "containerMap: removing container" podUID="844e6de8-25be-467f-a7f5-492b77d45bb8" containerName="payload-pre-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473009    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="844e6de8-25be-467f-a7f5-492b77d45bb8" containerName="payload-pre-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473019    4918 cpu_manager.go:414] "containerMap: removing container" podUID="67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc" containerName="maas-api"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473023    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc" containerName="maas-api"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473030    4918 cpu_manager.go:414] "containerMap: removing container" podUID="176181fd-429c-45fe-a755-2d97b9bae435" containerName="istio-proxy"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473034    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="176181fd-429c-45fe-a755-2d97b9bae435" containerName="istio-proxy"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473040    4918 cpu_manager.go:414] "containerMap: removing container" podUID="6ab4caf4-843c-46ef-a936-a8eb42f5053f" containerName="istio-proxy"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473047    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ab4caf4-843c-46ef-a936-a8eb42f5053f" containerName="istio-proxy"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473054    4918 cpu_manager.go:414] "containerMap: removing container" podUID="cf72b38f-08c1-495f-bb7b-7b555ffa89cb" containerName="payload-pre-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473058    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf72b38f-08c1-495f-bb7b-7b555ffa89cb" containerName="payload-pre-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473069    4918 cpu_manager.go:414] "containerMap: removing container" podUID="6b84ddf8-b9a7-4b38-911a-956bf8348821" containerName="maas-api"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473073    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b84ddf8-b9a7-4b38-911a-956bf8348821" containerName="maas-api"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473079    4918 cpu_manager.go:414] "containerMap: removing container" podUID="176181fd-429c-45fe-a755-2d97b9bae435" containerName="istio-proxy"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473083    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="176181fd-429c-45fe-a755-2d97b9bae435" containerName="istio-proxy"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473089    4918 cpu_manager.go:414] "containerMap: removing container" podUID="0655fa00-4030-4426-aa2d-07636dcc82a3" containerName="maas-api"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473093    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0655fa00-4030-4426-aa2d-07636dcc82a3" containerName="maas-api"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473100    4918 cpu_manager.go:414] "containerMap: removing container" podUID="304dcc1f-95a3-4265-addf-52fcd249ea24" containerName="payload-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473106    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="304dcc1f-95a3-4265-addf-52fcd249ea24" containerName="payload-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473119    4918 cpu_manager.go:414] "containerMap: removing container" podUID="4b5caa06-ef8f-4250-9928-3b5e5b5ef502" containerName="payload-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473123    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4b5caa06-ef8f-4250-9928-3b5e5b5ef502" containerName="payload-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473130    4918 cpu_manager.go:414] "containerMap: removing container" podUID="3424cac6-8a47-4d3e-9faf-e79b9175de1f" containerName="payload-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473134    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3424cac6-8a47-4d3e-9faf-e79b9175de1f" containerName="payload-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473144    4918 cpu_manager.go:414] "containerMap: removing container" podUID="cbd3d21b-6f89-4eaa-98eb-d83a9de11d64" containerName="maas-api"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473149    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cbd3d21b-6f89-4eaa-98eb-d83a9de11d64" containerName="maas-api"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473156    4918 cpu_manager.go:414] "containerMap: removing container" podUID="34de2b70-307f-4377-81ac-b5e8913dab09" containerName="payload-pre-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473161    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="34de2b70-307f-4377-81ac-b5e8913dab09" containerName="payload-pre-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473167    4918 cpu_manager.go:414] "containerMap: removing container" podUID="cd38dc35-09e7-4deb-b418-bb5a6a667d93" containerName="payload-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473171    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cd38dc35-09e7-4deb-b418-bb5a6a667d93" containerName="payload-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473179    4918 cpu_manager.go:414] "containerMap: removing container" podUID="38a22d19-473c-4f13-a59a-b6d89b9cb232" containerName="payload-pre-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473183    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="38a22d19-473c-4f13-a59a-b6d89b9cb232" containerName="payload-pre-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473189    4918 cpu_manager.go:414] "containerMap: removing container" podUID="06c38ed1-2d5f-4d24-94e2-66622e8730b2" containerName="payload-pre-processing"
Oct 30 22:25:55.473194 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473194    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06c38ed1-2d5f-4d24-94e2-66622e8730b2" containerName="payload-pre-processing"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473276    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="612f3d2b-2897-489a-bb3e-0dc4b00f49e4" containerName="istio-proxy"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473288    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" containerName="istio-proxy"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473297    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f4c3406-75c9-4871-b92f-15676af6e5d7" containerName="istio-proxy"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473307    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="b87b4e20-3e41-4364-a89e-f92ef042a0db" containerName="payload-pre-processing"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473318    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="844e6de8-25be-467f-a7f5-492b77d45bb8" containerName="payload-pre-processing"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473347    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="67c0dee0-b0e1-427a-9b8e-0a3f073ac3bc" containerName="maas-api"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473357    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="176181fd-429c-45fe-a755-2d97b9bae435" containerName="istio-proxy"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473364    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="6ab4caf4-843c-46ef-a936-a8eb42f5053f" containerName="istio-proxy"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473372    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="612f3d2b-2897-489a-bb3e-0dc4b00f49e4" containerName="istio-proxy"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473379    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf72b38f-08c1-495f-bb7b-7b555ffa89cb" containerName="payload-pre-processing"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473388    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f4c3406-75c9-4871-b92f-15676af6e5d7" containerName="istio-proxy"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473393    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="6b84ddf8-b9a7-4b38-911a-956bf8348821" containerName="maas-api"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473399    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="176181fd-429c-45fe-a755-2d97b9bae435" containerName="istio-proxy"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473407    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="0655fa00-4030-4426-aa2d-07636dcc82a3" containerName="maas-api"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473418    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="304dcc1f-95a3-4265-addf-52fcd249ea24" containerName="payload-processing"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473429    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="4b5caa06-ef8f-4250-9928-3b5e5b5ef502" containerName="payload-processing"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473434    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="3424cac6-8a47-4d3e-9faf-e79b9175de1f" containerName="payload-processing"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473442    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="e184fc8f-c462-4f29-bbf0-46ab63033f13" containerName="istio-proxy"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473449    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="cbd3d21b-6f89-4eaa-98eb-d83a9de11d64" containerName="maas-api"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473455    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="34de2b70-307f-4377-81ac-b5e8913dab09" containerName="payload-pre-processing"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473460    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="cd38dc35-09e7-4deb-b418-bb5a6a667d93" containerName="payload-processing"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473466    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="38a22d19-473c-4f13-a59a-b6d89b9cb232" containerName="payload-pre-processing"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473471    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="06c38ed1-2d5f-4d24-94e2-66622e8730b2" containerName="payload-pre-processing"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473477    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="061e5396-ce07-46fe-b478-91d10896e249" containerName="payload-processing"
Oct 30 22:25:55.474324 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.473485    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="e184fc8f-c462-4f29-bbf0-46ab63033f13" containerName="istio-proxy"
Oct 30 22:25:55.479276 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.479254    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:25:55.484893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.484836    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:55.537865 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.537841    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-026c11-serving-cert\""
Oct 30 22:25:55.546035 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.546008    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"]
Oct 30 22:25:55.585326 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.585271    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9dv5\" (UniqueName: \"kubernetes.io/projected/001d2e93-a0fb-4b18-9380-d3adacd51379-kube-api-access-x9dv5\") pod \"maas-api-e2e-inf-a-026c11-6576654955-29c9d\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:25:55.585326 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.585308    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-maas-api-tls\") pod \"maas-api-e2e-inf-a-026c11-6576654955-29c9d\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:25:55.585494 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.585406    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-metrics-certs\") pod \"maas-api-e2e-inf-a-026c11-6576654955-29c9d\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:25:55.585583 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.585562    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/001d2e93-a0fb-4b18-9380-d3adacd51379-openshift-service-ca\") pod \"maas-api-e2e-inf-a-026c11-6576654955-29c9d\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:25:55.687263 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.687228    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9dv5\" (UniqueName: \"kubernetes.io/projected/001d2e93-a0fb-4b18-9380-d3adacd51379-kube-api-access-x9dv5\") pod \"maas-api-e2e-inf-a-026c11-6576654955-29c9d\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:25:55.687446 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.687277    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-maas-api-tls\") pod \"maas-api-e2e-inf-a-026c11-6576654955-29c9d\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:25:55.687446 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.687337    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-metrics-certs\") pod \"maas-api-e2e-inf-a-026c11-6576654955-29c9d\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:25:55.687446 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.687420    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/001d2e93-a0fb-4b18-9380-d3adacd51379-openshift-service-ca\") pod \"maas-api-e2e-inf-a-026c11-6576654955-29c9d\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:25:55.687446 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:25:55.687437    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-serving-cert: secret "maas-api-e2e-inf-a-026c11-serving-cert" not found
Oct 30 22:25:55.687640 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:25:55.687503    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-maas-api-tls podName:001d2e93-a0fb-4b18-9380-d3adacd51379 nodeName:}" failed. No retries permitted until 2026-10-30 22:25:56.187486031 +0000 UTC m=+2494.236093704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-maas-api-tls") pod "maas-api-e2e-inf-a-026c11-6576654955-29c9d" (UID: "001d2e93-a0fb-4b18-9380-d3adacd51379") : secret "maas-api-e2e-inf-a-026c11-serving-cert" not found
Oct 30 22:25:55.688104 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.688082    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/001d2e93-a0fb-4b18-9380-d3adacd51379-openshift-service-ca\") pod \"maas-api-e2e-inf-a-026c11-6576654955-29c9d\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:25:55.689854 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.689822    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-metrics-certs\") pod \"maas-api-e2e-inf-a-026c11-6576654955-29c9d\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:25:55.774108 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.773867    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9dv5\" (UniqueName: \"kubernetes.io/projected/001d2e93-a0fb-4b18-9380-d3adacd51379-kube-api-access-x9dv5\") pod \"maas-api-e2e-inf-a-026c11-6576654955-29c9d\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:25:55.802154 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:55.802117    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:56.064621 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:56.064582    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:56.215612 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:56.215580    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-maas-api-tls\") pod \"maas-api-e2e-inf-a-026c11-6576654955-29c9d\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:25:56.218261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:56.218235    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-maas-api-tls\") pod \"maas-api-e2e-inf-a-026c11-6576654955-29c9d\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:25:56.327837 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:56.327659    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:56.396587 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:56.396556    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:25:56.594013 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:56.593927    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:56.793250 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:56.793224    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"]
Oct 30 22:25:56.795241 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:25:56.795215    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001d2e93_a0fb_4b18_9380_d3adacd51379.slice/crio-66043227fcb455a8abe22a85d0ac5d43ebc977e327ac0d6c1cd7e59b2eff9259 WatchSource:0}: Error finding container 66043227fcb455a8abe22a85d0ac5d43ebc977e327ac0d6c1cd7e59b2eff9259: Status 404 returned error can't find the container with id 66043227fcb455a8abe22a85d0ac5d43ebc977e327ac0d6c1cd7e59b2eff9259
Oct 30 22:25:57.461954 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:57.461913    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:57.598101 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:57.598067    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d" event={"ID":"001d2e93-a0fb-4b18-9380-d3adacd51379","Type":"ContainerStarted","Data":"66043227fcb455a8abe22a85d0ac5d43ebc977e327ac0d6c1cd7e59b2eff9259"}
Oct 30 22:25:57.781522 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:57.781443    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:58.508891 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:58.508851    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-tm497 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:25:58.509271 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:58.508918    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497" podUID="3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:25:58.525933 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:58.525895    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-b2m7w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:25:58.526063 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:58.525959    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w" podUID="dc87536c-72a7-4afb-9a5b-28d69ef186ab" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:25:58.607048 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:58.607009    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d" event={"ID":"001d2e93-a0fb-4b18-9380-d3adacd51379","Type":"ContainerStarted","Data":"f343ec6425f8a8397363e5643c613eb8c4453b6c53164758260d9e63e6e645f3"}
Oct 30 22:25:58.607188 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:58.607085    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:25:58.734120 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:25:58.734074    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d" podStartSLOduration=2.911057699 podStartE2EDuration="3.734062127s" totalImagesPullingTime="823.004428ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:25:58.732598687 +0000 UTC m=+2496.781206394" watchObservedRunningTime="2026-10-30 22:25:58.734062127 +0000 UTC m=+2496.782669821"
Oct 30 22:26:00.627563 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.627519    4918 generic.go:356] "Generic (PLEG): container finished" podID="dc87536c-72a7-4afb-9a5b-28d69ef186ab" containerID="443116ea21d242d067fe85128ae0f510c8b886299c7d8779487d9dc42d4c0d4f" exitCode=0
Oct 30 22:26:00.628036 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.627661    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w" event={"ID":"dc87536c-72a7-4afb-9a5b-28d69ef186ab","Type":"ContainerDied","Data":"443116ea21d242d067fe85128ae0f510c8b886299c7d8779487d9dc42d4c0d4f"}
Oct 30 22:26:00.629612 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.629586    4918 generic.go:356] "Generic (PLEG): container finished" podID="28475ffd-de42-4a6a-a116-25e940739ffb" containerID="65a4f8a9a17794d586ba6057395980c3a8e4f1703f7756e5cea7839d143a5140" exitCode=0
Oct 30 22:26:00.629839 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.629818    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" event={"ID":"28475ffd-de42-4a6a-a116-25e940739ffb","Type":"ContainerDied","Data":"65a4f8a9a17794d586ba6057395980c3a8e4f1703f7756e5cea7839d143a5140"}
Oct 30 22:26:00.631527 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.631499    4918 generic.go:356] "Generic (PLEG): container finished" podID="3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" containerID="c41596ee76cb3b26aba0735826c3ad225542f2e0f1a6f0c22d0ed635f5368f87" exitCode=0
Oct 30 22:26:00.631636 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.631576    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497" event={"ID":"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8","Type":"ContainerDied","Data":"c41596ee76cb3b26aba0735826c3ad225542f2e0f1a6f0c22d0ed635f5368f87"}
Oct 30 22:26:00.665434 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.665342    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:00.668781 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.668743    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:26:00.679575 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.679548    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.803525    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-data\") pod \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.803591    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-podinfo\") pod \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.803634    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dc87536c-72a7-4afb-9a5b-28d69ef186ab-kube-api-access-kwjpz\" (UniqueName: \"kubernetes.io/projected/dc87536c-72a7-4afb-9a5b-28d69ef186ab-kube-api-access-kwjpz\") pod \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.803723    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-workload-socket\") pod \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.803751    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istiod-ca-cert\") pod \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.803830    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-token\" (UniqueName: \"kubernetes.io/projected/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-token\") pod \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.803866    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-token\" (UniqueName: \"kubernetes.io/projected/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-token\") pod \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.803924    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-credential-socket\") pod \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.803980    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-kube-api-access-q9fm8\" (UniqueName: \"kubernetes.io/projected/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-kube-api-access-q9fm8\") pod \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.804026    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-workload-certs\") pod \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.804052    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-workload-socket\") pod \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.804078    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istiod-ca-cert\") pod \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.804103    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-podinfo\") pod \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.804133    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-data\") pod \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.804221    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-envoy\") pod \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.804250    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-credential-socket\") pod \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.804378    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-workload-certs\") pod \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\" (UID: \"dc87536c-72a7-4afb-9a5b-28d69ef186ab\") "
Oct 30 22:26:00.811044 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.804482    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-envoy\") pod \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\" (UID: \"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8\") "
Oct 30 22:26:00.848997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.814781    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-workload-certs" pod "dc87536c-72a7-4afb-9a5b-28d69ef186ab" (UID: "dc87536c-72a7-4afb-9a5b-28d69ef186ab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:00.848997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.815829    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-workload-socket" pod "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" (UID: "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:00.848997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.816053    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-credential-socket" pod "dc87536c-72a7-4afb-9a5b-28d69ef186ab" (UID: "dc87536c-72a7-4afb-9a5b-28d69ef186ab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:00.848997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.819184    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-data" pod "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" (UID: "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:00.848997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.824754    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-data" pod "dc87536c-72a7-4afb-9a5b-28d69ef186ab" (UID: "dc87536c-72a7-4afb-9a5b-28d69ef186ab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:00.848997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.829666    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-workload-certs" pod "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" (UID: "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:00.848997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.829948    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-workload-socket" pod "dc87536c-72a7-4afb-9a5b-28d69ef186ab" (UID: "dc87536c-72a7-4afb-9a5b-28d69ef186ab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:00.848997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.830223    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istiod-ca-cert" pod "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" (UID: "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:00.848997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.842566    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istiod-ca-cert" pod "dc87536c-72a7-4afb-9a5b-28d69ef186ab" (UID: "dc87536c-72a7-4afb-9a5b-28d69ef186ab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:00.848997 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.847849    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-credential-socket" pod "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" (UID: "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:00.850564 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.850418    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-podinfo" pod "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" (UID: "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:26:00.851192 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.851152    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc87536c-72a7-4afb-9a5b-28d69ef186ab-kube-api-access-kwjpz" pod "dc87536c-72a7-4afb-9a5b-28d69ef186ab" (UID: "dc87536c-72a7-4afb-9a5b-28d69ef186ab"). InnerVolumeSpecName "kube-api-access-kwjpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:00.853724 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.853700    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-token" pod "dc87536c-72a7-4afb-9a5b-28d69ef186ab" (UID: "dc87536c-72a7-4afb-9a5b-28d69ef186ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:00.856008 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.855979    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-kube-api-access-q9fm8" pod "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" (UID: "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8"). InnerVolumeSpecName "kube-api-access-q9fm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:00.856333 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.856304    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-envoy" pod "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" (UID: "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:00.857770 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.857741    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-envoy" pod "dc87536c-72a7-4afb-9a5b-28d69ef186ab" (UID: "dc87536c-72a7-4afb-9a5b-28d69ef186ab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:00.857876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.857748    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-token" pod "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" (UID: "3aed0330-8b15-4d4b-ade5-ae5c7a4877e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:00.858433 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.858405    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-podinfo" pod "dc87536c-72a7-4afb-9a5b-28d69ef186ab" (UID: "dc87536c-72a7-4afb-9a5b-28d69ef186ab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:26:00.906822 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906772    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.906822 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906819    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.906822 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906828    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.907059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906838    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9fm8\" (UniqueName: \"kubernetes.io/projected/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-kube-api-access-q9fm8\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.907059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906846    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.907059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906855    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.907059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906870    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.907059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906878    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.907059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906886    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.907059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906894    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.907059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906902    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.907059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906911    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.907059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906919    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.907059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906927    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.907059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906935    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.907059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906947    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwjpz\" (UniqueName: \"kubernetes.io/projected/dc87536c-72a7-4afb-9a5b-28d69ef186ab-kube-api-access-kwjpz\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.907059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906955    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:00.907059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:00.906963    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc87536c-72a7-4afb-9a5b-28d69ef186ab-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.026836 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.026624    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:01.038461 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.038437    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:26:01.112910 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.112879    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/28475ffd-de42-4a6a-a116-25e940739ffb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28475ffd-de42-4a6a-a116-25e940739ffb-istio-podinfo\") pod \"28475ffd-de42-4a6a-a116-25e940739ffb\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") "
Oct 30 22:26:01.113099 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.112924    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-istio-data\") pod \"28475ffd-de42-4a6a-a116-25e940739ffb\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") "
Oct 30 22:26:01.113099 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.112981    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-workload-certs\") pod \"28475ffd-de42-4a6a-a116-25e940739ffb\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") "
Oct 30 22:26:01.113099 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.113021    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-workload-socket\") pod \"28475ffd-de42-4a6a-a116-25e940739ffb\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") "
Oct 30 22:26:01.113099 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.113072    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/28475ffd-de42-4a6a-a116-25e940739ffb-istio-token\" (UniqueName: \"kubernetes.io/projected/28475ffd-de42-4a6a-a116-25e940739ffb-istio-token\") pod \"28475ffd-de42-4a6a-a116-25e940739ffb\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") "
Oct 30 22:26:01.113313 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.113149    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/28475ffd-de42-4a6a-a116-25e940739ffb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28475ffd-de42-4a6a-a116-25e940739ffb-istiod-ca-cert\") pod \"28475ffd-de42-4a6a-a116-25e940739ffb\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") "
Oct 30 22:26:01.113313 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.113182    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-credential-socket\") pod \"28475ffd-de42-4a6a-a116-25e940739ffb\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") "
Oct 30 22:26:01.113414 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.113327    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-istio-data" pod "28475ffd-de42-4a6a-a116-25e940739ffb" (UID: "28475ffd-de42-4a6a-a116-25e940739ffb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:01.113414 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.113327    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-workload-certs" pod "28475ffd-de42-4a6a-a116-25e940739ffb" (UID: "28475ffd-de42-4a6a-a116-25e940739ffb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:01.113414 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.113350    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-workload-socket" pod "28475ffd-de42-4a6a-a116-25e940739ffb" (UID: "28475ffd-de42-4a6a-a116-25e940739ffb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:01.113537 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.113464    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-credential-socket" pod "28475ffd-de42-4a6a-a116-25e940739ffb" (UID: "28475ffd-de42-4a6a-a116-25e940739ffb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:01.113537 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.113497    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-istio-envoy\") pod \"28475ffd-de42-4a6a-a116-25e940739ffb\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") "
Oct 30 22:26:01.113622 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.113574    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28475ffd-de42-4a6a-a116-25e940739ffb-istiod-ca-cert" pod "28475ffd-de42-4a6a-a116-25e940739ffb" (UID: "28475ffd-de42-4a6a-a116-25e940739ffb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:01.113622 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.113580    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/28475ffd-de42-4a6a-a116-25e940739ffb-kube-api-access-ft6lw\" (UniqueName: \"kubernetes.io/projected/28475ffd-de42-4a6a-a116-25e940739ffb-kube-api-access-ft6lw\") pod \"28475ffd-de42-4a6a-a116-25e940739ffb\" (UID: \"28475ffd-de42-4a6a-a116-25e940739ffb\") "
Oct 30 22:26:01.114202 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.114179    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.114349 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.114207    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.114349 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.114226    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.114349 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.114240    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28475ffd-de42-4a6a-a116-25e940739ffb-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.114349 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.114263    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.115476 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.115455    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/28475ffd-de42-4a6a-a116-25e940739ffb-istio-podinfo" pod "28475ffd-de42-4a6a-a116-25e940739ffb" (UID: "28475ffd-de42-4a6a-a116-25e940739ffb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:26:01.115476 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.115454    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28475ffd-de42-4a6a-a116-25e940739ffb-istio-token" pod "28475ffd-de42-4a6a-a116-25e940739ffb" (UID: "28475ffd-de42-4a6a-a116-25e940739ffb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:01.115650 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.115611    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-istio-envoy" pod "28475ffd-de42-4a6a-a116-25e940739ffb" (UID: "28475ffd-de42-4a6a-a116-25e940739ffb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:01.115873 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.115855    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28475ffd-de42-4a6a-a116-25e940739ffb-kube-api-access-ft6lw" pod "28475ffd-de42-4a6a-a116-25e940739ffb" (UID: "28475ffd-de42-4a6a-a116-25e940739ffb"). InnerVolumeSpecName "kube-api-access-ft6lw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:01.216256 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.216166    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28475ffd-de42-4a6a-a116-25e940739ffb-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.216256 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.216198    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft6lw\" (UniqueName: \"kubernetes.io/projected/28475ffd-de42-4a6a-a116-25e940739ffb-kube-api-access-ft6lw\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.216256 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.216211    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28475ffd-de42-4a6a-a116-25e940739ffb-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.216256 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.216223    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28475ffd-de42-4a6a-a116-25e940739ffb-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:01.689046 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.689001    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497" event={"ID":"3aed0330-8b15-4d4b-ade5-ae5c7a4877e8","Type":"ContainerDied","Data":"959da1906072732ee074dbdb13a7511d3be221047065836bacaf04d32c595273"}
Oct 30 22:26:01.689708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.689664    4918 scope.go:122] "RemoveContainer" containerID="c41596ee76cb3b26aba0735826c3ad225542f2e0f1a6f0c22d0ed635f5368f87"
Oct 30 22:26:01.690631 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.690117    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"
Oct 30 22:26:01.694020 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.693949    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w" event={"ID":"dc87536c-72a7-4afb-9a5b-28d69ef186ab","Type":"ContainerDied","Data":"3e9fcb1fb731fa64ec0e8d9381167b641a9d621ba42a88005ca0f91676fcc3c7"}
Oct 30 22:26:01.694138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.694103    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"
Oct 30 22:26:01.697561 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.697531    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7" event={"ID":"28475ffd-de42-4a6a-a116-25e940739ffb","Type":"ContainerDied","Data":"cc0e4c5a600ec5752117974e3f1b11f4d536b7091b13ee3568680f1b548ad4a8"}
Oct 30 22:26:01.697711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.697693    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"
Oct 30 22:26:01.729946 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.729911    4918 scope.go:122] "RemoveContainer" containerID="443116ea21d242d067fe85128ae0f510c8b886299c7d8779487d9dc42d4c0d4f"
Oct 30 22:26:01.740070 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.740047    4918 scope.go:122] "RemoveContainer" containerID="65a4f8a9a17794d586ba6057395980c3a8e4f1703f7756e5cea7839d143a5140"
Oct 30 22:26:01.863085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.863049    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"]
Oct 30 22:26:01.912810 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:01.912769    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-b2m7w"]
Oct 30 22:26:02.014744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:02.014637    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"]
Oct 30 22:26:02.026332 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:02.026301    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-4fhw7"]
Oct 30 22:26:02.077001 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:02.076968    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" path="/var/lib/kubelet/pods/28475ffd-de42-4a6a-a116-25e940739ffb/volumes"
Oct 30 22:26:02.077525 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:02.077505    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dc87536c-72a7-4afb-9a5b-28d69ef186ab" path="/var/lib/kubelet/pods/dc87536c-72a7-4afb-9a5b-28d69ef186ab/volumes"
Oct 30 22:26:02.136417 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:02.136389    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"]
Oct 30 22:26:02.144006 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:02.143977    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-tm497"]
Oct 30 22:26:02.161997 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:26:02.161965    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:26:02.512524 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:02.512487    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:02.814598 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:02.814511    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:03.101634 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:03.101549    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:03.599775 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:03.599744    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:04.073533 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:04.073501    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" path="/var/lib/kubelet/pods/3aed0330-8b15-4d4b-ade5-ae5c7a4877e8/volumes"
Oct 30 22:26:04.466578 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:04.466540    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:04.623008 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:04.622979    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:26:04.653715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:04.653667    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"]
Oct 30 22:26:04.653913 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:04.653893    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl" podUID="d8c8c11e-594d-444e-a5f5-1ac207dc74cb" containerName="istio-proxy" containerID="cri-o://52540e6ed4dbb50d7d6cadc6570b72d4f2a46be0d321a15e614fb4cbc47395b3" gracePeriod=30
Oct 30 22:26:04.751770 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:04.744595    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:05.008516 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:05.008430    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:05.938802 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:05.938762    4918 patch_prober.go:29] interesting pod/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:26:05.939200 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:05.938829    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl" podUID="d8c8c11e-594d-444e-a5f5-1ac207dc74cb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:26:08.177716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:08.177669    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:09.850051 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:09.849943    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:09.921156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:09.921097    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:26:10.032604 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.032570    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-kube-api-access-j8cvw\" (UniqueName: \"kubernetes.io/projected/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-kube-api-access-j8cvw\") pod \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") "
Oct 30 22:26:10.032804 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.032646    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-podinfo\") pod \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") "
Oct 30 22:26:10.032804 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.032767    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-workload-socket\") pod \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") "
Oct 30 22:26:10.032804 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.032800    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-credential-socket\") pod \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") "
Oct 30 22:26:10.032970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.032881    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-token\" (UniqueName: \"kubernetes.io/projected/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-token\") pod \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") "
Oct 30 22:26:10.032970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.032922    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-envoy\") pod \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") "
Oct 30 22:26:10.032970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.032949    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istiod-ca-cert\") pod \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") "
Oct 30 22:26:10.033140 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.032989    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-data\") pod \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") "
Oct 30 22:26:10.033140 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.033011    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-workload-certs\") pod \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\" (UID: \"d8c8c11e-594d-444e-a5f5-1ac207dc74cb\") "
Oct 30 22:26:10.033140 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.033012    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-workload-socket" pod "d8c8c11e-594d-444e-a5f5-1ac207dc74cb" (UID: "d8c8c11e-594d-444e-a5f5-1ac207dc74cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:10.033140 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.033104    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-credential-socket" pod "d8c8c11e-594d-444e-a5f5-1ac207dc74cb" (UID: "d8c8c11e-594d-444e-a5f5-1ac207dc74cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:10.033329 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.033270    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-data" pod "d8c8c11e-594d-444e-a5f5-1ac207dc74cb" (UID: "d8c8c11e-594d-444e-a5f5-1ac207dc74cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:10.033376 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.033332    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-workload-certs" pod "d8c8c11e-594d-444e-a5f5-1ac207dc74cb" (UID: "d8c8c11e-594d-444e-a5f5-1ac207dc74cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:10.033425 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.033399    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istiod-ca-cert" pod "d8c8c11e-594d-444e-a5f5-1ac207dc74cb" (UID: "d8c8c11e-594d-444e-a5f5-1ac207dc74cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:10.033582 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.033556    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:10.033582 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.033586    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:10.033833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.033602    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:10.033833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.033618    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:10.033833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.033631    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:10.035114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.035082    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-podinfo" pod "d8c8c11e-594d-444e-a5f5-1ac207dc74cb" (UID: "d8c8c11e-594d-444e-a5f5-1ac207dc74cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:26:10.035244 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.035163    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-kube-api-access-j8cvw" pod "d8c8c11e-594d-444e-a5f5-1ac207dc74cb" (UID: "d8c8c11e-594d-444e-a5f5-1ac207dc74cb"). InnerVolumeSpecName "kube-api-access-j8cvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:10.035471 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.035453    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-token" pod "d8c8c11e-594d-444e-a5f5-1ac207dc74cb" (UID: "d8c8c11e-594d-444e-a5f5-1ac207dc74cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:10.035471 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.035455    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-envoy" pod "d8c8c11e-594d-444e-a5f5-1ac207dc74cb" (UID: "d8c8c11e-594d-444e-a5f5-1ac207dc74cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:26:10.109982 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.109946    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:10.134469 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.134442    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:10.134469 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.134470    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8cvw\" (UniqueName: \"kubernetes.io/projected/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-kube-api-access-j8cvw\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:10.134628 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.134480    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:10.134628 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.134490    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8c8c11e-594d-444e-a5f5-1ac207dc74cb-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:10.760012 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.759977    4918 generic.go:356] "Generic (PLEG): container finished" podID="d8c8c11e-594d-444e-a5f5-1ac207dc74cb" containerID="52540e6ed4dbb50d7d6cadc6570b72d4f2a46be0d321a15e614fb4cbc47395b3" exitCode=0
Oct 30 22:26:10.760202 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.760027    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"
Oct 30 22:26:10.760202 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.760060    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl" event={"ID":"d8c8c11e-594d-444e-a5f5-1ac207dc74cb","Type":"ContainerDied","Data":"52540e6ed4dbb50d7d6cadc6570b72d4f2a46be0d321a15e614fb4cbc47395b3"}
Oct 30 22:26:10.760202 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.760124    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl" event={"ID":"d8c8c11e-594d-444e-a5f5-1ac207dc74cb","Type":"ContainerDied","Data":"35a8842c68c9535a46d5274c3dab87d3f57310cb7b98c0fbf2c57eddc73cb2a1"}
Oct 30 22:26:10.760202 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.760154    4918 scope.go:122] "RemoveContainer" containerID="52540e6ed4dbb50d7d6cadc6570b72d4f2a46be0d321a15e614fb4cbc47395b3"
Oct 30 22:26:10.770742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.770529    4918 scope.go:122] "RemoveContainer" containerID="52540e6ed4dbb50d7d6cadc6570b72d4f2a46be0d321a15e614fb4cbc47395b3"
Oct 30 22:26:10.770852 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:26:10.770828    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52540e6ed4dbb50d7d6cadc6570b72d4f2a46be0d321a15e614fb4cbc47395b3\": container with ID starting with 52540e6ed4dbb50d7d6cadc6570b72d4f2a46be0d321a15e614fb4cbc47395b3 not found: ID does not exist" containerID="52540e6ed4dbb50d7d6cadc6570b72d4f2a46be0d321a15e614fb4cbc47395b3"
Oct 30 22:26:10.770891 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.770865    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52540e6ed4dbb50d7d6cadc6570b72d4f2a46be0d321a15e614fb4cbc47395b3"} err="failed to get container status \"52540e6ed4dbb50d7d6cadc6570b72d4f2a46be0d321a15e614fb4cbc47395b3\": rpc error: code = NotFound desc = could not find container \"52540e6ed4dbb50d7d6cadc6570b72d4f2a46be0d321a15e614fb4cbc47395b3\": container with ID starting with 52540e6ed4dbb50d7d6cadc6570b72d4f2a46be0d321a15e614fb4cbc47395b3 not found: ID does not exist"
Oct 30 22:26:10.925423 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.925387    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"]
Oct 30 22:26:10.974576 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:10.974541    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-bf7cbf-openshift-default-854dc59b99-9j8pl"]
Oct 30 22:26:12.072517 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:12.072486    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d8c8c11e-594d-444e-a5f5-1ac207dc74cb" path="/var/lib/kubelet/pods/d8c8c11e-594d-444e-a5f5-1ac207dc74cb/volumes"
Oct 30 22:26:12.778559 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:12.778520    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:14.350189 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:14.350151    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:14.643113 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:14.643079    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:14.922170 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:14.922094    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:15.263060 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:15.262987    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:16.027292 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:16.027254    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:16.423818 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:16.423785    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:18.206868 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:18.206832    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:18.507777 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:18.507700    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:19.248068 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:19.248020    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:19.776174 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:19.776145    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:20.214353 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:20.214259    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:21.568821 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:21.568787    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:21.838085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:21.838004    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:22.108450 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:22.108372    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:22.374392 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:22.374311    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:23.671910 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:23.671876    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:23.951391 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:23.951307    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:24.952487 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:24.952429    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:25.212033 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:25.211921    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:26.255857 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:26.255822    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:26.517902 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:26.517812    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:27.466101 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:27.466065    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:29.057390 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:29.057357    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:30.273346 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:30.273309    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:31.771536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:31.771490    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:32.158839 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:26:32.158806    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:26:32.357409 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:32.357365    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:32.974646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:32.974599    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:33.272545 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:33.272460    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:33.528454 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:33.528376    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:33.779114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:33.779025    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:34.667972 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:34.667938    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"]
Oct 30 22:26:34.668462 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:34.668204    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg" podUID="259f9e64-cfca-4654-bea7-772b31f7021d" containerName="maas-api" containerID="cri-o://9c9affeb99fc8e2a3eae3aeb54b54d654862a4ce9ed72574891b39f691031a24" gracePeriod=30
Oct 30 22:26:34.877474 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:34.877442    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:34.943047 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:34.942704    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:26:34.995580 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:34.995549    4918 generic.go:356] "Generic (PLEG): container finished" podID="259f9e64-cfca-4654-bea7-772b31f7021d" containerID="9c9affeb99fc8e2a3eae3aeb54b54d654862a4ce9ed72574891b39f691031a24" exitCode=0
Oct 30 22:26:34.995828 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:34.995659    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"
Oct 30 22:26:34.995828 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:34.995699    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg" event={"ID":"259f9e64-cfca-4654-bea7-772b31f7021d","Type":"ContainerDied","Data":"9c9affeb99fc8e2a3eae3aeb54b54d654862a4ce9ed72574891b39f691031a24"}
Oct 30 22:26:34.995828 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:34.995763    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg" event={"ID":"259f9e64-cfca-4654-bea7-772b31f7021d","Type":"ContainerDied","Data":"3342c765ffb3240971f94b1f23d35f4c4e637da2f110a85698d81b7e6dd3d0e5"}
Oct 30 22:26:34.995828 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:34.995795    4918 scope.go:122] "RemoveContainer" containerID="9c9affeb99fc8e2a3eae3aeb54b54d654862a4ce9ed72574891b39f691031a24"
Oct 30 22:26:35.005431 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:35.005410    4918 scope.go:122] "RemoveContainer" containerID="9c9affeb99fc8e2a3eae3aeb54b54d654862a4ce9ed72574891b39f691031a24"
Oct 30 22:26:35.005727 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:26:35.005708    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c9affeb99fc8e2a3eae3aeb54b54d654862a4ce9ed72574891b39f691031a24\": container with ID starting with 9c9affeb99fc8e2a3eae3aeb54b54d654862a4ce9ed72574891b39f691031a24 not found: ID does not exist" containerID="9c9affeb99fc8e2a3eae3aeb54b54d654862a4ce9ed72574891b39f691031a24"
Oct 30 22:26:35.005843 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:35.005737    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c9affeb99fc8e2a3eae3aeb54b54d654862a4ce9ed72574891b39f691031a24"} err="failed to get container status \"9c9affeb99fc8e2a3eae3aeb54b54d654862a4ce9ed72574891b39f691031a24\": rpc error: code = NotFound desc = could not find container \"9c9affeb99fc8e2a3eae3aeb54b54d654862a4ce9ed72574891b39f691031a24\": container with ID starting with 9c9affeb99fc8e2a3eae3aeb54b54d654862a4ce9ed72574891b39f691031a24 not found: ID does not exist"
Oct 30 22:26:35.059146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:35.059089    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/259f9e64-cfca-4654-bea7-772b31f7021d-kube-api-access-gkrlr\" (UniqueName: \"kubernetes.io/projected/259f9e64-cfca-4654-bea7-772b31f7021d-kube-api-access-gkrlr\") pod \"259f9e64-cfca-4654-bea7-772b31f7021d\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") "
Oct 30 22:26:35.062322 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:35.062292    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-metrics-certs\") pod \"259f9e64-cfca-4654-bea7-772b31f7021d\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") "
Oct 30 22:26:35.062565 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:35.062526    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/259f9e64-cfca-4654-bea7-772b31f7021d-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/259f9e64-cfca-4654-bea7-772b31f7021d-openshift-service-ca\") pod \"259f9e64-cfca-4654-bea7-772b31f7021d\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") "
Oct 30 22:26:35.062814 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:35.062794    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-maas-api-tls\") pod \"259f9e64-cfca-4654-bea7-772b31f7021d\" (UID: \"259f9e64-cfca-4654-bea7-772b31f7021d\") "
Oct 30 22:26:35.065284 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:35.065259    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/259f9e64-cfca-4654-bea7-772b31f7021d-openshift-service-ca" pod "259f9e64-cfca-4654-bea7-772b31f7021d" (UID: "259f9e64-cfca-4654-bea7-772b31f7021d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:35.069035 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:35.068979    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-metrics-certs" pod "259f9e64-cfca-4654-bea7-772b31f7021d" (UID: "259f9e64-cfca-4654-bea7-772b31f7021d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:26:35.073356 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:35.073326    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/259f9e64-cfca-4654-bea7-772b31f7021d-kube-api-access-gkrlr" pod "259f9e64-cfca-4654-bea7-772b31f7021d" (UID: "259f9e64-cfca-4654-bea7-772b31f7021d"). InnerVolumeSpecName "kube-api-access-gkrlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:35.075236 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:35.075215    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-maas-api-tls" pod "259f9e64-cfca-4654-bea7-772b31f7021d" (UID: "259f9e64-cfca-4654-bea7-772b31f7021d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:26:35.165670 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:35.165634    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkrlr\" (UniqueName: \"kubernetes.io/projected/259f9e64-cfca-4654-bea7-772b31f7021d-kube-api-access-gkrlr\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:35.165670 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:35.165666    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:35.165879 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:35.165709    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/259f9e64-cfca-4654-bea7-772b31f7021d-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:35.165879 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:35.165724    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/259f9e64-cfca-4654-bea7-772b31f7021d-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:35.416279 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:35.416238    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"]
Oct 30 22:26:35.418732 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:35.418663    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-67657a-697bd4cf68-x86dg"]
Oct 30 22:26:36.073405 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:36.073371    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="259f9e64-cfca-4654-bea7-772b31f7021d" path="/var/lib/kubelet/pods/259f9e64-cfca-4654-bea7-772b31f7021d/volumes"
Oct 30 22:26:36.785237 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:36.785204    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:38.071046 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:38.071002    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:38.324626 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:38.324533    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:41.371388 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.371345    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:41.393785 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.389422    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"]
Oct 30 22:26:41.393785 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.390159    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8" podUID="09941908-8213-44f4-be72-a5bfe5317ed5" containerName="maas-api" containerID="cri-o://f37435000ee60a8031d7856e9b0932bdd811f93d5969e7a72d8de8af871291fb" gracePeriod=30
Oct 30 22:26:41.715359 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.715334    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 22:26:41.799744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.799710    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:41.838160 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.838130    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-maas-api-tls\") pod \"09941908-8213-44f4-be72-a5bfe5317ed5\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") "
Oct 30 22:26:41.838337 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.838268    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-metrics-certs\") pod \"09941908-8213-44f4-be72-a5bfe5317ed5\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") "
Oct 30 22:26:41.838337 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.838308    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09941908-8213-44f4-be72-a5bfe5317ed5-kube-api-access-cngls\" (UniqueName: \"kubernetes.io/projected/09941908-8213-44f4-be72-a5bfe5317ed5-kube-api-access-cngls\") pod \"09941908-8213-44f4-be72-a5bfe5317ed5\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") "
Oct 30 22:26:41.838411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.838366    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/09941908-8213-44f4-be72-a5bfe5317ed5-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09941908-8213-44f4-be72-a5bfe5317ed5-openshift-service-ca\") pod \"09941908-8213-44f4-be72-a5bfe5317ed5\" (UID: \"09941908-8213-44f4-be72-a5bfe5317ed5\") "
Oct 30 22:26:41.838973 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.838889    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09941908-8213-44f4-be72-a5bfe5317ed5-openshift-service-ca" pod "09941908-8213-44f4-be72-a5bfe5317ed5" (UID: "09941908-8213-44f4-be72-a5bfe5317ed5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:26:41.840500 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.840480    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-maas-api-tls" pod "09941908-8213-44f4-be72-a5bfe5317ed5" (UID: "09941908-8213-44f4-be72-a5bfe5317ed5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:26:41.840746 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.840726    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09941908-8213-44f4-be72-a5bfe5317ed5-kube-api-access-cngls" pod "09941908-8213-44f4-be72-a5bfe5317ed5" (UID: "09941908-8213-44f4-be72-a5bfe5317ed5"). InnerVolumeSpecName "kube-api-access-cngls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:26:41.841008 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.840981    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-metrics-certs" pod "09941908-8213-44f4-be72-a5bfe5317ed5" (UID: "09941908-8213-44f4-be72-a5bfe5317ed5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:26:41.939640 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.939571    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:41.939640 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.939596    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cngls\" (UniqueName: \"kubernetes.io/projected/09941908-8213-44f4-be72-a5bfe5317ed5-kube-api-access-cngls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:41.939640 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.939607    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09941908-8213-44f4-be72-a5bfe5317ed5-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:41.939640 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:41.939618    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09941908-8213-44f4-be72-a5bfe5317ed5-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:26:42.046673 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:42.046635    4918 generic.go:356] "Generic (PLEG): container finished" podID="09941908-8213-44f4-be72-a5bfe5317ed5" containerID="f37435000ee60a8031d7856e9b0932bdd811f93d5969e7a72d8de8af871291fb" exitCode=0
Oct 30 22:26:42.046868 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:42.046727    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"
Oct 30 22:26:42.046868 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:42.046761    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8" event={"ID":"09941908-8213-44f4-be72-a5bfe5317ed5","Type":"ContainerDied","Data":"f37435000ee60a8031d7856e9b0932bdd811f93d5969e7a72d8de8af871291fb"}
Oct 30 22:26:42.046868 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:42.046819    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8" event={"ID":"09941908-8213-44f4-be72-a5bfe5317ed5","Type":"ContainerDied","Data":"e80f193aa4ab79f494d1596537d6ea39b465f030cc1bd1bd8c074da507316c37"}
Oct 30 22:26:42.046868 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:42.046841    4918 scope.go:122] "RemoveContainer" containerID="f37435000ee60a8031d7856e9b0932bdd811f93d5969e7a72d8de8af871291fb"
Oct 30 22:26:42.057341 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:42.057322    4918 scope.go:122] "RemoveContainer" containerID="f37435000ee60a8031d7856e9b0932bdd811f93d5969e7a72d8de8af871291fb"
Oct 30 22:26:42.057607 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:26:42.057586    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f37435000ee60a8031d7856e9b0932bdd811f93d5969e7a72d8de8af871291fb\": container with ID starting with f37435000ee60a8031d7856e9b0932bdd811f93d5969e7a72d8de8af871291fb not found: ID does not exist" containerID="f37435000ee60a8031d7856e9b0932bdd811f93d5969e7a72d8de8af871291fb"
Oct 30 22:26:42.057662 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:42.057617    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37435000ee60a8031d7856e9b0932bdd811f93d5969e7a72d8de8af871291fb"} err="failed to get container status \"f37435000ee60a8031d7856e9b0932bdd811f93d5969e7a72d8de8af871291fb\": rpc error: code = NotFound desc = could not find container \"f37435000ee60a8031d7856e9b0932bdd811f93d5969e7a72d8de8af871291fb\": container with ID starting with f37435000ee60a8031d7856e9b0932bdd811f93d5969e7a72d8de8af871291fb not found: ID does not exist"
Oct 30 22:26:42.214465 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:42.214397    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"]
Oct 30 22:26:42.224438 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:42.224410    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-a7b06b-5b67d9c7b6-n4xn8"]
Oct 30 22:26:43.302415 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:43.302379    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:43.679675 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:43.679644    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:43.978938 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:43.978847    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:44.073190 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:44.073160    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="09941908-8213-44f4-be72-a5bfe5317ed5" path="/var/lib/kubelet/pods/09941908-8213-44f4-be72-a5bfe5317ed5/volumes"
Oct 30 22:26:44.348784 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:44.348697    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:46.400569 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:46.400529    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:46.680624 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:46.680543    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:48.836089 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:48.836045    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:50.106741 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:50.106636    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:50.442355 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:50.442317    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:50.759406 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:50.759332    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:51.162741 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:51.160715    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:51.430708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:51.430602    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:51.687195 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:51.687102    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:54.065379 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:54.065327    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:55.357720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:55.356657    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:55.666367 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:55.666335    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:58.600400 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:58.600363    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:58.858306 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:58.858216    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:59.598018 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:26:59.597985    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:02.157823 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:27:02.157737    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:27:04.563449 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:04.563411    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:05.348217 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:05.348183    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:06.469874 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:06.469837    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:06.792886 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:06.792801    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:09.416096 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:09.416047    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:14.330392 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:14.330354    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:15.709624 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:15.709590    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:16.000133 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:16.000059    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:18.426347 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:18.426316    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"]
Oct 30 22:27:18.426844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:18.426587    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk" podUID="f6a9898d-8632-43e1-ba70-78e4f9efb462" containerName="maas-api" containerID="cri-o://c4208c0e00399a5e64ef5004be3abc1dde8c81b091e7b56a4f245af9d9ac3df1" gracePeriod=30
Oct 30 22:27:18.642837 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:18.642595    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:18.714528 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:18.714505    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 22:27:18.779164 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:18.779137    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-metrics-certs\") pod \"f6a9898d-8632-43e1-ba70-78e4f9efb462\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") "
Oct 30 22:27:18.779289 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:18.779246    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f6a9898d-8632-43e1-ba70-78e4f9efb462-kube-api-access-xfnj9\" (UniqueName: \"kubernetes.io/projected/f6a9898d-8632-43e1-ba70-78e4f9efb462-kube-api-access-xfnj9\") pod \"f6a9898d-8632-43e1-ba70-78e4f9efb462\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") "
Oct 30 22:27:18.779289 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:18.779273    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f6a9898d-8632-43e1-ba70-78e4f9efb462-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a9898d-8632-43e1-ba70-78e4f9efb462-openshift-service-ca\") pod \"f6a9898d-8632-43e1-ba70-78e4f9efb462\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") "
Oct 30 22:27:18.779458 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:18.779435    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-maas-api-tls\") pod \"f6a9898d-8632-43e1-ba70-78e4f9efb462\" (UID: \"f6a9898d-8632-43e1-ba70-78e4f9efb462\") "
Oct 30 22:27:18.779611 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:18.779591    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6a9898d-8632-43e1-ba70-78e4f9efb462-openshift-service-ca" pod "f6a9898d-8632-43e1-ba70-78e4f9efb462" (UID: "f6a9898d-8632-43e1-ba70-78e4f9efb462"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:27:18.780110 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:18.780089    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a9898d-8632-43e1-ba70-78e4f9efb462-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:18.781461 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:18.781442    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-metrics-certs" pod "f6a9898d-8632-43e1-ba70-78e4f9efb462" (UID: "f6a9898d-8632-43e1-ba70-78e4f9efb462"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:27:18.781538 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:18.781493    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a9898d-8632-43e1-ba70-78e4f9efb462-kube-api-access-xfnj9" pod "f6a9898d-8632-43e1-ba70-78e4f9efb462" (UID: "f6a9898d-8632-43e1-ba70-78e4f9efb462"). InnerVolumeSpecName "kube-api-access-xfnj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:27:18.781611 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:18.781585    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-maas-api-tls" pod "f6a9898d-8632-43e1-ba70-78e4f9efb462" (UID: "f6a9898d-8632-43e1-ba70-78e4f9efb462"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:27:18.881617 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:18.881581    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:18.881617 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:18.881610    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfnj9\" (UniqueName: \"kubernetes.io/projected/f6a9898d-8632-43e1-ba70-78e4f9efb462-kube-api-access-xfnj9\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:18.881617 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:18.881621    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6a9898d-8632-43e1-ba70-78e4f9efb462-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:27:19.291812 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:19.291776    4918 generic.go:356] "Generic (PLEG): container finished" podID="f6a9898d-8632-43e1-ba70-78e4f9efb462" containerID="c4208c0e00399a5e64ef5004be3abc1dde8c81b091e7b56a4f245af9d9ac3df1" exitCode=0
Oct 30 22:27:19.292017 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:19.291826    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"
Oct 30 22:27:19.292017 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:19.291870    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk" event={"ID":"f6a9898d-8632-43e1-ba70-78e4f9efb462","Type":"ContainerDied","Data":"c4208c0e00399a5e64ef5004be3abc1dde8c81b091e7b56a4f245af9d9ac3df1"}
Oct 30 22:27:19.292017 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:19.291925    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk" event={"ID":"f6a9898d-8632-43e1-ba70-78e4f9efb462","Type":"ContainerDied","Data":"e3cbfbfdee7bdf80279e2de07427c6437284c8906170f4c2c3bd76aef0bcaddd"}
Oct 30 22:27:19.292017 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:19.291957    4918 scope.go:122] "RemoveContainer" containerID="c4208c0e00399a5e64ef5004be3abc1dde8c81b091e7b56a4f245af9d9ac3df1"
Oct 30 22:27:19.305251 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:19.305227    4918 scope.go:122] "RemoveContainer" containerID="c4208c0e00399a5e64ef5004be3abc1dde8c81b091e7b56a4f245af9d9ac3df1"
Oct 30 22:27:19.305599 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:27:19.305575    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4208c0e00399a5e64ef5004be3abc1dde8c81b091e7b56a4f245af9d9ac3df1\": container with ID starting with c4208c0e00399a5e64ef5004be3abc1dde8c81b091e7b56a4f245af9d9ac3df1 not found: ID does not exist" containerID="c4208c0e00399a5e64ef5004be3abc1dde8c81b091e7b56a4f245af9d9ac3df1"
Oct 30 22:27:19.306063 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:19.305607    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4208c0e00399a5e64ef5004be3abc1dde8c81b091e7b56a4f245af9d9ac3df1"} err="failed to get container status \"c4208c0e00399a5e64ef5004be3abc1dde8c81b091e7b56a4f245af9d9ac3df1\": rpc error: code = NotFound desc = could not find container \"c4208c0e00399a5e64ef5004be3abc1dde8c81b091e7b56a4f245af9d9ac3df1\": container with ID starting with c4208c0e00399a5e64ef5004be3abc1dde8c81b091e7b56a4f245af9d9ac3df1 not found: ID does not exist"
Oct 30 22:27:19.457133 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:19.457102    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"]
Oct 30 22:27:19.506512 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:19.506479    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-cef074-ddc4599f9-26swk"]
Oct 30 22:27:20.072697 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:20.072653    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f6a9898d-8632-43e1-ba70-78e4f9efb462" path="/var/lib/kubelet/pods/f6a9898d-8632-43e1-ba70-78e4f9efb462/volumes"
Oct 30 22:27:20.167470 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:20.167438    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:20.469292 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:20.469251    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:21.070180 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.070148    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:21.198394 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198364    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"]
Oct 30 22:27:21.198863 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198850    4918 cpu_manager.go:414] "containerMap: removing container" podUID="f6a9898d-8632-43e1-ba70-78e4f9efb462" containerName="maas-api"
Oct 30 22:27:21.198915 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198863    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f6a9898d-8632-43e1-ba70-78e4f9efb462" containerName="maas-api"
Oct 30 22:27:21.198915 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198876    4918 cpu_manager.go:414] "containerMap: removing container" podUID="3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" containerName="istio-proxy"
Oct 30 22:27:21.198915 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198882    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" containerName="istio-proxy"
Oct 30 22:27:21.198915 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198892    4918 cpu_manager.go:414] "containerMap: removing container" podUID="e184fc8f-c462-4f29-bbf0-46ab63033f13" containerName="istio-proxy"
Oct 30 22:27:21.198915 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198897    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e184fc8f-c462-4f29-bbf0-46ab63033f13" containerName="istio-proxy"
Oct 30 22:27:21.198915 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198903    4918 cpu_manager.go:414] "containerMap: removing container" podUID="dc87536c-72a7-4afb-9a5b-28d69ef186ab" containerName="istio-proxy"
Oct 30 22:27:21.198915 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198907    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dc87536c-72a7-4afb-9a5b-28d69ef186ab" containerName="istio-proxy"
Oct 30 22:27:21.198915 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198915    4918 cpu_manager.go:414] "containerMap: removing container" podUID="259f9e64-cfca-4654-bea7-772b31f7021d" containerName="maas-api"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198920    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="259f9e64-cfca-4654-bea7-772b31f7021d" containerName="maas-api"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198927    4918 cpu_manager.go:414] "containerMap: removing container" podUID="612f3d2b-2897-489a-bb3e-0dc4b00f49e4" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198932    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="612f3d2b-2897-489a-bb3e-0dc4b00f49e4" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198940    4918 cpu_manager.go:414] "containerMap: removing container" podUID="b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198944    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198955    4918 cpu_manager.go:414] "containerMap: removing container" podUID="2f4c3406-75c9-4871-b92f-15676af6e5d7" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198959    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f4c3406-75c9-4871-b92f-15676af6e5d7" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198972    4918 cpu_manager.go:414] "containerMap: removing container" podUID="6ab4caf4-843c-46ef-a936-a8eb42f5053f" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198977    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ab4caf4-843c-46ef-a936-a8eb42f5053f" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198989    4918 cpu_manager.go:414] "containerMap: removing container" podUID="d8c8c11e-594d-444e-a5f5-1ac207dc74cb" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.198994    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d8c8c11e-594d-444e-a5f5-1ac207dc74cb" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.199002    4918 cpu_manager.go:414] "containerMap: removing container" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.199005    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.199023    4918 cpu_manager.go:414] "containerMap: removing container" podUID="09941908-8213-44f4-be72-a5bfe5317ed5" containerName="maas-api"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.199027    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="09941908-8213-44f4-be72-a5bfe5317ed5" containerName="maas-api"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.199100    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="09941908-8213-44f4-be72-a5bfe5317ed5" containerName="maas-api"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.199109    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="f6a9898d-8632-43e1-ba70-78e4f9efb462" containerName="maas-api"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.199114    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="3aed0330-8b15-4d4b-ade5-ae5c7a4877e8" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.199122    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="dc87536c-72a7-4afb-9a5b-28d69ef186ab" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.199128    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="259f9e64-cfca-4654-bea7-772b31f7021d" containerName="maas-api"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.199134    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="b6202640-b4eb-49b4-a93d-ef4b2d7e8d4f" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.199140    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="6ab4caf4-843c-46ef-a936-a8eb42f5053f" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.199147    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="d8c8c11e-594d-444e-a5f5-1ac207dc74cb" containerName="istio-proxy"
Oct 30 22:27:21.199156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.199153    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="28475ffd-de42-4a6a-a116-25e940739ffb" containerName="istio-proxy"
Oct 30 22:27:21.202482 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.202462    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:21.254195 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.254165    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-87b6b3-serving-cert\""
Oct 30 22:27:21.306218 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.306178    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"]
Oct 30 22:27:21.309177 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.309156    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/131996b0-d9f3-4da0-86a7-c998ebd3407f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:21.309299 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.309186    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-metrics-certs\") pod \"maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:21.309299 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.309285    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhv78\" (UniqueName: \"kubernetes.io/projected/131996b0-d9f3-4da0-86a7-c998ebd3407f-kube-api-access-fhv78\") pod \"maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:21.309376 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.309314    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-maas-api-tls\") pod \"maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:21.342706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.342602    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:21.410255 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.410227    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhv78\" (UniqueName: \"kubernetes.io/projected/131996b0-d9f3-4da0-86a7-c998ebd3407f-kube-api-access-fhv78\") pod \"maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:21.410434 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.410269    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-maas-api-tls\") pod \"maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:21.410504 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:27:21.410429    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-serving-cert: secret "maas-api-e2e-inf-a-87b6b3-serving-cert" not found
Oct 30 22:27:21.410504 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.410468    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/131996b0-d9f3-4da0-86a7-c998ebd3407f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:21.410504 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:27:21.410501    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-maas-api-tls podName:131996b0-d9f3-4da0-86a7-c998ebd3407f nodeName:}" failed. No retries permitted until 2026-10-30 22:27:21.910485086 +0000 UTC m=+2579.959092792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-maas-api-tls") pod "maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v" (UID: "131996b0-d9f3-4da0-86a7-c998ebd3407f") : secret "maas-api-e2e-inf-a-87b6b3-serving-cert" not found
Oct 30 22:27:21.410670 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.410520    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-metrics-certs\") pod \"maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:21.411138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.411115    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/131996b0-d9f3-4da0-86a7-c998ebd3407f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:21.413140 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.413121    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-metrics-certs\") pod \"maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:21.474628 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.474585    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhv78\" (UniqueName: \"kubernetes.io/projected/131996b0-d9f3-4da0-86a7-c998ebd3407f-kube-api-access-fhv78\") pod \"maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:21.588287 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.588249    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:21.821160 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.821120    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:21.915928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.915895    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-maas-api-tls\") pod \"maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:21.918519 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:21.918494    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-maas-api-tls\") pod \"maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:22.115521 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:22.115455    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:22.400494 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:22.400459    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:22.492867 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:22.492846    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"]
Oct 30 22:27:22.495405 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:27:22.495377    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131996b0_d9f3_4da0_86a7_c998ebd3407f.slice/crio-f0e696196ff41b8e61ff811adc7585afb64d1d621a5ab12b8ccc20a9ea979a38 WatchSource:0}: Error finding container f0e696196ff41b8e61ff811adc7585afb64d1d621a5ab12b8ccc20a9ea979a38: Status 404 returned error can't find the container with id f0e696196ff41b8e61ff811adc7585afb64d1d621a5ab12b8ccc20a9ea979a38
Oct 30 22:27:23.326751 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:23.326721    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v" event={"ID":"131996b0-d9f3-4da0-86a7-c998ebd3407f","Type":"ContainerStarted","Data":"f0e696196ff41b8e61ff811adc7585afb64d1d621a5ab12b8ccc20a9ea979a38"}
Oct 30 22:27:24.334930 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:24.334894    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v" event={"ID":"131996b0-d9f3-4da0-86a7-c998ebd3407f","Type":"ContainerStarted","Data":"ab026f83c78e966814cb7e3cdabd1d182bb5f251dff31aa1e356ac4eb325848c"}
Oct 30 22:27:24.335359 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:24.334970    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:24.452637 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:24.452591    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v" podStartSLOduration=2.5533762209999997 podStartE2EDuration="3.45257813s" totalImagesPullingTime="899.201909ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:27:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:27:24.450813781 +0000 UTC m=+2582.499421477" watchObservedRunningTime="2026-10-30 22:27:24.45257813 +0000 UTC m=+2582.501185847"
Oct 30 22:27:27.014838 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:27.014791    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:27.455074 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:27.455041    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:27.747528 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:27.747436    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:27.990455 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:27.990421    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:29.152271 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:29.152231    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:29.452928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:29.452841    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:30.345467 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:30.345428    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:27:31.905220 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:31.905166    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:32.157536 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:27:32.157455    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:27:36.730204 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:36.730170    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:39.468704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:39.468471    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:40.017212 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:40.017180    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:41.673571 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:41.673534    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"]
Oct 30 22:27:41.679024 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:41.679003    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:41.713091 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:41.713064    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-metrics-certs\") pod \"maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:41.713212 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:41.713097    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h9bt\" (UniqueName: \"kubernetes.io/projected/40d4d570-e10e-4be3-955f-36e0e1872fd3-kube-api-access-5h9bt\") pod \"maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:41.713212 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:41.713118    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40d4d570-e10e-4be3-955f-36e0e1872fd3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:41.713334 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:41.713285    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-maas-api-tls\") pod \"maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:41.734166 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:41.734140    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-32dd8d-serving-cert\""
Oct 30 22:27:41.737183 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:41.737161    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"]
Oct 30 22:27:41.814349 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:41.814320    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-maas-api-tls\") pod \"maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:41.814518 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:27:41.814479    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-serving-cert: secret "maas-api-e2e-inf-b-32dd8d-serving-cert" not found
Oct 30 22:27:41.814601 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:41.814481    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-metrics-certs\") pod \"maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:41.814601 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:27:41.814547    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-maas-api-tls podName:40d4d570-e10e-4be3-955f-36e0e1872fd3 nodeName:}" failed. No retries permitted until 2026-10-30 22:27:42.314526451 +0000 UTC m=+2600.363134168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-maas-api-tls") pod "maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g" (UID: "40d4d570-e10e-4be3-955f-36e0e1872fd3") : secret "maas-api-e2e-inf-b-32dd8d-serving-cert" not found
Oct 30 22:27:41.814760 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:41.814600    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h9bt\" (UniqueName: \"kubernetes.io/projected/40d4d570-e10e-4be3-955f-36e0e1872fd3-kube-api-access-5h9bt\") pod \"maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:41.814760 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:41.814632    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40d4d570-e10e-4be3-955f-36e0e1872fd3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:41.815838 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:41.815812    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40d4d570-e10e-4be3-955f-36e0e1872fd3-openshift-service-ca\") pod \"maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:41.817212 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:41.817191    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-metrics-certs\") pod \"maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:41.875568 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:41.875530    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h9bt\" (UniqueName: \"kubernetes.io/projected/40d4d570-e10e-4be3-955f-36e0e1872fd3-kube-api-access-5h9bt\") pod \"maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:41.957059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:41.956976    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:42.211466 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:42.211372    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:42.319132 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:42.319105    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-maas-api-tls\") pod \"maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:42.321670 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:42.321646    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-maas-api-tls\") pod \"maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:42.449121 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:42.449086    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:42.592346 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:42.592277    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:42.971394 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:42.971361    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"]
Oct 30 22:27:42.972582 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:27:42.972553    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d4d570_e10e_4be3_955f_36e0e1872fd3.slice/crio-8396b9683e351f5d1354baa0cf3b9330f510a5b470c035e06199fdbc2b3ed731 WatchSource:0}: Error finding container 8396b9683e351f5d1354baa0cf3b9330f510a5b470c035e06199fdbc2b3ed731: Status 404 returned error can't find the container with id 8396b9683e351f5d1354baa0cf3b9330f510a5b470c035e06199fdbc2b3ed731
Oct 30 22:27:43.454627 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:43.454587    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g" event={"ID":"40d4d570-e10e-4be3-955f-36e0e1872fd3","Type":"ContainerStarted","Data":"8396b9683e351f5d1354baa0cf3b9330f510a5b470c035e06199fdbc2b3ed731"}
Oct 30 22:27:44.461167 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:44.461129    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g" event={"ID":"40d4d570-e10e-4be3-955f-36e0e1872fd3","Type":"ContainerStarted","Data":"c10f815858ba7a072275d097ea36506d6a548d071b092700c52c9b33b05e955b"}
Oct 30 22:27:44.461590 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:44.461232    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:44.866428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:44.866336    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g" podStartSLOduration=2.889775056 podStartE2EDuration="3.86632128s" totalImagesPullingTime="976.546224ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:27:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:27:44.594145182 +0000 UTC m=+2602.642752882" watchObservedRunningTime="2026-10-30 22:27:44.86632128 +0000 UTC m=+2602.914928975"
Oct 30 22:27:44.868117 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:44.868098    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"]
Oct 30 22:27:44.876055 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:44.876028    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"]
Oct 30 22:27:45.126783 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:45.126692    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:47.247032 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:47.246999    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:47.500433 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:47.500346    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:50.472495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:50.472461    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:27:51.381645 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:51.381614    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:51.667634 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:51.667602    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:52.462571 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:52.462527    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:52.711521 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:52.711488    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:57.381366 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:57.381331    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"]
Oct 30 22:27:57.430944 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:57.430909    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"]
Oct 30 22:27:57.434308 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:57.434271    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"]
Oct 30 22:27:57.632104 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:57.632004    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:57.931167 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:57.931138    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:59.903137 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:59.903100    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" containerID="cri-o://1a474d1fe97424828cc2b112e4b93b9265eff440ff24abbf5d7eba619436e043" gracePeriod=45
Oct 30 22:27:59.903676 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:27:59.903102    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" containerID="cri-o://0cd489288f2d3e274444e4be69083032f4edc7625fe869443bad1565f8411fde" gracePeriod=45
Oct 30 22:28:00.183478 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.183445    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:28:00.187810 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.187786    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:28:00.326368 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.326333    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-tmp-dir\") pod \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") "
Oct 30 22:28:00.326533 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.326464    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-tmp-dir\") pod \"1ac33b11-35d1-4f1c-b225-4b2db946df73\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") "
Oct 30 22:28:00.326533 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.326516    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-model-cache\") pod \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") "
Oct 30 22:28:00.326639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.326573    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-dshm\") pod \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") "
Oct 30 22:28:00.326639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.326583    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-tmp-dir" pod "8a80dc71-49e6-42ad-b090-25bb7bcb324f" (UID: "8a80dc71-49e6-42ad-b090-25bb7bcb324f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:00.326639 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.326625    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ac33b11-35d1-4f1c-b225-4b2db946df73-kube-api-access-wh4h8\" (UniqueName: \"kubernetes.io/projected/1ac33b11-35d1-4f1c-b225-4b2db946df73-kube-api-access-wh4h8\") pod \"1ac33b11-35d1-4f1c-b225-4b2db946df73\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") "
Oct 30 22:28:00.326819 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.326661    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8a80dc71-49e6-42ad-b090-25bb7bcb324f-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a80dc71-49e6-42ad-b090-25bb7bcb324f-tls-certs\") pod \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") "
Oct 30 22:28:00.326819 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.326706    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-home\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-home\") pod \"1ac33b11-35d1-4f1c-b225-4b2db946df73\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") "
Oct 30 22:28:00.326819 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.326747    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ac33b11-35d1-4f1c-b225-4b2db946df73-tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac33b11-35d1-4f1c-b225-4b2db946df73-tls-certs\") pod \"1ac33b11-35d1-4f1c-b225-4b2db946df73\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") "
Oct 30 22:28:00.326968 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.326832    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-tmp-dir" pod "1ac33b11-35d1-4f1c-b225-4b2db946df73" (UID: "1ac33b11-35d1-4f1c-b225-4b2db946df73"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:00.326968 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.326853    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-model-cache" pod "8a80dc71-49e6-42ad-b090-25bb7bcb324f" (UID: "8a80dc71-49e6-42ad-b090-25bb7bcb324f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:00.327088 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.327061    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-model-cache\") pod \"1ac33b11-35d1-4f1c-b225-4b2db946df73\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") "
Oct 30 22:28:00.327670 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.327157    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a80dc71-49e6-42ad-b090-25bb7bcb324f-kube-api-access-8xbkm\" (UniqueName: \"kubernetes.io/projected/8a80dc71-49e6-42ad-b090-25bb7bcb324f-kube-api-access-8xbkm\") pod \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") "
Oct 30 22:28:00.327881 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.327858    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-dshm\") pod \"1ac33b11-35d1-4f1c-b225-4b2db946df73\" (UID: \"1ac33b11-35d1-4f1c-b225-4b2db946df73\") "
Oct 30 22:28:00.328000 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.327985    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-home\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-home\") pod \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\" (UID: \"8a80dc71-49e6-42ad-b090-25bb7bcb324f\") "
Oct 30 22:28:00.328348 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.327208    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-home" pod "1ac33b11-35d1-4f1c-b225-4b2db946df73" (UID: "1ac33b11-35d1-4f1c-b225-4b2db946df73"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:00.328348 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.327352    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-model-cache" pod "1ac33b11-35d1-4f1c-b225-4b2db946df73" (UID: "1ac33b11-35d1-4f1c-b225-4b2db946df73"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:00.328533 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.328511    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-home" pod "8a80dc71-49e6-42ad-b090-25bb7bcb324f" (UID: "8a80dc71-49e6-42ad-b090-25bb7bcb324f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:00.328833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.328722    4918 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-home\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.328833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.328741    4918 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-model-cache\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.328833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.328756    4918 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-home\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.328833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.328793    4918 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-tmp-dir\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.328833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.328807    4918 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-tmp-dir\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.328833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.328822    4918 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-model-cache\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.330087 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.330020    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-dshm" pod "8a80dc71-49e6-42ad-b090-25bb7bcb324f" (UID: "8a80dc71-49e6-42ad-b090-25bb7bcb324f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:00.332017 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.331988    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a80dc71-49e6-42ad-b090-25bb7bcb324f-kube-api-access-8xbkm" pod "8a80dc71-49e6-42ad-b090-25bb7bcb324f" (UID: "8a80dc71-49e6-42ad-b090-25bb7bcb324f"). InnerVolumeSpecName "kube-api-access-8xbkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:28:00.332210 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.332185    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac33b11-35d1-4f1c-b225-4b2db946df73-tls-certs" pod "1ac33b11-35d1-4f1c-b225-4b2db946df73" (UID: "1ac33b11-35d1-4f1c-b225-4b2db946df73"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:28:00.332285 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.332184    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a80dc71-49e6-42ad-b090-25bb7bcb324f-tls-certs" pod "8a80dc71-49e6-42ad-b090-25bb7bcb324f" (UID: "8a80dc71-49e6-42ad-b090-25bb7bcb324f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:28:00.332903 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.332879    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-dshm" pod "1ac33b11-35d1-4f1c-b225-4b2db946df73" (UID: "1ac33b11-35d1-4f1c-b225-4b2db946df73"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:00.333031 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.333012    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ac33b11-35d1-4f1c-b225-4b2db946df73-kube-api-access-wh4h8" pod "1ac33b11-35d1-4f1c-b225-4b2db946df73" (UID: "1ac33b11-35d1-4f1c-b225-4b2db946df73"). InnerVolumeSpecName "kube-api-access-wh4h8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:28:00.430386 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.430305    4918 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a80dc71-49e6-42ad-b090-25bb7bcb324f-dshm\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.430386 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.430348    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh4h8\" (UniqueName: \"kubernetes.io/projected/1ac33b11-35d1-4f1c-b225-4b2db946df73-kube-api-access-wh4h8\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.430386 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.430364    4918 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a80dc71-49e6-42ad-b090-25bb7bcb324f-tls-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.430386 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.430379    4918 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ac33b11-35d1-4f1c-b225-4b2db946df73-tls-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.430676 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.430392    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xbkm\" (UniqueName: \"kubernetes.io/projected/8a80dc71-49e6-42ad-b090-25bb7bcb324f-kube-api-access-8xbkm\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.430676 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.430407    4918 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ac33b11-35d1-4f1c-b225-4b2db946df73-dshm\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:00.564283 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.564249    4918 generic.go:356] "Generic (PLEG): container finished" podID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerID="1a474d1fe97424828cc2b112e4b93b9265eff440ff24abbf5d7eba619436e043" exitCode=0
Oct 30 22:28:00.564472 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.564304    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"
Oct 30 22:28:00.564472 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.564340    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" event={"ID":"8a80dc71-49e6-42ad-b090-25bb7bcb324f","Type":"ContainerDied","Data":"1a474d1fe97424828cc2b112e4b93b9265eff440ff24abbf5d7eba619436e043"}
Oct 30 22:28:00.564472 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.564387    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" event={"ID":"8a80dc71-49e6-42ad-b090-25bb7bcb324f","Type":"ContainerDied","Data":"72d3877f45a9f7e6b790320a86dc5822d1cf81aed1d30bf7e311ceae8f9f6eae"}
Oct 30 22:28:00.564472 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.564410    4918 scope.go:122] "RemoveContainer" containerID="1a474d1fe97424828cc2b112e4b93b9265eff440ff24abbf5d7eba619436e043"
Oct 30 22:28:00.566002 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.565978    4918 generic.go:356] "Generic (PLEG): container finished" podID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerID="0cd489288f2d3e274444e4be69083032f4edc7625fe869443bad1565f8411fde" exitCode=0
Oct 30 22:28:00.566139 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.566019    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"
Oct 30 22:28:00.566139 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.566093    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" event={"ID":"1ac33b11-35d1-4f1c-b225-4b2db946df73","Type":"ContainerDied","Data":"0cd489288f2d3e274444e4be69083032f4edc7625fe869443bad1565f8411fde"}
Oct 30 22:28:00.566139 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.566122    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" event={"ID":"1ac33b11-35d1-4f1c-b225-4b2db946df73","Type":"ContainerDied","Data":"50c0c6f4b9f2b5a6f9093628a9b58c94c740377d8ee92cf8d493b5a8cfb7cd22"}
Oct 30 22:28:00.574780 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.574762    4918 scope.go:122] "RemoveContainer" containerID="1a474d1fe97424828cc2b112e4b93b9265eff440ff24abbf5d7eba619436e043"
Oct 30 22:28:00.575155 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:28:00.575121    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a474d1fe97424828cc2b112e4b93b9265eff440ff24abbf5d7eba619436e043\": container with ID starting with 1a474d1fe97424828cc2b112e4b93b9265eff440ff24abbf5d7eba619436e043 not found: ID does not exist" containerID="1a474d1fe97424828cc2b112e4b93b9265eff440ff24abbf5d7eba619436e043"
Oct 30 22:28:00.575247 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.575163    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a474d1fe97424828cc2b112e4b93b9265eff440ff24abbf5d7eba619436e043"} err="failed to get container status \"1a474d1fe97424828cc2b112e4b93b9265eff440ff24abbf5d7eba619436e043\": rpc error: code = NotFound desc = could not find container \"1a474d1fe97424828cc2b112e4b93b9265eff440ff24abbf5d7eba619436e043\": container with ID starting with 1a474d1fe97424828cc2b112e4b93b9265eff440ff24abbf5d7eba619436e043 not found: ID does not exist"
Oct 30 22:28:00.575247 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.575189    4918 scope.go:122] "RemoveContainer" containerID="0cd489288f2d3e274444e4be69083032f4edc7625fe869443bad1565f8411fde"
Oct 30 22:28:00.584195 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.584177    4918 scope.go:122] "RemoveContainer" containerID="0cd489288f2d3e274444e4be69083032f4edc7625fe869443bad1565f8411fde"
Oct 30 22:28:00.584463 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:28:00.584442    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cd489288f2d3e274444e4be69083032f4edc7625fe869443bad1565f8411fde\": container with ID starting with 0cd489288f2d3e274444e4be69083032f4edc7625fe869443bad1565f8411fde not found: ID does not exist" containerID="0cd489288f2d3e274444e4be69083032f4edc7625fe869443bad1565f8411fde"
Oct 30 22:28:00.584538 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.584469    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cd489288f2d3e274444e4be69083032f4edc7625fe869443bad1565f8411fde"} err="failed to get container status \"0cd489288f2d3e274444e4be69083032f4edc7625fe869443bad1565f8411fde\": rpc error: code = NotFound desc = could not find container \"0cd489288f2d3e274444e4be69083032f4edc7625fe869443bad1565f8411fde\": container with ID starting with 0cd489288f2d3e274444e4be69083032f4edc7625fe869443bad1565f8411fde not found: ID does not exist"
Oct 30 22:28:00.729933 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.729839    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"]
Oct 30 22:28:00.735869 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.735841    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7"]
Oct 30 22:28:00.844569 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.844526    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"]
Oct 30 22:28:00.847392 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:00.847363    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b"]
Oct 30 22:28:01.091349 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:01.091257    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-2-w2-b2f165-kserve-b5b45bf68-d955b" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:28:01.139525 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:01.139483    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b2f165/distinct-w2-b2f165-kserve-86695fb7dc-nffb7" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:28:02.072648 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:02.072610    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" path="/var/lib/kubelet/pods/1ac33b11-35d1-4f1c-b225-4b2db946df73/volumes"
Oct 30 22:28:02.073068 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:02.073054    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" path="/var/lib/kubelet/pods/8a80dc71-49e6-42ad-b090-25bb7bcb324f/volumes"
Oct 30 22:28:02.158335 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:28:02.158296    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:28:03.018805 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:03.018776    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:03.943178 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:03.943144    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:04.231476 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:04.231394    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:08.399350 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:08.399314    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:12.403240 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.403194    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" containerID="cri-o://406da8b09726f77e8ac16a59345145646dd08adf19cbed2147f0173d15377e11" gracePeriod=45
Oct 30 22:28:12.456795 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.456727    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main" containerID="cri-o://4958a28e97af074ce1ef8334f1487e0a16592688fefbdcb28b309e084ba9bba5" gracePeriod=45
Oct 30 22:28:12.457309 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.457228    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" containerID="cri-o://6b1dcde49e1e04725dd4ad5b2d49f8f8b335f2607f7bc01cc4bf792b752af6ed" gracePeriod=45
Oct 30 22:28:12.604676 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.603205    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main" probeResult="failure" output="Get \"https://10.132.0.56:8000/ready\": dial tcp 10.132.0.56:8000: connect: connection refused"
Oct 30 22:28:12.647996 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.647940    4918 generic.go:356] "Generic (PLEG): container finished" podID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerID="406da8b09726f77e8ac16a59345145646dd08adf19cbed2147f0173d15377e11" exitCode=0
Oct 30 22:28:12.648157 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.648045    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" event={"ID":"ce09f1e8-a736-4d77-be12-5f4a45415859","Type":"ContainerDied","Data":"406da8b09726f77e8ac16a59345145646dd08adf19cbed2147f0173d15377e11"}
Oct 30 22:28:12.649858 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.649832    4918 generic.go:356] "Generic (PLEG): container finished" podID="a3ac5821-d19a-470a-acf7-f3c069268120" containerID="6b1dcde49e1e04725dd4ad5b2d49f8f8b335f2607f7bc01cc4bf792b752af6ed" exitCode=0
Oct 30 22:28:12.650030 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.650012    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" event={"ID":"a3ac5821-d19a-470a-acf7-f3c069268120","Type":"ContainerDied","Data":"6b1dcde49e1e04725dd4ad5b2d49f8f8b335f2607f7bc01cc4bf792b752af6ed"}
Oct 30 22:28:12.651674 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.651650    4918 generic.go:356] "Generic (PLEG): container finished" podID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerID="4958a28e97af074ce1ef8334f1487e0a16592688fefbdcb28b309e084ba9bba5" exitCode=0
Oct 30 22:28:12.651790 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.651719    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" event={"ID":"e9b08f22-10ad-497e-bac2-8ff8156131d5","Type":"ContainerDied","Data":"4958a28e97af074ce1ef8334f1487e0a16592688fefbdcb28b309e084ba9bba5"}
Oct 30 22:28:12.791738 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.790110    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:28:12.791738 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.791100    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:28:12.818373 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.818352    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:28:12.899187 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899150    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-tmp-dir\") pod \"a3ac5821-d19a-470a-acf7-f3c069268120\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") "
Oct 30 22:28:12.899373 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899208    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-dshm\") pod \"e9b08f22-10ad-497e-bac2-8ff8156131d5\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") "
Oct 30 22:28:12.899373 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899246    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-tmp-dir\") pod \"e9b08f22-10ad-497e-bac2-8ff8156131d5\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") "
Oct 30 22:28:12.899373 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899277    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-model-cache\") pod \"e9b08f22-10ad-497e-bac2-8ff8156131d5\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") "
Oct 30 22:28:12.899373 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899313    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-dshm\") pod \"a3ac5821-d19a-470a-acf7-f3c069268120\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") "
Oct 30 22:28:12.899373 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899366    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ce09f1e8-a736-4d77-be12-5f4a45415859-tls-certs\" (UniqueName: \"kubernetes.io/secret/ce09f1e8-a736-4d77-be12-5f4a45415859-tls-certs\") pod \"ce09f1e8-a736-4d77-be12-5f4a45415859\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") "
Oct 30 22:28:12.899993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899407    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-home\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-home\") pod \"a3ac5821-d19a-470a-acf7-f3c069268120\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") "
Oct 30 22:28:12.899993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899437    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-model-cache\") pod \"a3ac5821-d19a-470a-acf7-f3c069268120\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") "
Oct 30 22:28:12.899993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899461    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-home\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-home\") pod \"e9b08f22-10ad-497e-bac2-8ff8156131d5\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") "
Oct 30 22:28:12.899993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899489    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9b08f22-10ad-497e-bac2-8ff8156131d5-kube-api-access-rr5mh\" (UniqueName: \"kubernetes.io/projected/e9b08f22-10ad-497e-bac2-8ff8156131d5-kube-api-access-rr5mh\") pod \"e9b08f22-10ad-497e-bac2-8ff8156131d5\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") "
Oct 30 22:28:12.899993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899467    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-tmp-dir" pod "a3ac5821-d19a-470a-acf7-f3c069268120" (UID: "a3ac5821-d19a-470a-acf7-f3c069268120"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:12.899993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899540    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-model-cache" pod "e9b08f22-10ad-497e-bac2-8ff8156131d5" (UID: "e9b08f22-10ad-497e-bac2-8ff8156131d5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:12.899993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899558    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-tmp-dir" pod "e9b08f22-10ad-497e-bac2-8ff8156131d5" (UID: "e9b08f22-10ad-497e-bac2-8ff8156131d5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:12.899993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899569    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-model-cache\") pod \"ce09f1e8-a736-4d77-be12-5f4a45415859\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") "
Oct 30 22:28:12.899993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899628    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a3ac5821-d19a-470a-acf7-f3c069268120-kube-api-access-l8b2t\" (UniqueName: \"kubernetes.io/projected/a3ac5821-d19a-470a-acf7-f3c069268120-kube-api-access-l8b2t\") pod \"a3ac5821-d19a-470a-acf7-f3c069268120\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") "
Oct 30 22:28:12.899993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899753    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-tmp-dir\") pod \"ce09f1e8-a736-4d77-be12-5f4a45415859\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") "
Oct 30 22:28:12.899993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899780    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-home" pod "a3ac5821-d19a-470a-acf7-f3c069268120" (UID: "a3ac5821-d19a-470a-acf7-f3c069268120"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:12.899993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899790    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e9b08f22-10ad-497e-bac2-8ff8156131d5-tls-certs\" (UniqueName: \"kubernetes.io/secret/e9b08f22-10ad-497e-bac2-8ff8156131d5-tls-certs\") pod \"e9b08f22-10ad-497e-bac2-8ff8156131d5\" (UID: \"e9b08f22-10ad-497e-bac2-8ff8156131d5\") "
Oct 30 22:28:12.899993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899836    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-model-cache" pod "ce09f1e8-a736-4d77-be12-5f4a45415859" (UID: "ce09f1e8-a736-4d77-be12-5f4a45415859"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:12.899993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899850    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-home" pod "e9b08f22-10ad-497e-bac2-8ff8156131d5" (UID: "e9b08f22-10ad-497e-bac2-8ff8156131d5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:12.899993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899863    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-dshm\") pod \"ce09f1e8-a736-4d77-be12-5f4a45415859\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") "
Oct 30 22:28:12.899993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.899913    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-home\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-home\") pod \"ce09f1e8-a736-4d77-be12-5f4a45415859\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") "
Oct 30 22:28:12.900875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.900060    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-model-cache" pod "a3ac5821-d19a-470a-acf7-f3c069268120" (UID: "a3ac5821-d19a-470a-acf7-f3c069268120"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:12.900875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.900094    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce09f1e8-a736-4d77-be12-5f4a45415859-kube-api-access-4w8js\" (UniqueName: \"kubernetes.io/projected/ce09f1e8-a736-4d77-be12-5f4a45415859-kube-api-access-4w8js\") pod \"ce09f1e8-a736-4d77-be12-5f4a45415859\" (UID: \"ce09f1e8-a736-4d77-be12-5f4a45415859\") "
Oct 30 22:28:12.900875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.900129    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a3ac5821-d19a-470a-acf7-f3c069268120-tls-certs\" (UniqueName: \"kubernetes.io/secret/a3ac5821-d19a-470a-acf7-f3c069268120-tls-certs\") pod \"a3ac5821-d19a-470a-acf7-f3c069268120\" (UID: \"a3ac5821-d19a-470a-acf7-f3c069268120\") "
Oct 30 22:28:12.900875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.900266    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-tmp-dir" pod "ce09f1e8-a736-4d77-be12-5f4a45415859" (UID: "ce09f1e8-a736-4d77-be12-5f4a45415859"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:12.900875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.900431    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-home" pod "ce09f1e8-a736-4d77-be12-5f4a45415859" (UID: "ce09f1e8-a736-4d77-be12-5f4a45415859"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:12.900875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.900710    4918 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-tmp-dir\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:12.900875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.900735    4918 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-tmp-dir\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:12.900875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.900749    4918 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-model-cache\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:12.900875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.900763    4918 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-home\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:12.900875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.900776    4918 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-model-cache\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:12.900875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.900791    4918 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-home\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:12.900875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.900806    4918 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-model-cache\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:12.900875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.900819    4918 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-tmp-dir\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:12.900875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.900832    4918 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-home\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:12.902766 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.902711    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-dshm" pod "e9b08f22-10ad-497e-bac2-8ff8156131d5" (UID: "e9b08f22-10ad-497e-bac2-8ff8156131d5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:12.902874 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.902824    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce09f1e8-a736-4d77-be12-5f4a45415859-tls-certs" pod "ce09f1e8-a736-4d77-be12-5f4a45415859" (UID: "ce09f1e8-a736-4d77-be12-5f4a45415859"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:28:12.902972 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.902947    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9b08f22-10ad-497e-bac2-8ff8156131d5-kube-api-access-rr5mh" pod "e9b08f22-10ad-497e-bac2-8ff8156131d5" (UID: "e9b08f22-10ad-497e-bac2-8ff8156131d5"). InnerVolumeSpecName "kube-api-access-rr5mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:28:12.903155 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.903104    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce09f1e8-a736-4d77-be12-5f4a45415859-kube-api-access-4w8js" pod "ce09f1e8-a736-4d77-be12-5f4a45415859" (UID: "ce09f1e8-a736-4d77-be12-5f4a45415859"). InnerVolumeSpecName "kube-api-access-4w8js". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:28:12.903256 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.903165    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-dshm" pod "ce09f1e8-a736-4d77-be12-5f4a45415859" (UID: "ce09f1e8-a736-4d77-be12-5f4a45415859"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:12.903256 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.903179    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9b08f22-10ad-497e-bac2-8ff8156131d5-tls-certs" pod "e9b08f22-10ad-497e-bac2-8ff8156131d5" (UID: "e9b08f22-10ad-497e-bac2-8ff8156131d5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:28:12.903562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.903546    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3ac5821-d19a-470a-acf7-f3c069268120-kube-api-access-l8b2t" pod "a3ac5821-d19a-470a-acf7-f3c069268120" (UID: "a3ac5821-d19a-470a-acf7-f3c069268120"). InnerVolumeSpecName "kube-api-access-l8b2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:28:12.903831 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.903813    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-dshm" pod "a3ac5821-d19a-470a-acf7-f3c069268120" (UID: "a3ac5821-d19a-470a-acf7-f3c069268120"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:28:12.904244 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:12.904227    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3ac5821-d19a-470a-acf7-f3c069268120-tls-certs" pod "a3ac5821-d19a-470a-acf7-f3c069268120" (UID: "a3ac5821-d19a-470a-acf7-f3c069268120"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:28:13.001708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.001584    4918 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9b08f22-10ad-497e-bac2-8ff8156131d5-dshm\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:13.001708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.001613    4918 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3ac5821-d19a-470a-acf7-f3c069268120-dshm\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:13.001708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.001625    4918 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce09f1e8-a736-4d77-be12-5f4a45415859-tls-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:13.001708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.001638    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rr5mh\" (UniqueName: \"kubernetes.io/projected/e9b08f22-10ad-497e-bac2-8ff8156131d5-kube-api-access-rr5mh\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:13.001708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.001653    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8b2t\" (UniqueName: \"kubernetes.io/projected/a3ac5821-d19a-470a-acf7-f3c069268120-kube-api-access-l8b2t\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:13.001708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.001666    4918 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9b08f22-10ad-497e-bac2-8ff8156131d5-tls-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:13.001708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.001708    4918 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce09f1e8-a736-4d77-be12-5f4a45415859-dshm\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:13.002062 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.001722    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w8js\" (UniqueName: \"kubernetes.io/projected/ce09f1e8-a736-4d77-be12-5f4a45415859-kube-api-access-4w8js\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:13.002062 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.001734    4918 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3ac5821-d19a-470a-acf7-f3c069268120-tls-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:13.658716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.658657    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"
Oct 30 22:28:13.659202 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.658660    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" event={"ID":"ce09f1e8-a736-4d77-be12-5f4a45415859","Type":"ContainerDied","Data":"ab0dde9fc8c4a967bc453ff0d26c2e1cf4862362635373d6da5eac6a1cbed0ec"}
Oct 30 22:28:13.659202 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.658792    4918 scope.go:122] "RemoveContainer" containerID="406da8b09726f77e8ac16a59345145646dd08adf19cbed2147f0173d15377e11"
Oct 30 22:28:13.660266 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.659924    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"
Oct 30 22:28:13.660266 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.659969    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59" event={"ID":"a3ac5821-d19a-470a-acf7-f3c069268120","Type":"ContainerDied","Data":"93685401ee08ba0f1333d251086fab4c930c15ea13d0f07ee0538ba64848dc30"}
Oct 30 22:28:13.661575 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.661555    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"
Oct 30 22:28:13.661739 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.661592    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb" event={"ID":"e9b08f22-10ad-497e-bac2-8ff8156131d5","Type":"ContainerDied","Data":"f8fdf04a6c1be8c6aab31237202703f35032c732e7a2c3636ee8600b1d861e68"}
Oct 30 22:28:13.664550 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.664521    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main" probeResult="failure" output="Get \"https://10.132.0.63:8000/ready\": context deadline exceeded"
Oct 30 22:28:13.669947 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.669917    4918 scope.go:122] "RemoveContainer" containerID="6b1dcde49e1e04725dd4ad5b2d49f8f8b335f2607f7bc01cc4bf792b752af6ed"
Oct 30 22:28:13.672661 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.672636    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:13.679562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.679545    4918 scope.go:122] "RemoveContainer" containerID="4958a28e97af074ce1ef8334f1487e0a16592688fefbdcb28b309e084ba9bba5"
Oct 30 22:28:13.823888 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.823815    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"]
Oct 30 22:28:13.830474 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.830453    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/distinct-w0-7df73b-kserve-666cf8f844-qnflb"]
Oct 30 22:28:13.939289 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.939262    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"]
Oct 30 22:28:13.944236 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:13.944213    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/premium-w0-7df73b-kserve-7c7d7b6769-whn59"]
Oct 30 22:28:14.052627 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:14.052596    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"]
Oct 30 22:28:14.057167 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:14.057144    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-7df73b/distinct-2-w0-7df73b-kserve-849784d559-6vj42"]
Oct 30 22:28:14.072352 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:14.072325    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" path="/var/lib/kubelet/pods/a3ac5821-d19a-470a-acf7-f3c069268120/volumes"
Oct 30 22:28:14.072796 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:14.072776    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" path="/var/lib/kubelet/pods/ce09f1e8-a736-4d77-be12-5f4a45415859/volumes"
Oct 30 22:28:14.073272 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:14.073255    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" path="/var/lib/kubelet/pods/e9b08f22-10ad-497e-bac2-8ff8156131d5/volumes"
Oct 30 22:28:18.915647 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:18.915605    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:22.456550 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:22.456509    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:22.705484 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:22.705444    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:23.550334 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:23.550296    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:23.822693 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:23.822594    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:24.597569 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:24.597534    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:25.024235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.024205    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:25.532267 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.532236    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"]
Oct 30 22:28:25.532845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.532813    4918 cpu_manager.go:414] "containerMap: removing container" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main"
Oct 30 22:28:25.532845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.532832    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main"
Oct 30 22:28:25.532845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.532851    4918 cpu_manager.go:414] "containerMap: removing container" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main"
Oct 30 22:28:25.533161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.532856    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main"
Oct 30 22:28:25.533161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.532880    4918 cpu_manager.go:414] "containerMap: removing container" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main"
Oct 30 22:28:25.533161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.532889    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main"
Oct 30 22:28:25.533161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.532902    4918 cpu_manager.go:414] "containerMap: removing container" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main"
Oct 30 22:28:25.533161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.532907    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main"
Oct 30 22:28:25.533161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.532916    4918 cpu_manager.go:414] "containerMap: removing container" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main"
Oct 30 22:28:25.533161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.532921    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main"
Oct 30 22:28:25.533161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.532998    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce09f1e8-a736-4d77-be12-5f4a45415859" containerName="main"
Oct 30 22:28:25.533161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.533008    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9b08f22-10ad-497e-bac2-8ff8156131d5" containerName="main"
Oct 30 22:28:25.533161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.533021    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a80dc71-49e6-42ad-b090-25bb7bcb324f" containerName="main"
Oct 30 22:28:25.533161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.533033    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ac33b11-35d1-4f1c-b225-4b2db946df73" containerName="main"
Oct 30 22:28:25.533161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.533046    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="a3ac5821-d19a-470a-acf7-f3c069268120" containerName="main"
Oct 30 22:28:25.537664 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.537648    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.589601 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.589580    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c04440-openshift-default-dockercfg-p79xm\""
Oct 30 22:28:25.641617 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.641580    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"]
Oct 30 22:28:25.649219 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.649197    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-workload-certs\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.649348 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.649243    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istiod-ca-cert\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.649348 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.649265    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-credential-socket\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.649496 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.649468    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-data\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.649560 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.649514    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-token\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.649659 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.649640    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-podinfo\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.649731 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.649696    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5pp5\" (UniqueName: \"kubernetes.io/projected/cf6c1371-8fc2-4017-b5b2-510b4707b61e-kube-api-access-x5pp5\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.649808 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.649784    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-workload-socket\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.649849 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.649832    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-envoy\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.716367 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.716331    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:25.750709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.750649    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-workload-certs\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.750878 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.750717    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istiod-ca-cert\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.750878 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.750738    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-credential-socket\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.750878 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.750788    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-data\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.750878 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.750816    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-token\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.750878 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.750871    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-podinfo\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.751163 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.750901    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5pp5\" (UniqueName: \"kubernetes.io/projected/cf6c1371-8fc2-4017-b5b2-510b4707b61e-kube-api-access-x5pp5\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.751163 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.750928    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-workload-socket\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.751163 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.750952    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-envoy\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.751163 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.751129    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-credential-socket\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.751426 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.751393    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-workload-certs\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.751610 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.751434    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-data\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.751610 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.751514    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-workload-socket\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.751610 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.751518    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istiod-ca-cert\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.753418 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.753396    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-envoy\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.753653 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.753635    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-podinfo\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.817850 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.817787    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-token\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.822237 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.822214    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5pp5\" (UniqueName: \"kubernetes.io/projected/cf6c1371-8fc2-4017-b5b2-510b4707b61e-kube-api-access-x5pp5\") pod \"e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") " pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:25.851230 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:25.851203    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:26.053889 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:26.053852    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:26.290094 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:26.290064    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"]
Oct 30 22:28:26.291711 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:28:26.291672    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf6c1371_8fc2_4017_b5b2_510b4707b61e.slice/crio-92fbc42fb1f07dee43d8807451836354d73bae1422fc299f312cbf33a0de257c WatchSource:0}: Error finding container 92fbc42fb1f07dee43d8807451836354d73bae1422fc299f312cbf33a0de257c: Status 404 returned error can't find the container with id 92fbc42fb1f07dee43d8807451836354d73bae1422fc299f312cbf33a0de257c
Oct 30 22:28:26.294174 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:26.294142    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:28:26.294234 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:26.294206    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:28:26.294271 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:26.294236    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:28:26.735731 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:26.735694    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8" event={"ID":"cf6c1371-8fc2-4017-b5b2-510b4707b61e","Type":"ContainerStarted","Data":"5f090793a2d5fe857c010d13650303617d5a13df82c434606891de468fa59926"}
Oct 30 22:28:26.736184 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:26.735749    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8" event={"ID":"cf6c1371-8fc2-4017-b5b2-510b4707b61e","Type":"ContainerStarted","Data":"92fbc42fb1f07dee43d8807451836354d73bae1422fc299f312cbf33a0de257c"}
Oct 30 22:28:26.851315 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:26.851288    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:26.855808 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:26.855751    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8" podStartSLOduration=1.85573535 podStartE2EDuration="1.85573535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:28:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:28:26.854645942 +0000 UTC m=+2644.903253637" watchObservedRunningTime="2026-10-30 22:28:26.85573535 +0000 UTC m=+2644.904343047"
Oct 30 22:28:27.857548 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:27.857520    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:28.088265 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:28.088230    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:28.746752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:28.746724    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:28.747657 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:28.747641    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:28:28.822571 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:28.822536    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:29.681235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:29.681188    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:30.979389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:30.979306    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:32.159364 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:28:32.159320    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:28:32.215750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:32.215718    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:34.168906 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:34.168866    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:35.643964 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:35.643921    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:35.985758 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:35.972052    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:36.911793 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:36.911753    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:38.225208 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:38.225169    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:38.493258 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:38.493175    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:39.816427 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:39.816386    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:40.759468 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.759425    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"]
Oct 30 22:28:40.763625 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.763607    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.816024 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.816000    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-7df73b-openshift-default-dockercfg-r7qb2\""
Oct 30 22:28:40.827734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.827707    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.828150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.827749    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.828150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.827775    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.828150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.827816    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-899m5\" (UniqueName: \"kubernetes.io/projected/7dd1de7b-2369-4163-adb3-466bae84f33a-kube-api-access-899m5\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.828150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.827860    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dd1de7b-2369-4163-adb3-466bae84f33a-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.828150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.827891    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.828150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.827944    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.828150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.828034    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.828150 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.828084    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.867633 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.867604    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"]
Oct 30 22:28:40.929526 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.929495    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.929647 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.929546    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.929647 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.929615    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.929811 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.929643    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.929811 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.929669    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.929811 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.929739    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-899m5\" (UniqueName: \"kubernetes.io/projected/7dd1de7b-2369-4163-adb3-466bae84f33a-kube-api-access-899m5\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.929980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.929874    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dd1de7b-2369-4163-adb3-466bae84f33a-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.929980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.929898    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-data\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.929980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.929917    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.930140 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.929978    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.930263 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.930238    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-workload-certs\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.930389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.930365    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-workload-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.930389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.930381    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-credential-socket\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.930711 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.930666    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dd1de7b-2369-4163-adb3-466bae84f33a-istiod-ca-cert\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.932271 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.932246    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-envoy\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.932365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.932277    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-podinfo\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.991165 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.991134    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-token\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:40.991315 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:40.991296    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-899m5\" (UniqueName: \"kubernetes.io/projected/7dd1de7b-2369-4163-adb3-466bae84f33a-kube-api-access-899m5\") pod \"e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") " pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:41.077790 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:41.077733    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:41.508167 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:41.508143    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"]
Oct 30 22:28:41.510203 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:28:41.510171    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd1de7b_2369_4163_adb3_466bae84f33a.slice/crio-a750c34862d14154838c2becd0eee6797a7b16ea8556bb7eca6414c284ce437e WatchSource:0}: Error finding container a750c34862d14154838c2becd0eee6797a7b16ea8556bb7eca6414c284ce437e: Status 404 returned error can't find the container with id a750c34862d14154838c2becd0eee6797a7b16ea8556bb7eca6414c284ce437e
Oct 30 22:28:41.512698 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:41.512646    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:28:41.512834 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:41.512739    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:28:41.512834 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:41.512786    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:28:41.827374 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:41.827295    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l" event={"ID":"7dd1de7b-2369-4163-adb3-466bae84f33a","Type":"ContainerStarted","Data":"7ffbcb370b02d7c640592284406b9c97411dbc323f1282cc4c9b434712da8ceb"}
Oct 30 22:28:41.827374 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:41.827346    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l" event={"ID":"7dd1de7b-2369-4163-adb3-466bae84f33a","Type":"ContainerStarted","Data":"a750c34862d14154838c2becd0eee6797a7b16ea8556bb7eca6414c284ce437e"}
Oct 30 22:28:41.949837 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:41.949789    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l" podStartSLOduration=1.9497712649999999 podStartE2EDuration="1.949771265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:28:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:28:41.947031401 +0000 UTC m=+2659.995639097" watchObservedRunningTime="2026-10-30 22:28:41.949771265 +0000 UTC m=+2659.998378961"
Oct 30 22:28:42.077946 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:42.077862    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:42.079478 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:42.079457    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused" start-of-body=
Oct 30 22:28:42.079538 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:42.079503    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l" podUID="7dd1de7b-2369-4163-adb3-466bae84f33a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused"
Oct 30 22:28:42.916708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:42.916435    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:43.078810 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:43.078774    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused" start-of-body=
Oct 30 22:28:43.079190 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:43.078837    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l" podUID="7dd1de7b-2369-4163-adb3-466bae84f33a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused"
Oct 30 22:28:44.078077 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:44.078046    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused" start-of-body=
Oct 30 22:28:44.078264 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:44.078095    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l" podUID="7dd1de7b-2369-4163-adb3-466bae84f33a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused"
Oct 30 22:28:44.734710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:44.732660    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:45.078375 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:45.078297    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused" start-of-body=
Oct 30 22:28:45.078375 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:45.078347    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l" podUID="7dd1de7b-2369-4163-adb3-466bae84f33a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused"
Oct 30 22:28:46.078434 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:46.078404    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused" start-of-body=
Oct 30 22:28:46.078835 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:46.078461    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l" podUID="7dd1de7b-2369-4163-adb3-466bae84f33a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused"
Oct 30 22:28:47.078760 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:47.078720    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused" start-of-body=
Oct 30 22:28:47.079175 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:47.078783    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l" podUID="7dd1de7b-2369-4163-adb3-466bae84f33a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused"
Oct 30 22:28:48.078592 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:48.078564    4918 patch_prober.go:29] interesting pod/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused" start-of-body=
Oct 30 22:28:48.078789 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:48.078610    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l" podUID="7dd1de7b-2369-4163-adb3-466bae84f33a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.135:15021/healthz/ready\": dial tcp 10.132.0.135:15021: connect: connection refused"
Oct 30 22:28:49.082551 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:49.082523    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:49.082990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:49.082969    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:49.083644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:49.083625    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:28:49.795066 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:49.795024    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:50.105199 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:50.105102    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:53.083315 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:53.083283    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:53.323218 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:53.323173    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:54.508889 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:54.508851    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:55.523246 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.523204    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"]
Oct 30 22:28:55.523719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.523440    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw" podUID="05ed40e1-2fa4-4b27-89bb-c3409c173828" containerName="maas-api" containerID="cri-o://374aaeb941d66aa7362d76e0135015f6d017cb7226e0707d3bf3e18a03be1aec" gracePeriod=30
Oct 30 22:28:55.759046 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.758949    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:55.850222 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.850188    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 22:28:55.909518 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.909478    4918 generic.go:356] "Generic (PLEG): container finished" podID="05ed40e1-2fa4-4b27-89bb-c3409c173828" containerID="374aaeb941d66aa7362d76e0135015f6d017cb7226e0707d3bf3e18a03be1aec" exitCode=0
Oct 30 22:28:55.909518 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.909528    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw" event={"ID":"05ed40e1-2fa4-4b27-89bb-c3409c173828","Type":"ContainerDied","Data":"374aaeb941d66aa7362d76e0135015f6d017cb7226e0707d3bf3e18a03be1aec"}
Oct 30 22:28:55.909808 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.909614    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw" event={"ID":"05ed40e1-2fa4-4b27-89bb-c3409c173828","Type":"ContainerDied","Data":"d130384e28c2271f1153ce7fd2fac5bcdf8efe08a6c26b0c933f0d4dd09c86f2"}
Oct 30 22:28:55.909808 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.909645    4918 scope.go:122] "RemoveContainer" containerID="374aaeb941d66aa7362d76e0135015f6d017cb7226e0707d3bf3e18a03be1aec"
Oct 30 22:28:55.909941 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.909843    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"
Oct 30 22:28:55.918396 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.918359    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/05ed40e1-2fa4-4b27-89bb-c3409c173828-kube-api-access-t2lcp\" (UniqueName: \"kubernetes.io/projected/05ed40e1-2fa4-4b27-89bb-c3409c173828-kube-api-access-t2lcp\") pod \"05ed40e1-2fa4-4b27-89bb-c3409c173828\" (UID: \"05ed40e1-2fa4-4b27-89bb-c3409c173828\") "
Oct 30 22:28:55.918715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.918670    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/05ed40e1-2fa4-4b27-89bb-c3409c173828-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ed40e1-2fa4-4b27-89bb-c3409c173828-maas-api-tls\") pod \"05ed40e1-2fa4-4b27-89bb-c3409c173828\" (UID: \"05ed40e1-2fa4-4b27-89bb-c3409c173828\") "
Oct 30 22:28:55.918984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.918965    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/05ed40e1-2fa4-4b27-89bb-c3409c173828-metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ed40e1-2fa4-4b27-89bb-c3409c173828-metrics-certs\") pod \"05ed40e1-2fa4-4b27-89bb-c3409c173828\" (UID: \"05ed40e1-2fa4-4b27-89bb-c3409c173828\") "
Oct 30 22:28:55.919214 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.919173    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/05ed40e1-2fa4-4b27-89bb-c3409c173828-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05ed40e1-2fa4-4b27-89bb-c3409c173828-openshift-service-ca\") pod \"05ed40e1-2fa4-4b27-89bb-c3409c173828\" (UID: \"05ed40e1-2fa4-4b27-89bb-c3409c173828\") "
Oct 30 22:28:55.921021 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.920999    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05ed40e1-2fa4-4b27-89bb-c3409c173828-openshift-service-ca" pod "05ed40e1-2fa4-4b27-89bb-c3409c173828" (UID: "05ed40e1-2fa4-4b27-89bb-c3409c173828"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:28:55.961051 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.956914    4918 scope.go:122] "RemoveContainer" containerID="374aaeb941d66aa7362d76e0135015f6d017cb7226e0707d3bf3e18a03be1aec"
Oct 30 22:28:55.961051 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:28:55.957423    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"374aaeb941d66aa7362d76e0135015f6d017cb7226e0707d3bf3e18a03be1aec\": container with ID starting with 374aaeb941d66aa7362d76e0135015f6d017cb7226e0707d3bf3e18a03be1aec not found: ID does not exist" containerID="374aaeb941d66aa7362d76e0135015f6d017cb7226e0707d3bf3e18a03be1aec"
Oct 30 22:28:55.961051 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.957476    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"374aaeb941d66aa7362d76e0135015f6d017cb7226e0707d3bf3e18a03be1aec"} err="failed to get container status \"374aaeb941d66aa7362d76e0135015f6d017cb7226e0707d3bf3e18a03be1aec\": rpc error: code = NotFound desc = could not find container \"374aaeb941d66aa7362d76e0135015f6d017cb7226e0707d3bf3e18a03be1aec\": container with ID starting with 374aaeb941d66aa7362d76e0135015f6d017cb7226e0707d3bf3e18a03be1aec not found: ID does not exist"
Oct 30 22:28:55.974875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.974172    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05ed40e1-2fa4-4b27-89bb-c3409c173828-maas-api-tls" pod "05ed40e1-2fa4-4b27-89bb-c3409c173828" (UID: "05ed40e1-2fa4-4b27-89bb-c3409c173828"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:28:55.974875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.974638    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05ed40e1-2fa4-4b27-89bb-c3409c173828-metrics-certs" pod "05ed40e1-2fa4-4b27-89bb-c3409c173828" (UID: "05ed40e1-2fa4-4b27-89bb-c3409c173828"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:28:55.974875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:55.974812    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05ed40e1-2fa4-4b27-89bb-c3409c173828-kube-api-access-t2lcp" pod "05ed40e1-2fa4-4b27-89bb-c3409c173828" (UID: "05ed40e1-2fa4-4b27-89bb-c3409c173828"). InnerVolumeSpecName "kube-api-access-t2lcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:28:56.021393 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:56.021358    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2lcp\" (UniqueName: \"kubernetes.io/projected/05ed40e1-2fa4-4b27-89bb-c3409c173828-kube-api-access-t2lcp\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:56.021580 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:56.021413    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ed40e1-2fa4-4b27-89bb-c3409c173828-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:56.021580 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:56.021433    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/05ed40e1-2fa4-4b27-89bb-c3409c173828-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:56.021580 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:56.021449    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05ed40e1-2fa4-4b27-89bb-c3409c173828-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:56.121708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:56.113469    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:56.325271 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:56.325239    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"]
Oct 30 22:28:56.330940 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:56.330907    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw"]
Oct 30 22:28:56.395311 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:56.395261    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:57.062409 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:57.062374    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:57.479921 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:57.479892    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:57.723161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:57.722586    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:57.985542 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:57.985501    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:58.073270 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:58.073240    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="05ed40e1-2fa4-4b27-89bb-c3409c173828" path="/var/lib/kubelet/pods/05ed40e1-2fa4-4b27-89bb-c3409c173828/volumes"
Oct 30 22:28:58.440776 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:58.440736    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:58.711474 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:58.711389    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-b2f165-65d7b9d5f5-b4wfw" podUID="05ed40e1-2fa4-4b27-89bb-c3409c173828" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.47:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:28:59.802247 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:28:59.802210    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:00.045488 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:00.045431    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:02.158591 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:29:02.158555    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:29:02.676651 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:02.676619    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:03.124595 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:03.124508    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:04.178145 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:04.178104    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:04.448828 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:04.448748    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"]
Oct 30 22:29:04.448985 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:04.448936    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l" podUID="7dd1de7b-2369-4163-adb3-466bae84f33a" containerName="istio-proxy" containerID="cri-o://7ffbcb370b02d7c640592284406b9c97411dbc323f1282cc4c9b434712da8ceb" gracePeriod=30
Oct 30 22:29:04.471069 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:04.471035    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:04.801646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:04.801553    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:05.391692 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:05.391655    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:05.632898 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:05.632864    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:05.640962 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:05.640935    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"]
Oct 30 22:29:05.641146 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:05.641128    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z" podUID="d6363579-8652-4079-b4b7-252ff83d1a33" containerName="istio-proxy" containerID="cri-o://ac1b8fbee7e5a3f44c7159192b3b53a5d62a57246dd45f35951ad7d8634814af" gracePeriod=30
Oct 30 22:29:05.869966 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:05.869870    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:06.576220 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:06.576185    4918 patch_prober.go:29] interesting pod/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:29:06.576633 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:06.576256    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z" podUID="d6363579-8652-4079-b4b7-252ff83d1a33" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:29:08.231606 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:08.231567    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:09.703962 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.703934    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:29:09.784424 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.784339    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-workload-socket\") pod \"7dd1de7b-2369-4163-adb3-466bae84f33a\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") "
Oct 30 22:29:09.784424 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.784381    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-data\") pod \"7dd1de7b-2369-4163-adb3-466bae84f33a\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") "
Oct 30 22:29:09.784424 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.784415    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-workload-certs\") pod \"7dd1de7b-2369-4163-adb3-466bae84f33a\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") "
Oct 30 22:29:09.784734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.784437    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-podinfo\") pod \"7dd1de7b-2369-4163-adb3-466bae84f33a\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") "
Oct 30 22:29:09.784734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.784456    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-envoy\") pod \"7dd1de7b-2369-4163-adb3-466bae84f33a\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") "
Oct 30 22:29:09.784734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.784487    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-token\" (UniqueName: \"kubernetes.io/projected/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-token\") pod \"7dd1de7b-2369-4163-adb3-466bae84f33a\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") "
Oct 30 22:29:09.784734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.784534    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-credential-socket\") pod \"7dd1de7b-2369-4163-adb3-466bae84f33a\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") "
Oct 30 22:29:09.784734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.784652    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7dd1de7b-2369-4163-adb3-466bae84f33a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dd1de7b-2369-4163-adb3-466bae84f33a-istiod-ca-cert\") pod \"7dd1de7b-2369-4163-adb3-466bae84f33a\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") "
Oct 30 22:29:09.784734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.784661    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-workload-socket" pod "7dd1de7b-2369-4163-adb3-466bae84f33a" (UID: "7dd1de7b-2369-4163-adb3-466bae84f33a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:09.785038 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.784778    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7dd1de7b-2369-4163-adb3-466bae84f33a-kube-api-access-899m5\" (UniqueName: \"kubernetes.io/projected/7dd1de7b-2369-4163-adb3-466bae84f33a-kube-api-access-899m5\") pod \"7dd1de7b-2369-4163-adb3-466bae84f33a\" (UID: \"7dd1de7b-2369-4163-adb3-466bae84f33a\") "
Oct 30 22:29:09.785038 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.784833    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-workload-certs" pod "7dd1de7b-2369-4163-adb3-466bae84f33a" (UID: "7dd1de7b-2369-4163-adb3-466bae84f33a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:09.785038 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.784852    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-data" pod "7dd1de7b-2369-4163-adb3-466bae84f33a" (UID: "7dd1de7b-2369-4163-adb3-466bae84f33a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:09.785038 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.784931    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-credential-socket" pod "7dd1de7b-2369-4163-adb3-466bae84f33a" (UID: "7dd1de7b-2369-4163-adb3-466bae84f33a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:09.785250 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.785094    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dd1de7b-2369-4163-adb3-466bae84f33a-istiod-ca-cert" pod "7dd1de7b-2369-4163-adb3-466bae84f33a" (UID: "7dd1de7b-2369-4163-adb3-466bae84f33a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:29:09.785483 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.785461    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.785549 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.785491    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.785549 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.785507    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.785549 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.785521    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7dd1de7b-2369-4163-adb3-466bae84f33a-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.785549 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.785535    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.786861 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.786834    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-podinfo" pod "7dd1de7b-2369-4163-adb3-466bae84f33a" (UID: "7dd1de7b-2369-4163-adb3-466bae84f33a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:29:09.786972 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.786880    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-envoy" pod "7dd1de7b-2369-4163-adb3-466bae84f33a" (UID: "7dd1de7b-2369-4163-adb3-466bae84f33a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:09.787481 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.787453    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dd1de7b-2369-4163-adb3-466bae84f33a-kube-api-access-899m5" pod "7dd1de7b-2369-4163-adb3-466bae84f33a" (UID: "7dd1de7b-2369-4163-adb3-466bae84f33a"). InnerVolumeSpecName "kube-api-access-899m5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:09.787481 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.787464    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-token" pod "7dd1de7b-2369-4163-adb3-466bae84f33a" (UID: "7dd1de7b-2369-4163-adb3-466bae84f33a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:09.887396 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.887349    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.887396 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.887391    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.887670 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.887406    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7dd1de7b-2369-4163-adb3-466bae84f33a-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.887670 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.887421    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-899m5\" (UniqueName: \"kubernetes.io/projected/7dd1de7b-2369-4163-adb3-466bae84f33a-kube-api-access-899m5\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:09.998208 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.998166    4918 generic.go:356] "Generic (PLEG): container finished" podID="7dd1de7b-2369-4163-adb3-466bae84f33a" containerID="7ffbcb370b02d7c640592284406b9c97411dbc323f1282cc4c9b434712da8ceb" exitCode=0
Oct 30 22:29:09.998380 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.998220    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"
Oct 30 22:29:09.998380 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.998247    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l" event={"ID":"7dd1de7b-2369-4163-adb3-466bae84f33a","Type":"ContainerDied","Data":"7ffbcb370b02d7c640592284406b9c97411dbc323f1282cc4c9b434712da8ceb"}
Oct 30 22:29:09.998380 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.998308    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l" event={"ID":"7dd1de7b-2369-4163-adb3-466bae84f33a","Type":"ContainerDied","Data":"a750c34862d14154838c2becd0eee6797a7b16ea8556bb7eca6414c284ce437e"}
Oct 30 22:29:09.998380 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:09.998331    4918 scope.go:122] "RemoveContainer" containerID="7ffbcb370b02d7c640592284406b9c97411dbc323f1282cc4c9b434712da8ceb"
Oct 30 22:29:10.010969 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.010951    4918 scope.go:122] "RemoveContainer" containerID="7ffbcb370b02d7c640592284406b9c97411dbc323f1282cc4c9b434712da8ceb"
Oct 30 22:29:10.011288 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:29:10.011271    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ffbcb370b02d7c640592284406b9c97411dbc323f1282cc4c9b434712da8ceb\": container with ID starting with 7ffbcb370b02d7c640592284406b9c97411dbc323f1282cc4c9b434712da8ceb not found: ID does not exist" containerID="7ffbcb370b02d7c640592284406b9c97411dbc323f1282cc4c9b434712da8ceb"
Oct 30 22:29:10.011340 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.011298    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ffbcb370b02d7c640592284406b9c97411dbc323f1282cc4c9b434712da8ceb"} err="failed to get container status \"7ffbcb370b02d7c640592284406b9c97411dbc323f1282cc4c9b434712da8ceb\": rpc error: code = NotFound desc = could not find container \"7ffbcb370b02d7c640592284406b9c97411dbc323f1282cc4c9b434712da8ceb\": container with ID starting with 7ffbcb370b02d7c640592284406b9c97411dbc323f1282cc4c9b434712da8ceb not found: ID does not exist"
Oct 30 22:29:10.163480 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.163443    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"]
Oct 30 22:29:10.171169 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.171142    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7df73b-openshift-default-7fd847d4b7-lg58l"]
Oct 30 22:29:10.907876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.907817    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:29:10.997891 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.997859    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-istio-data\") pod \"d6363579-8652-4079-b4b7-252ff83d1a33\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") "
Oct 30 22:29:10.998089 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.997903    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-workload-socket\") pod \"d6363579-8652-4079-b4b7-252ff83d1a33\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") "
Oct 30 22:29:10.998089 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.997936    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d6363579-8652-4079-b4b7-252ff83d1a33-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6363579-8652-4079-b4b7-252ff83d1a33-istio-podinfo\") pod \"d6363579-8652-4079-b4b7-252ff83d1a33\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") "
Oct 30 22:29:10.998089 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.997984    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-credential-socket\") pod \"d6363579-8652-4079-b4b7-252ff83d1a33\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") "
Oct 30 22:29:10.998089 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.998020    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d6363579-8652-4079-b4b7-252ff83d1a33-istio-token\" (UniqueName: \"kubernetes.io/projected/d6363579-8652-4079-b4b7-252ff83d1a33-istio-token\") pod \"d6363579-8652-4079-b4b7-252ff83d1a33\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") "
Oct 30 22:29:10.998089 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.998079    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d6363579-8652-4079-b4b7-252ff83d1a33-kube-api-access-tvwtr\" (UniqueName: \"kubernetes.io/projected/d6363579-8652-4079-b4b7-252ff83d1a33-kube-api-access-tvwtr\") pod \"d6363579-8652-4079-b4b7-252ff83d1a33\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") "
Oct 30 22:29:10.998361 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.998127    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-workload-certs\") pod \"d6363579-8652-4079-b4b7-252ff83d1a33\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") "
Oct 30 22:29:10.998361 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.998153    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d6363579-8652-4079-b4b7-252ff83d1a33-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6363579-8652-4079-b4b7-252ff83d1a33-istiod-ca-cert\") pod \"d6363579-8652-4079-b4b7-252ff83d1a33\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") "
Oct 30 22:29:10.998361 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.998182    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-istio-envoy\") pod \"d6363579-8652-4079-b4b7-252ff83d1a33\" (UID: \"d6363579-8652-4079-b4b7-252ff83d1a33\") "
Oct 30 22:29:10.998361 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.998198    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-istio-data" pod "d6363579-8652-4079-b4b7-252ff83d1a33" (UID: "d6363579-8652-4079-b4b7-252ff83d1a33"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:10.998361 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.998216    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-workload-socket" pod "d6363579-8652-4079-b4b7-252ff83d1a33" (UID: "d6363579-8652-4079-b4b7-252ff83d1a33"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:10.998361 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.998300    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-credential-socket" pod "d6363579-8652-4079-b4b7-252ff83d1a33" (UID: "d6363579-8652-4079-b4b7-252ff83d1a33"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:10.998695 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.998652    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-workload-certs" pod "d6363579-8652-4079-b4b7-252ff83d1a33" (UID: "d6363579-8652-4079-b4b7-252ff83d1a33"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:10.998695 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.998659    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6363579-8652-4079-b4b7-252ff83d1a33-istiod-ca-cert" pod "d6363579-8652-4079-b4b7-252ff83d1a33" (UID: "d6363579-8652-4079-b4b7-252ff83d1a33"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:29:10.998885 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.998809    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:10.998885 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.998835    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6363579-8652-4079-b4b7-252ff83d1a33-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:10.998885 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.998849    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:10.998885 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.998865    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:10.998885 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:10.998879    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:11.001206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.001028    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-istio-envoy" pod "d6363579-8652-4079-b4b7-252ff83d1a33" (UID: "d6363579-8652-4079-b4b7-252ff83d1a33"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:29:11.001332 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.001260    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d6363579-8652-4079-b4b7-252ff83d1a33-istio-podinfo" pod "d6363579-8652-4079-b4b7-252ff83d1a33" (UID: "d6363579-8652-4079-b4b7-252ff83d1a33"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:29:11.003877 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.003847    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6363579-8652-4079-b4b7-252ff83d1a33-kube-api-access-tvwtr" pod "d6363579-8652-4079-b4b7-252ff83d1a33" (UID: "d6363579-8652-4079-b4b7-252ff83d1a33"). InnerVolumeSpecName "kube-api-access-tvwtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:11.017529 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.017493    4918 generic.go:356] "Generic (PLEG): container finished" podID="d6363579-8652-4079-b4b7-252ff83d1a33" containerID="ac1b8fbee7e5a3f44c7159192b3b53a5d62a57246dd45f35951ad7d8634814af" exitCode=0
Oct 30 22:29:11.017692 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.017603    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z" event={"ID":"d6363579-8652-4079-b4b7-252ff83d1a33","Type":"ContainerDied","Data":"ac1b8fbee7e5a3f44c7159192b3b53a5d62a57246dd45f35951ad7d8634814af"}
Oct 30 22:29:11.017817 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.017724    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z" event={"ID":"d6363579-8652-4079-b4b7-252ff83d1a33","Type":"ContainerDied","Data":"40d005854ea42e90bf7e52507aae39ad0a2d0a1158ba06e0cbef346870993531"}
Oct 30 22:29:11.017817 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.017772    4918 scope.go:122] "RemoveContainer" containerID="ac1b8fbee7e5a3f44c7159192b3b53a5d62a57246dd45f35951ad7d8634814af"
Oct 30 22:29:11.018211 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.018035    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"
Oct 30 22:29:11.021793 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.021762    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6363579-8652-4079-b4b7-252ff83d1a33-istio-token" pod "d6363579-8652-4079-b4b7-252ff83d1a33" (UID: "d6363579-8652-4079-b4b7-252ff83d1a33"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:11.037276 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.037246    4918 scope.go:122] "RemoveContainer" containerID="ac1b8fbee7e5a3f44c7159192b3b53a5d62a57246dd45f35951ad7d8634814af"
Oct 30 22:29:11.037634 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:29:11.037615    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac1b8fbee7e5a3f44c7159192b3b53a5d62a57246dd45f35951ad7d8634814af\": container with ID starting with ac1b8fbee7e5a3f44c7159192b3b53a5d62a57246dd45f35951ad7d8634814af not found: ID does not exist" containerID="ac1b8fbee7e5a3f44c7159192b3b53a5d62a57246dd45f35951ad7d8634814af"
Oct 30 22:29:11.037713 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.037644    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac1b8fbee7e5a3f44c7159192b3b53a5d62a57246dd45f35951ad7d8634814af"} err="failed to get container status \"ac1b8fbee7e5a3f44c7159192b3b53a5d62a57246dd45f35951ad7d8634814af\": rpc error: code = NotFound desc = could not find container \"ac1b8fbee7e5a3f44c7159192b3b53a5d62a57246dd45f35951ad7d8634814af\": container with ID starting with ac1b8fbee7e5a3f44c7159192b3b53a5d62a57246dd45f35951ad7d8634814af not found: ID does not exist"
Oct 30 22:29:11.099723 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.099668    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6363579-8652-4079-b4b7-252ff83d1a33-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:11.099723 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.099716    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6363579-8652-4079-b4b7-252ff83d1a33-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:11.099723 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.099726    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6363579-8652-4079-b4b7-252ff83d1a33-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:11.099960 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.099737    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvwtr\" (UniqueName: \"kubernetes.io/projected/d6363579-8652-4079-b4b7-252ff83d1a33-kube-api-access-tvwtr\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:11.439428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.439393    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"]
Oct 30 22:29:11.488573 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:11.488541    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b2f165-openshift-default-6549966f6f-gcv6z"]
Oct 30 22:29:12.073827 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:12.073794    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7dd1de7b-2369-4163-adb3-466bae84f33a" path="/var/lib/kubelet/pods/7dd1de7b-2369-4163-adb3-466bae84f33a/volumes"
Oct 30 22:29:12.074291 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:12.074277    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d6363579-8652-4079-b4b7-252ff83d1a33" path="/var/lib/kubelet/pods/d6363579-8652-4079-b4b7-252ff83d1a33/volumes"
Oct 30 22:29:13.108156 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.108112    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:13.669559 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.669516    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"]
Oct 30 22:29:13.670041 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.670020    4918 cpu_manager.go:414] "containerMap: removing container" podUID="d6363579-8652-4079-b4b7-252ff83d1a33" containerName="istio-proxy"
Oct 30 22:29:13.670041 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.670036    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d6363579-8652-4079-b4b7-252ff83d1a33" containerName="istio-proxy"
Oct 30 22:29:13.670260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.670066    4918 cpu_manager.go:414] "containerMap: removing container" podUID="05ed40e1-2fa4-4b27-89bb-c3409c173828" containerName="maas-api"
Oct 30 22:29:13.670260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.670071    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="05ed40e1-2fa4-4b27-89bb-c3409c173828" containerName="maas-api"
Oct 30 22:29:13.670260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.670084    4918 cpu_manager.go:414] "containerMap: removing container" podUID="7dd1de7b-2369-4163-adb3-466bae84f33a" containerName="istio-proxy"
Oct 30 22:29:13.670260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.670089    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7dd1de7b-2369-4163-adb3-466bae84f33a" containerName="istio-proxy"
Oct 30 22:29:13.670260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.670179    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="d6363579-8652-4079-b4b7-252ff83d1a33" containerName="istio-proxy"
Oct 30 22:29:13.670260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.670198    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="05ed40e1-2fa4-4b27-89bb-c3409c173828" containerName="maas-api"
Oct 30 22:29:13.670260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.670205    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="7dd1de7b-2369-4163-adb3-466bae84f33a" containerName="istio-proxy"
Oct 30 22:29:13.674875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.674859    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.726956 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.726931    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x6pr\" (UniqueName: \"kubernetes.io/projected/aeb7445e-8468-474e-be2d-4b67b15e7a2a-kube-api-access-2x6pr\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.727095 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.726978    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-model-cache\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.727137 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.727095    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-home\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.727137 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.727114    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-tmp-dir\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.727203 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.727170    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeb7445e-8468-474e-be2d-4b67b15e7a2a-tls-certs\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.727250 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.727233    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-dshm\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.778009 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.777983    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-32dd8d\"/\"kube-root-ca.crt\""
Oct 30 22:29:13.778284 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.778265    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-32dd8d\"/\"openshift-service-ca.crt\""
Oct 30 22:29:13.778398 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.778354    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-32dd8d\"/\"test-model-32dd8d-kserve-self-signed-certs\""
Oct 30 22:29:13.778398 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.778355    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-32dd8d\"/\"default-dockercfg-nt4v7\""
Oct 30 22:29:13.780836 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.780814    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"]
Oct 30 22:29:13.828060 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.828038    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-model-cache\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.828171 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.828098    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-home\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.828171 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.828124    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-tmp-dir\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.828303 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.828282    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeb7445e-8468-474e-be2d-4b67b15e7a2a-tls-certs\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.828343 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.828324    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-dshm\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.828441 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.828423    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x6pr\" (UniqueName: \"kubernetes.io/projected/aeb7445e-8468-474e-be2d-4b67b15e7a2a-kube-api-access-2x6pr\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.828495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.828475    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-model-cache\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.828547 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.828515    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-home\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.828588 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.828551    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-tmp-dir\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.830843 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.830817    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-dshm\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.831085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.831067    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeb7445e-8468-474e-be2d-4b67b15e7a2a-tls-certs\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.889432 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.889351    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x6pr\" (UniqueName: \"kubernetes.io/projected/aeb7445e-8468-474e-be2d-4b67b15e7a2a-kube-api-access-2x6pr\") pod \"test-model-32dd8d-kserve-6b95df8fd9-7p82t\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") " pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:13.986825 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:13.986763    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:14.364183 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:14.364156    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"]
Oct 30 22:29:14.366874 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:29:14.366850    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaeb7445e_8468_474e_be2d_4b67b15e7a2a.slice/crio-8650d334a717547400965e5887f0b3a8ed1629287b5dc7523612a9ec014102f0 WatchSource:0}: Error finding container 8650d334a717547400965e5887f0b3a8ed1629287b5dc7523612a9ec014102f0: Status 404 returned error can't find the container with id 8650d334a717547400965e5887f0b3a8ed1629287b5dc7523612a9ec014102f0
Oct 30 22:29:14.662856 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:14.662814    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:15.042012 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:15.041980    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t" event={"ID":"aeb7445e-8468-474e-be2d-4b67b15e7a2a","Type":"ContainerStarted","Data":"23ddde33c6887105bc7197f0b846c9b589fcebafc0304f41e5f8167813104f60"}
Oct 30 22:29:15.042157 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:15.042022    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t" event={"ID":"aeb7445e-8468-474e-be2d-4b67b15e7a2a","Type":"ContainerStarted","Data":"8650d334a717547400965e5887f0b3a8ed1629287b5dc7523612a9ec014102f0"}
Oct 30 22:29:15.157211 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:15.157169    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t" podStartSLOduration=2.157157369 podStartE2EDuration="2.157157369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:29:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:29:15.157009937 +0000 UTC m=+2693.205617633" watchObservedRunningTime="2026-10-30 22:29:15.157157369 +0000 UTC m=+2693.205765065"
Oct 30 22:29:15.986850 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:15.986821    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:18.009518 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:18.009477    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:22.404175 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:22.404148    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:29:22.432015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:22.431989    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:29:22.904068 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:22.904034    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:23.987672 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:23.987640    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:24.000334 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:24.000308    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:24.105486 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:24.105458    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:29:27.711869 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:27.711835    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:28.454522 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:28.454477    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:32.157345 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:29:32.157304    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:29:32.251520 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.251494    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"]
Oct 30 22:29:32.256799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.256780    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:32.311993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.311970    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-c04440-serving-cert\""
Oct 30 22:29:32.363424 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.363393    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"]
Oct 30 22:29:32.415165 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.415105    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-maas-api-tls\") pod \"maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:32.415165 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.415141    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z47vb\" (UniqueName: \"kubernetes.io/projected/29baa21c-a90a-44d3-815d-595c1dc1b14f-kube-api-access-z47vb\") pod \"maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:32.415165 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.415161    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-metrics-certs\") pod \"maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:32.415372 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.415216    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29baa21c-a90a-44d3-815d-595c1dc1b14f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:32.516419 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.516282    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z47vb\" (UniqueName: \"kubernetes.io/projected/29baa21c-a90a-44d3-815d-595c1dc1b14f-kube-api-access-z47vb\") pod \"maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:32.516419 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.516329    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-metrics-certs\") pod \"maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:32.516419 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.516357    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29baa21c-a90a-44d3-815d-595c1dc1b14f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:32.516749 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.516732    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-maas-api-tls\") pod \"maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:32.516893 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:29:32.516871    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-serving-cert: secret "maas-api-e2e-inf-b-c04440-serving-cert" not found
Oct 30 22:29:32.516972 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:29:32.516956    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-maas-api-tls podName:29baa21c-a90a-44d3-815d-595c1dc1b14f nodeName:}" failed. No retries permitted until 2026-10-30 22:29:33.016936484 +0000 UTC m=+2711.065544170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-maas-api-tls") pod "maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl" (UID: "29baa21c-a90a-44d3-815d-595c1dc1b14f") : secret "maas-api-e2e-inf-b-c04440-serving-cert" not found
Oct 30 22:29:32.517387 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.517363    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29baa21c-a90a-44d3-815d-595c1dc1b14f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:32.519360 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.519335    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-metrics-certs\") pod \"maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:32.539587 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.539563    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:32.577730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.577703    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z47vb\" (UniqueName: \"kubernetes.io/projected/29baa21c-a90a-44d3-815d-595c1dc1b14f-kube-api-access-z47vb\") pod \"maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:32.770524 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:32.770437    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:33.022332 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:33.022265    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-maas-api-tls\") pod \"maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:33.024698 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:33.024666    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-maas-api-tls\") pod \"maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:33.170451 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:33.170424    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:33.547970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:33.547900    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"]
Oct 30 22:29:33.550528 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:29:33.550501    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29baa21c_a90a_44d3_815d_595c1dc1b14f.slice/crio-8523b1397f65b7dce9b57a24ef7fb508ecf84cdc22f7e35477ecada74c703a6d WatchSource:0}: Error finding container 8523b1397f65b7dce9b57a24ef7fb508ecf84cdc22f7e35477ecada74c703a6d: Status 404 returned error can't find the container with id 8523b1397f65b7dce9b57a24ef7fb508ecf84cdc22f7e35477ecada74c703a6d
Oct 30 22:29:33.552031 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:33.552011    4918 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:29:34.145369 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:34.145328    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl" event={"ID":"29baa21c-a90a-44d3-815d-595c1dc1b14f","Type":"ContainerStarted","Data":"8523b1397f65b7dce9b57a24ef7fb508ecf84cdc22f7e35477ecada74c703a6d"}
Oct 30 22:29:35.152351 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:35.152273    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl" event={"ID":"29baa21c-a90a-44d3-815d-595c1dc1b14f","Type":"ContainerStarted","Data":"efb3851e11cbec27c22f27f84bf24c2766fdb5a97969b0302ffd37fac469970f"}
Oct 30 22:29:35.152768 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:35.152490    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:35.270729 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:35.270662    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl" podStartSLOduration=2.441661656 podStartE2EDuration="3.270647539s" totalImagesPullingTime="828.985883ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:29:35.269333276 +0000 UTC m=+2713.317940973" watchObservedRunningTime="2026-10-30 22:29:35.270647539 +0000 UTC m=+2713.319255233"
Oct 30 22:29:37.547029 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:37.546992    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:41.163646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:41.163615    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:29:42.507875 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:42.507771    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:47.334508 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:47.334464    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:48.350322 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:48.350287    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:48.582584 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:48.582545    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:50.269175 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:50.269148    4918 generic.go:356] "Generic (PLEG): container finished" podID="cf6c1371-8fc2-4017-b5b2-510b4707b61e" containerID="5f090793a2d5fe857c010d13650303617d5a13df82c434606891de468fa59926" exitCode=0
Oct 30 22:29:50.269545 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:50.269211    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8" event={"ID":"cf6c1371-8fc2-4017-b5b2-510b4707b61e","Type":"ContainerDied","Data":"5f090793a2d5fe857c010d13650303617d5a13df82c434606891de468fa59926"}
Oct 30 22:29:50.269591 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:50.269545    4918 scope.go:122] "RemoveContainer" containerID="5f090793a2d5fe857c010d13650303617d5a13df82c434606891de468fa59926"
Oct 30 22:29:50.270871 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:50.270841    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:29:50.270931 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:50.270915    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:29:50.270971 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:50.270953    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:29:51.277224 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:51.277187    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8" event={"ID":"cf6c1371-8fc2-4017-b5b2-510b4707b61e","Type":"ContainerStarted","Data":"ae4f80a2636b0d97648256f8343a18beb08405532a346e549d664f54869cab50"}
Oct 30 22:29:51.852121 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:51.852066    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:29:51.852372 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:51.852353    4918 patch_prober.go:29] interesting pod/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused" start-of-body=
Oct 30 22:29:51.852421 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:51.852408    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8" podUID="cf6c1371-8fc2-4017-b5b2-510b4707b61e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused"
Oct 30 22:29:52.174918 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:52.174881    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:52.852053 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:52.852013    4918 patch_prober.go:29] interesting pod/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused" start-of-body=
Oct 30 22:29:52.852466 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:52.852069    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8" podUID="cf6c1371-8fc2-4017-b5b2-510b4707b61e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused"
Oct 30 22:29:53.851849 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:53.851813    4918 patch_prober.go:29] interesting pod/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused" start-of-body=
Oct 30 22:29:53.852038 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:53.851870    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8" podUID="cf6c1371-8fc2-4017-b5b2-510b4707b61e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused"
Oct 30 22:29:54.851634 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:54.851595    4918 patch_prober.go:29] interesting pod/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused" start-of-body=
Oct 30 22:29:54.852087 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:54.851675    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8" podUID="cf6c1371-8fc2-4017-b5b2-510b4707b61e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused"
Oct 30 22:29:55.852439 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:55.852403    4918 patch_prober.go:29] interesting pod/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused" start-of-body=
Oct 30 22:29:55.852848 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:55.852464    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8" podUID="cf6c1371-8fc2-4017-b5b2-510b4707b61e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.134:15021/healthz/ready\": dial tcp 10.132.0.134:15021: connect: connection refused"
Oct 30 22:29:56.855973 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:56.855938    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:29:56.856363 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:56.856230    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:29:56.856978 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:56.856960    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:29:57.012828 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:29:57.012783    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:01.944066 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:01.943970    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:02.158059 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:30:02.158025    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:30:06.825804 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:06.825765    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:11.716402 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:11.716365    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:14.373897 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:14.373861    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:14.663272 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:14.663219    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:16.613956 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:16.613906    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:21.506777 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:21.506741    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:26.186218 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:26.186183    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:26.758945 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:26.758915    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:28.797767 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:28.797729    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:29.142285 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:29.142250    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:31.611583 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:31.611546    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:32.158537 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:30:32.158502    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:30:36.453064 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:36.453021    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:37.827038 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:37.827002    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:39.526950 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:39.526909    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:39.815293 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:39.815204    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:41.411795 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:41.411753    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:46.317903 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:46.317870    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:50.782410 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:50.782370    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:51.262365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:51.262319    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:56.078238 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:30:56.078201    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:01.053051 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:31:01.052993    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:02.159407 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:31:02.159371    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:31:05.926390 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:31:05.926346    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:10.812116 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:31:10.812056    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:11.315834 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:31:11.315791    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:15.736210 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:31:15.736177    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:20.616662 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:31:20.616623    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:25.600241 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:31:25.600177    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:29.165939 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:31:29.165897    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:30.719490 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:31:30.719388    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:32.157424 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:31:32.157388    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:31:35.627749 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:31:35.627718    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:40.537123 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:31:40.537090    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:45.486609 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:31:45.486572    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:50.316201 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:31:50.316160    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:55.220138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:31:55.220104    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:00.163241 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:32:00.163198    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:02.158222 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:32:02.158184    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:32:05.023709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:32:05.023662    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:09.927608 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:32:09.927568    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:14.825339 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:32:14.825288    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:19.730235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:32:19.730196    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:24.640942 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:32:24.640903    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:29.495789 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:32:29.495750    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:29.782641 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:32:29.782549    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:32.157917 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:32:32.157881    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:32:34.464476 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:32:34.464446    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:39.316788 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:32:39.316751    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:44.164530 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:32:44.164496    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:49.008055 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:32:49.008016    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:53.798827 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:32:53.798796    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:58.603477 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:32:58.603435    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:02.158859 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:33:02.158774    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:33:03.518071 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:03.518026    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:08.399974 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:08.399934    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:13.316884 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:13.316831    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:16.178889 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:16.178854    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:18.305969 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:18.305929    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:23.206527 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:23.206485    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:28.043917 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:28.043883    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:29.846554 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:29.846512    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:32.157476 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:33:32.157436    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:33:32.966024 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:32.965977    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:37.714015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:37.713970    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:42.605316 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:42.605281    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:47.430241 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:47.430196    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:52.331141 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:52.331105    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:56.255498 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:56.255463    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"]
Oct 30 22:33:56.397607 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:56.397573    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:57.339375 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:57.339343    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:57.623933 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:33:57.623841    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:02.157318 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:34:02.157277    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:34:02.587517 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:02.587430    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:07.253943 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:07.253897    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:07.542393 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:07.542308    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:07.783036 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:07.782993    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:08.017889 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:08.017856    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:11.278474 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.278429    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t" podUID="aeb7445e-8468-474e-be2d-4b67b15e7a2a" containerName="main" containerID="cri-o://23ddde33c6887105bc7197f0b846c9b589fcebafc0304f41e5f8167813104f60" gracePeriod=45
Oct 30 22:34:11.529635 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.529569    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:34:11.642478 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.642447    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-model-cache\") pod \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") "
Oct 30 22:34:11.642478 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.642483    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-home\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-home\") pod \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") "
Oct 30 22:34:11.642752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.642508    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aeb7445e-8468-474e-be2d-4b67b15e7a2a-tls-certs\" (UniqueName: \"kubernetes.io/secret/aeb7445e-8468-474e-be2d-4b67b15e7a2a-tls-certs\") pod \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") "
Oct 30 22:34:11.642752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.642593    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aeb7445e-8468-474e-be2d-4b67b15e7a2a-kube-api-access-2x6pr\" (UniqueName: \"kubernetes.io/projected/aeb7445e-8468-474e-be2d-4b67b15e7a2a-kube-api-access-2x6pr\") pod \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") "
Oct 30 22:34:11.642752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.642649    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-dshm\") pod \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") "
Oct 30 22:34:11.642752 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.642669    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-tmp-dir\") pod \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\" (UID: \"aeb7445e-8468-474e-be2d-4b67b15e7a2a\") "
Oct 30 22:34:11.642993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.642800    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-home" pod "aeb7445e-8468-474e-be2d-4b67b15e7a2a" (UID: "aeb7445e-8468-474e-be2d-4b67b15e7a2a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:34:11.642993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.642824    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-model-cache" pod "aeb7445e-8468-474e-be2d-4b67b15e7a2a" (UID: "aeb7445e-8468-474e-be2d-4b67b15e7a2a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:34:11.642993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.642967    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-tmp-dir" pod "aeb7445e-8468-474e-be2d-4b67b15e7a2a" (UID: "aeb7445e-8468-474e-be2d-4b67b15e7a2a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:34:11.643197 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.643179    4918 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-model-cache\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:11.643285 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.643200    4918 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-home\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:11.643285 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.643227    4918 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-tmp-dir\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:11.645065 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.645043    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeb7445e-8468-474e-be2d-4b67b15e7a2a-tls-certs" pod "aeb7445e-8468-474e-be2d-4b67b15e7a2a" (UID: "aeb7445e-8468-474e-be2d-4b67b15e7a2a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:34:11.645065 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.645052    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-dshm" pod "aeb7445e-8468-474e-be2d-4b67b15e7a2a" (UID: "aeb7445e-8468-474e-be2d-4b67b15e7a2a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:34:11.645202 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.645105    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeb7445e-8468-474e-be2d-4b67b15e7a2a-kube-api-access-2x6pr" pod "aeb7445e-8468-474e-be2d-4b67b15e7a2a" (UID: "aeb7445e-8468-474e-be2d-4b67b15e7a2a"). InnerVolumeSpecName "kube-api-access-2x6pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:34:11.744091 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.744057    4918 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeb7445e-8468-474e-be2d-4b67b15e7a2a-dshm\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:11.744091 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.744083    4918 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeb7445e-8468-474e-be2d-4b67b15e7a2a-tls-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:11.744091 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.744093    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x6pr\" (UniqueName: \"kubernetes.io/projected/aeb7445e-8468-474e-be2d-4b67b15e7a2a-kube-api-access-2x6pr\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:11.746877 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.746847    4918 generic.go:356] "Generic (PLEG): container finished" podID="aeb7445e-8468-474e-be2d-4b67b15e7a2a" containerID="23ddde33c6887105bc7197f0b846c9b589fcebafc0304f41e5f8167813104f60" exitCode=0
Oct 30 22:34:11.746989 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.746891    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"
Oct 30 22:34:11.746989 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.746917    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t" event={"ID":"aeb7445e-8468-474e-be2d-4b67b15e7a2a","Type":"ContainerDied","Data":"23ddde33c6887105bc7197f0b846c9b589fcebafc0304f41e5f8167813104f60"}
Oct 30 22:34:11.746989 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.746954    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t" event={"ID":"aeb7445e-8468-474e-be2d-4b67b15e7a2a","Type":"ContainerDied","Data":"8650d334a717547400965e5887f0b3a8ed1629287b5dc7523612a9ec014102f0"}
Oct 30 22:34:11.746989 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.746972    4918 scope.go:122] "RemoveContainer" containerID="23ddde33c6887105bc7197f0b846c9b589fcebafc0304f41e5f8167813104f60"
Oct 30 22:34:11.756953 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.756933    4918 scope.go:122] "RemoveContainer" containerID="23ddde33c6887105bc7197f0b846c9b589fcebafc0304f41e5f8167813104f60"
Oct 30 22:34:11.757223 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:34:11.757202    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23ddde33c6887105bc7197f0b846c9b589fcebafc0304f41e5f8167813104f60\": container with ID starting with 23ddde33c6887105bc7197f0b846c9b589fcebafc0304f41e5f8167813104f60 not found: ID does not exist" containerID="23ddde33c6887105bc7197f0b846c9b589fcebafc0304f41e5f8167813104f60"
Oct 30 22:34:11.757293 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.757233    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23ddde33c6887105bc7197f0b846c9b589fcebafc0304f41e5f8167813104f60"} err="failed to get container status \"23ddde33c6887105bc7197f0b846c9b589fcebafc0304f41e5f8167813104f60\": rpc error: code = NotFound desc = could not find container \"23ddde33c6887105bc7197f0b846c9b589fcebafc0304f41e5f8167813104f60\": container with ID starting with 23ddde33c6887105bc7197f0b846c9b589fcebafc0304f41e5f8167813104f60 not found: ID does not exist"
Oct 30 22:34:11.911161 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.911128    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"]
Oct 30 22:34:11.913219 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:11.913189    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-32dd8d/test-model-32dd8d-kserve-6b95df8fd9-7p82t"]
Oct 30 22:34:12.073241 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:12.073209    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aeb7445e-8468-474e-be2d-4b67b15e7a2a" path="/var/lib/kubelet/pods/aeb7445e-8468-474e-be2d-4b67b15e7a2a/volumes"
Oct 30 22:34:12.316650 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:12.316566    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:13.307087 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:13.307041    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"]
Oct 30 22:34:13.307284 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:13.307258    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" podUID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" containerName="istio-proxy" containerID="cri-o://657b43c2c5a5f5d4153ed6d6739a46ccd535fddaf690b230be2c5c7703a8148f" gracePeriod=30
Oct 30 22:34:17.154749 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:17.154670    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:18.568142 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.568121    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:34:18.607860 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.607802    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-workload-socket\") pod \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") "
Oct 30 22:34:18.607860 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.607835    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-workload-certs\") pod \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") "
Oct 30 22:34:18.607860 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.607858    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4ac242a8-aab1-4e8b-83fd-5c25425d417a-kube-api-access-7gvnq\" (UniqueName: \"kubernetes.io/projected/4ac242a8-aab1-4e8b-83fd-5c25425d417a-kube-api-access-7gvnq\") pod \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") "
Oct 30 22:34:18.608070 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.607887    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istiod-ca-cert\") pod \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") "
Oct 30 22:34:18.608070 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.607946    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-credential-socket\") pod \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") "
Oct 30 22:34:18.608070 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.607996    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-envoy\") pod \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") "
Oct 30 22:34:18.608070 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.608017    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-token\" (UniqueName: \"kubernetes.io/projected/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-token\") pod \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") "
Oct 30 22:34:18.608070 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.608054    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-data\") pod \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") "
Oct 30 22:34:18.608322 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.608085    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-podinfo\") pod \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\" (UID: \"4ac242a8-aab1-4e8b-83fd-5c25425d417a\") "
Oct 30 22:34:18.608378 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.608079    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-workload-socket" pod "4ac242a8-aab1-4e8b-83fd-5c25425d417a" (UID: "4ac242a8-aab1-4e8b-83fd-5c25425d417a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:34:18.608432 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.608107    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-workload-certs" pod "4ac242a8-aab1-4e8b-83fd-5c25425d417a" (UID: "4ac242a8-aab1-4e8b-83fd-5c25425d417a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:34:18.608432 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.608264    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-credential-socket" pod "4ac242a8-aab1-4e8b-83fd-5c25425d417a" (UID: "4ac242a8-aab1-4e8b-83fd-5c25425d417a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:34:18.608432 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.608338    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-data" pod "4ac242a8-aab1-4e8b-83fd-5c25425d417a" (UID: "4ac242a8-aab1-4e8b-83fd-5c25425d417a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:34:18.608578 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.608555    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istiod-ca-cert" pod "4ac242a8-aab1-4e8b-83fd-5c25425d417a" (UID: "4ac242a8-aab1-4e8b-83fd-5c25425d417a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:34:18.608703 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.608662    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:18.608765 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.608713    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:18.608765 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.608730    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:18.608765 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.608744    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:18.608765 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.608759    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:18.610208 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.610186    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-token" pod "4ac242a8-aab1-4e8b-83fd-5c25425d417a" (UID: "4ac242a8-aab1-4e8b-83fd-5c25425d417a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:34:18.610380 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.610361    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-podinfo" pod "4ac242a8-aab1-4e8b-83fd-5c25425d417a" (UID: "4ac242a8-aab1-4e8b-83fd-5c25425d417a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:34:18.610693 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.610658    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-envoy" pod "4ac242a8-aab1-4e8b-83fd-5c25425d417a" (UID: "4ac242a8-aab1-4e8b-83fd-5c25425d417a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:34:18.610772 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.610735    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ac242a8-aab1-4e8b-83fd-5c25425d417a-kube-api-access-7gvnq" pod "4ac242a8-aab1-4e8b-83fd-5c25425d417a" (UID: "4ac242a8-aab1-4e8b-83fd-5c25425d417a"). InnerVolumeSpecName "kube-api-access-7gvnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:34:18.709919 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.709889    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gvnq\" (UniqueName: \"kubernetes.io/projected/4ac242a8-aab1-4e8b-83fd-5c25425d417a-kube-api-access-7gvnq\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:18.709919 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.709918    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:18.710105 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.709938    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:18.710105 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.709951    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ac242a8-aab1-4e8b-83fd-5c25425d417a-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:18.788602 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.788570    4918 generic.go:356] "Generic (PLEG): container finished" podID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" containerID="657b43c2c5a5f5d4153ed6d6739a46ccd535fddaf690b230be2c5c7703a8148f" exitCode=0
Oct 30 22:34:18.788773 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.788659    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" event={"ID":"4ac242a8-aab1-4e8b-83fd-5c25425d417a","Type":"ContainerDied","Data":"657b43c2c5a5f5d4153ed6d6739a46ccd535fddaf690b230be2c5c7703a8148f"}
Oct 30 22:34:18.788773 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.788673    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"
Oct 30 22:34:18.788773 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.788714    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc" event={"ID":"4ac242a8-aab1-4e8b-83fd-5c25425d417a","Type":"ContainerDied","Data":"1ae728e22f400ba04f9afcbd4df24f775bada7470bf8e67a7f5ffd46615d7c95"}
Oct 30 22:34:18.788773 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.788735    4918 scope.go:122] "RemoveContainer" containerID="657b43c2c5a5f5d4153ed6d6739a46ccd535fddaf690b230be2c5c7703a8148f"
Oct 30 22:34:18.802626 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.802600    4918 scope.go:122] "RemoveContainer" containerID="657b43c2c5a5f5d4153ed6d6739a46ccd535fddaf690b230be2c5c7703a8148f"
Oct 30 22:34:18.802955 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:34:18.802930    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"657b43c2c5a5f5d4153ed6d6739a46ccd535fddaf690b230be2c5c7703a8148f\": container with ID starting with 657b43c2c5a5f5d4153ed6d6739a46ccd535fddaf690b230be2c5c7703a8148f not found: ID does not exist" containerID="657b43c2c5a5f5d4153ed6d6739a46ccd535fddaf690b230be2c5c7703a8148f"
Oct 30 22:34:18.803018 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.802963    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"657b43c2c5a5f5d4153ed6d6739a46ccd535fddaf690b230be2c5c7703a8148f"} err="failed to get container status \"657b43c2c5a5f5d4153ed6d6739a46ccd535fddaf690b230be2c5c7703a8148f\": rpc error: code = NotFound desc = could not find container \"657b43c2c5a5f5d4153ed6d6739a46ccd535fddaf690b230be2c5c7703a8148f\": container with ID starting with 657b43c2c5a5f5d4153ed6d6739a46ccd535fddaf690b230be2c5c7703a8148f not found: ID does not exist"
Oct 30 22:34:18.952256 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.952233    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"]
Oct 30 22:34:18.956930 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:18.956908    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-dwtrc"]
Oct 30 22:34:19.873162 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:19.873127    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:20.072723 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:20.072670    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" path="/var/lib/kubelet/pods/4ac242a8-aab1-4e8b-83fd-5c25425d417a/volumes"
Oct 30 22:34:22.225014 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:22.224974    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:22.437113 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:22.437091    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:34:22.465717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:22.465673    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:34:27.376089 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:27.376050    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:30.251556 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:30.251476    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:31.296735 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:31.296701    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:31.574467 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:31.574372    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:32.158277 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:34:32.158239    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:34:32.524185 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:32.524033    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:37.530852 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:37.530811    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:42.620320 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:42.620274    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:46.748827 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:46.748789    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"]
Oct 30 22:34:46.749475 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:46.749013    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v" podUID="131996b0-d9f3-4da0-86a7-c998ebd3407f" containerName="maas-api" containerID="cri-o://ab026f83c78e966814cb7e3cdabd1d182bb5f251dff31aa1e356ac4eb325848c" gracePeriod=30
Oct 30 22:34:46.951665 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:46.951625    4918 generic.go:356] "Generic (PLEG): container finished" podID="131996b0-d9f3-4da0-86a7-c998ebd3407f" containerID="ab026f83c78e966814cb7e3cdabd1d182bb5f251dff31aa1e356ac4eb325848c" exitCode=0
Oct 30 22:34:46.951839 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:46.951816    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v" event={"ID":"131996b0-d9f3-4da0-86a7-c998ebd3407f","Type":"ContainerDied","Data":"ab026f83c78e966814cb7e3cdabd1d182bb5f251dff31aa1e356ac4eb325848c"}
Oct 30 22:34:46.989642 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:46.989606    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:47.016076 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.016021    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:34:47.087329 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.087298    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-maas-api-tls\") pod \"131996b0-d9f3-4da0-86a7-c998ebd3407f\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") "
Oct 30 22:34:47.087454 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.087335    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/131996b0-d9f3-4da0-86a7-c998ebd3407f-kube-api-access-fhv78\" (UniqueName: \"kubernetes.io/projected/131996b0-d9f3-4da0-86a7-c998ebd3407f-kube-api-access-fhv78\") pod \"131996b0-d9f3-4da0-86a7-c998ebd3407f\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") "
Oct 30 22:34:47.087454 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.087383    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/131996b0-d9f3-4da0-86a7-c998ebd3407f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/131996b0-d9f3-4da0-86a7-c998ebd3407f-openshift-service-ca\") pod \"131996b0-d9f3-4da0-86a7-c998ebd3407f\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") "
Oct 30 22:34:47.087546 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.087461    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-metrics-certs\") pod \"131996b0-d9f3-4da0-86a7-c998ebd3407f\" (UID: \"131996b0-d9f3-4da0-86a7-c998ebd3407f\") "
Oct 30 22:34:47.087867 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.087844    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/131996b0-d9f3-4da0-86a7-c998ebd3407f-openshift-service-ca" pod "131996b0-d9f3-4da0-86a7-c998ebd3407f" (UID: "131996b0-d9f3-4da0-86a7-c998ebd3407f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:34:47.088124 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.087917    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/131996b0-d9f3-4da0-86a7-c998ebd3407f-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:47.089560 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.089531    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-maas-api-tls" pod "131996b0-d9f3-4da0-86a7-c998ebd3407f" (UID: "131996b0-d9f3-4da0-86a7-c998ebd3407f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:34:47.089652 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.089566    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-metrics-certs" pod "131996b0-d9f3-4da0-86a7-c998ebd3407f" (UID: "131996b0-d9f3-4da0-86a7-c998ebd3407f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:34:47.089652 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.089591    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/131996b0-d9f3-4da0-86a7-c998ebd3407f-kube-api-access-fhv78" pod "131996b0-d9f3-4da0-86a7-c998ebd3407f" (UID: "131996b0-d9f3-4da0-86a7-c998ebd3407f"). InnerVolumeSpecName "kube-api-access-fhv78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:34:47.189241 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.189208    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:47.189241 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.189237    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/131996b0-d9f3-4da0-86a7-c998ebd3407f-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:47.189241 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.189248    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhv78\" (UniqueName: \"kubernetes.io/projected/131996b0-d9f3-4da0-86a7-c998ebd3407f-kube-api-access-fhv78\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:47.936550 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.936513    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"]
Oct 30 22:34:47.937013 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.936739    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d" podUID="001d2e93-a0fb-4b18-9380-d3adacd51379" containerName="maas-api" containerID="cri-o://f343ec6425f8a8397363e5643c613eb8c4453b6c53164758260d9e63e6e645f3" gracePeriod=30
Oct 30 22:34:47.958221 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.958193    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"
Oct 30 22:34:47.958310 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.958213    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v" event={"ID":"131996b0-d9f3-4da0-86a7-c998ebd3407f","Type":"ContainerDied","Data":"f0e696196ff41b8e61ff811adc7585afb64d1d621a5ab12b8ccc20a9ea979a38"}
Oct 30 22:34:47.958310 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:47.958274    4918 scope.go:122] "RemoveContainer" containerID="ab026f83c78e966814cb7e3cdabd1d182bb5f251dff31aa1e356ac4eb325848c"
Oct 30 22:34:48.181923 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.181875    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"]
Oct 30 22:34:48.183775 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.183750    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:48.184143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.184124    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-87b6b3-6cf55776db-8mm7v"]
Oct 30 22:34:48.205521 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.205501    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:34:48.301615 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.301589    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-maas-api-tls\") pod \"001d2e93-a0fb-4b18-9380-d3adacd51379\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") "
Oct 30 22:34:48.301773 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.301622    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-metrics-certs\" (UniqueName: \"kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-metrics-certs\") pod \"001d2e93-a0fb-4b18-9380-d3adacd51379\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") "
Oct 30 22:34:48.301773 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.301644    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/001d2e93-a0fb-4b18-9380-d3adacd51379-kube-api-access-x9dv5\" (UniqueName: \"kubernetes.io/projected/001d2e93-a0fb-4b18-9380-d3adacd51379-kube-api-access-x9dv5\") pod \"001d2e93-a0fb-4b18-9380-d3adacd51379\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") "
Oct 30 22:34:48.301773 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.301717    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/001d2e93-a0fb-4b18-9380-d3adacd51379-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/001d2e93-a0fb-4b18-9380-d3adacd51379-openshift-service-ca\") pod \"001d2e93-a0fb-4b18-9380-d3adacd51379\" (UID: \"001d2e93-a0fb-4b18-9380-d3adacd51379\") "
Oct 30 22:34:48.302134 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.302112    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/001d2e93-a0fb-4b18-9380-d3adacd51379-openshift-service-ca" pod "001d2e93-a0fb-4b18-9380-d3adacd51379" (UID: "001d2e93-a0fb-4b18-9380-d3adacd51379"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:34:48.303912 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.303888    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-maas-api-tls" pod "001d2e93-a0fb-4b18-9380-d3adacd51379" (UID: "001d2e93-a0fb-4b18-9380-d3adacd51379"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:34:48.304005 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.303962    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-metrics-certs" pod "001d2e93-a0fb-4b18-9380-d3adacd51379" (UID: "001d2e93-a0fb-4b18-9380-d3adacd51379"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:34:48.304005 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.303972    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/001d2e93-a0fb-4b18-9380-d3adacd51379-kube-api-access-x9dv5" pod "001d2e93-a0fb-4b18-9380-d3adacd51379" (UID: "001d2e93-a0fb-4b18-9380-d3adacd51379"). InnerVolumeSpecName "kube-api-access-x9dv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:34:48.403066 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.403032    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:48.403066 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.403063    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/001d2e93-a0fb-4b18-9380-d3adacd51379-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:48.403275 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.403077    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9dv5\" (UniqueName: \"kubernetes.io/projected/001d2e93-a0fb-4b18-9380-d3adacd51379-kube-api-access-x9dv5\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:48.403275 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.403091    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/001d2e93-a0fb-4b18-9380-d3adacd51379-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:34:48.563978 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.563886    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:48.881600 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.881518    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:48.964816 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.964787    4918 generic.go:356] "Generic (PLEG): container finished" podID="001d2e93-a0fb-4b18-9380-d3adacd51379" containerID="f343ec6425f8a8397363e5643c613eb8c4453b6c53164758260d9e63e6e645f3" exitCode=0
Oct 30 22:34:48.965283 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.964849    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"
Oct 30 22:34:48.965283 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.964875    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d" event={"ID":"001d2e93-a0fb-4b18-9380-d3adacd51379","Type":"ContainerDied","Data":"f343ec6425f8a8397363e5643c613eb8c4453b6c53164758260d9e63e6e645f3"}
Oct 30 22:34:48.965283 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.964964    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d" event={"ID":"001d2e93-a0fb-4b18-9380-d3adacd51379","Type":"ContainerDied","Data":"66043227fcb455a8abe22a85d0ac5d43ebc977e327ac0d6c1cd7e59b2eff9259"}
Oct 30 22:34:48.965283 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.964991    4918 scope.go:122] "RemoveContainer" containerID="f343ec6425f8a8397363e5643c613eb8c4453b6c53164758260d9e63e6e645f3"
Oct 30 22:34:48.975435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.975418    4918 scope.go:122] "RemoveContainer" containerID="f343ec6425f8a8397363e5643c613eb8c4453b6c53164758260d9e63e6e645f3"
Oct 30 22:34:48.975749 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:34:48.975723    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f343ec6425f8a8397363e5643c613eb8c4453b6c53164758260d9e63e6e645f3\": container with ID starting with f343ec6425f8a8397363e5643c613eb8c4453b6c53164758260d9e63e6e645f3 not found: ID does not exist" containerID="f343ec6425f8a8397363e5643c613eb8c4453b6c53164758260d9e63e6e645f3"
Oct 30 22:34:48.975819 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:48.975763    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f343ec6425f8a8397363e5643c613eb8c4453b6c53164758260d9e63e6e645f3"} err="failed to get container status \"f343ec6425f8a8397363e5643c613eb8c4453b6c53164758260d9e63e6e645f3\": rpc error: code = NotFound desc = could not find container \"f343ec6425f8a8397363e5643c613eb8c4453b6c53164758260d9e63e6e645f3\": container with ID starting with f343ec6425f8a8397363e5643c613eb8c4453b6c53164758260d9e63e6e645f3 not found: ID does not exist"
Oct 30 22:34:49.150545 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:49.150514    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"]
Oct 30 22:34:49.199865 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:49.199838    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-026c11-6576654955-29c9d"]
Oct 30 22:34:49.675749 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:49.675706    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:49.933837 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:49.933765    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:50.081342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:50.081306    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="001d2e93-a0fb-4b18-9380-d3adacd51379" path="/var/lib/kubelet/pods/001d2e93-a0fb-4b18-9380-d3adacd51379/volumes"
Oct 30 22:34:50.081916 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:50.081850    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="131996b0-d9f3-4da0-86a7-c998ebd3407f" path="/var/lib/kubelet/pods/131996b0-d9f3-4da0-86a7-c998ebd3407f/volumes"
Oct 30 22:34:50.187569 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:50.187511    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:50.929784 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:50.929751    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:54.004233 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:54.004196    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:55.623473 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:55.623440    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:55.883337 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:55.883257    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:56.197993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:56.197958    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:57.787081 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:57.787041    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:58.039069 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:58.038984    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:58.272120 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:34:58.272086    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:00.829976 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:00.829940    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:02.159653 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:35:02.159618    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:35:05.909116 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:05.909047    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:07.904651 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:07.904618    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:08.151984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:08.151954    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:10.419283 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:10.419240    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:10.716148 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:10.716058    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:10.959272 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:10.959220    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:15.774974 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:15.774931    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:19.824765 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:19.824728    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"]
Oct 30 22:35:19.825413 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:19.824962    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl" podUID="29baa21c-a90a-44d3-815d-595c1dc1b14f" containerName="maas-api" containerID="cri-o://efb3851e11cbec27c22f27f84bf24c2766fdb5a97969b0302ffd37fac469970f" gracePeriod=30
Oct 30 22:35:20.008836 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.008800    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:20.084076 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.084018    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:35:20.129172 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.129141    4918 generic.go:356] "Generic (PLEG): container finished" podID="29baa21c-a90a-44d3-815d-595c1dc1b14f" containerID="efb3851e11cbec27c22f27f84bf24c2766fdb5a97969b0302ffd37fac469970f" exitCode=0
Oct 30 22:35:20.129314 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.129184    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"
Oct 30 22:35:20.129314 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.129196    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl" event={"ID":"29baa21c-a90a-44d3-815d-595c1dc1b14f","Type":"ContainerDied","Data":"efb3851e11cbec27c22f27f84bf24c2766fdb5a97969b0302ffd37fac469970f"}
Oct 30 22:35:20.129314 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.129230    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl" event={"ID":"29baa21c-a90a-44d3-815d-595c1dc1b14f","Type":"ContainerDied","Data":"8523b1397f65b7dce9b57a24ef7fb508ecf84cdc22f7e35477ecada74c703a6d"}
Oct 30 22:35:20.129314 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.129251    4918 scope.go:122] "RemoveContainer" containerID="efb3851e11cbec27c22f27f84bf24c2766fdb5a97969b0302ffd37fac469970f"
Oct 30 22:35:20.138152 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.138135    4918 scope.go:122] "RemoveContainer" containerID="efb3851e11cbec27c22f27f84bf24c2766fdb5a97969b0302ffd37fac469970f"
Oct 30 22:35:20.138423 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:35:20.138405    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efb3851e11cbec27c22f27f84bf24c2766fdb5a97969b0302ffd37fac469970f\": container with ID starting with efb3851e11cbec27c22f27f84bf24c2766fdb5a97969b0302ffd37fac469970f not found: ID does not exist" containerID="efb3851e11cbec27c22f27f84bf24c2766fdb5a97969b0302ffd37fac469970f"
Oct 30 22:35:20.138481 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.138432    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efb3851e11cbec27c22f27f84bf24c2766fdb5a97969b0302ffd37fac469970f"} err="failed to get container status \"efb3851e11cbec27c22f27f84bf24c2766fdb5a97969b0302ffd37fac469970f\": rpc error: code = NotFound desc = could not find container \"efb3851e11cbec27c22f27f84bf24c2766fdb5a97969b0302ffd37fac469970f\": container with ID starting with efb3851e11cbec27c22f27f84bf24c2766fdb5a97969b0302ffd37fac469970f not found: ID does not exist"
Oct 30 22:35:20.229473 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.229435    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-maas-api-tls\") pod \"29baa21c-a90a-44d3-815d-595c1dc1b14f\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") "
Oct 30 22:35:20.229643 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.229535    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-metrics-certs\") pod \"29baa21c-a90a-44d3-815d-595c1dc1b14f\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") "
Oct 30 22:35:20.229643 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.229565    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29baa21c-a90a-44d3-815d-595c1dc1b14f-kube-api-access-z47vb\" (UniqueName: \"kubernetes.io/projected/29baa21c-a90a-44d3-815d-595c1dc1b14f-kube-api-access-z47vb\") pod \"29baa21c-a90a-44d3-815d-595c1dc1b14f\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") "
Oct 30 22:35:20.229643 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.229595    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/29baa21c-a90a-44d3-815d-595c1dc1b14f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29baa21c-a90a-44d3-815d-595c1dc1b14f-openshift-service-ca\") pod \"29baa21c-a90a-44d3-815d-595c1dc1b14f\" (UID: \"29baa21c-a90a-44d3-815d-595c1dc1b14f\") "
Oct 30 22:35:20.230056 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.230036    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29baa21c-a90a-44d3-815d-595c1dc1b14f-openshift-service-ca" pod "29baa21c-a90a-44d3-815d-595c1dc1b14f" (UID: "29baa21c-a90a-44d3-815d-595c1dc1b14f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:35:20.231812 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.231784    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-maas-api-tls" pod "29baa21c-a90a-44d3-815d-595c1dc1b14f" (UID: "29baa21c-a90a-44d3-815d-595c1dc1b14f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:35:20.231915 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.231825    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-metrics-certs" pod "29baa21c-a90a-44d3-815d-595c1dc1b14f" (UID: "29baa21c-a90a-44d3-815d-595c1dc1b14f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:35:20.232308 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.232290    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29baa21c-a90a-44d3-815d-595c1dc1b14f-kube-api-access-z47vb" pod "29baa21c-a90a-44d3-815d-595c1dc1b14f" (UID: "29baa21c-a90a-44d3-815d-595c1dc1b14f"). InnerVolumeSpecName "kube-api-access-z47vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:20.330614 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.330579    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/29baa21c-a90a-44d3-815d-595c1dc1b14f-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:20.330614 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.330608    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:20.330614 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.330618    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29baa21c-a90a-44d3-815d-595c1dc1b14f-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:20.330883 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.330627    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z47vb\" (UniqueName: \"kubernetes.io/projected/29baa21c-a90a-44d3-815d-595c1dc1b14f-kube-api-access-z47vb\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:20.550527 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.550493    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"]
Oct 30 22:35:20.554707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:20.554664    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c04440-7c4d964bf6-bdgfl"]
Oct 30 22:35:21.582019 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:21.581980    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:21.846374 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:21.846291    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:22.072175 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:22.072145    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="29baa21c-a90a-44d3-815d-595c1dc1b14f" path="/var/lib/kubelet/pods/29baa21c-a90a-44d3-815d-595c1dc1b14f/volumes"
Oct 30 22:35:22.088108 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:22.088080    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:22.517993 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:22.517953    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:26.240871 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:26.240835    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"]
Oct 30 22:35:26.241279 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:26.241012    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g" podUID="40d4d570-e10e-4be3-955f-36e0e1872fd3" containerName="maas-api" containerID="cri-o://c10f815858ba7a072275d097ea36506d6a548d071b092700c52c9b33b05e955b" gracePeriod=30
Oct 30 22:35:26.438400 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:26.438370    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:26.508272 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:26.508244    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:35:26.589803 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:26.589772    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/40d4d570-e10e-4be3-955f-36e0e1872fd3-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40d4d570-e10e-4be3-955f-36e0e1872fd3-openshift-service-ca\") pod \"40d4d570-e10e-4be3-955f-36e0e1872fd3\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") "
Oct 30 22:35:26.589943 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:26.589858    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-maas-api-tls\") pod \"40d4d570-e10e-4be3-955f-36e0e1872fd3\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") "
Oct 30 22:35:26.589943 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:26.589916    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/40d4d570-e10e-4be3-955f-36e0e1872fd3-kube-api-access-5h9bt\" (UniqueName: \"kubernetes.io/projected/40d4d570-e10e-4be3-955f-36e0e1872fd3-kube-api-access-5h9bt\") pod \"40d4d570-e10e-4be3-955f-36e0e1872fd3\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") "
Oct 30 22:35:26.590025 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:26.589959    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-metrics-certs\" (UniqueName: \"kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-metrics-certs\") pod \"40d4d570-e10e-4be3-955f-36e0e1872fd3\" (UID: \"40d4d570-e10e-4be3-955f-36e0e1872fd3\") "
Oct 30 22:35:26.590193 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:26.590169    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40d4d570-e10e-4be3-955f-36e0e1872fd3-openshift-service-ca" pod "40d4d570-e10e-4be3-955f-36e0e1872fd3" (UID: "40d4d570-e10e-4be3-955f-36e0e1872fd3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:35:26.590367 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:26.590350    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40d4d570-e10e-4be3-955f-36e0e1872fd3-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:26.592129 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:26.592106    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-maas-api-tls" pod "40d4d570-e10e-4be3-955f-36e0e1872fd3" (UID: "40d4d570-e10e-4be3-955f-36e0e1872fd3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:35:26.592235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:26.592151    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-metrics-certs" pod "40d4d570-e10e-4be3-955f-36e0e1872fd3" (UID: "40d4d570-e10e-4be3-955f-36e0e1872fd3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:35:26.592235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:26.592206    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40d4d570-e10e-4be3-955f-36e0e1872fd3-kube-api-access-5h9bt" pod "40d4d570-e10e-4be3-955f-36e0e1872fd3" (UID: "40d4d570-e10e-4be3-955f-36e0e1872fd3"). InnerVolumeSpecName "kube-api-access-5h9bt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:26.691557 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:26.691528    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:26.691557 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:26.691556    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h9bt\" (UniqueName: \"kubernetes.io/projected/40d4d570-e10e-4be3-955f-36e0e1872fd3-kube-api-access-5h9bt\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:26.691827 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:26.691569    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40d4d570-e10e-4be3-955f-36e0e1872fd3-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:27.179605 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:27.179565    4918 generic.go:356] "Generic (PLEG): container finished" podID="40d4d570-e10e-4be3-955f-36e0e1872fd3" containerID="c10f815858ba7a072275d097ea36506d6a548d071b092700c52c9b33b05e955b" exitCode=0
Oct 30 22:35:27.179931 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:27.179661    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g" event={"ID":"40d4d570-e10e-4be3-955f-36e0e1872fd3","Type":"ContainerDied","Data":"c10f815858ba7a072275d097ea36506d6a548d071b092700c52c9b33b05e955b"}
Oct 30 22:35:27.179931 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:27.179721    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"
Oct 30 22:35:27.179931 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:27.179751    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g" event={"ID":"40d4d570-e10e-4be3-955f-36e0e1872fd3","Type":"ContainerDied","Data":"8396b9683e351f5d1354baa0cf3b9330f510a5b470c035e06199fdbc2b3ed731"}
Oct 30 22:35:27.179931 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:27.179785    4918 scope.go:122] "RemoveContainer" containerID="c10f815858ba7a072275d097ea36506d6a548d071b092700c52c9b33b05e955b"
Oct 30 22:35:27.197565 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:27.197027    4918 scope.go:122] "RemoveContainer" containerID="c10f815858ba7a072275d097ea36506d6a548d071b092700c52c9b33b05e955b"
Oct 30 22:35:27.198078 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:35:27.197673    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c10f815858ba7a072275d097ea36506d6a548d071b092700c52c9b33b05e955b\": container with ID starting with c10f815858ba7a072275d097ea36506d6a548d071b092700c52c9b33b05e955b not found: ID does not exist" containerID="c10f815858ba7a072275d097ea36506d6a548d071b092700c52c9b33b05e955b"
Oct 30 22:35:27.198078 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:27.197728    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c10f815858ba7a072275d097ea36506d6a548d071b092700c52c9b33b05e955b"} err="failed to get container status \"c10f815858ba7a072275d097ea36506d6a548d071b092700c52c9b33b05e955b\": rpc error: code = NotFound desc = could not find container \"c10f815858ba7a072275d097ea36506d6a548d071b092700c52c9b33b05e955b\": container with ID starting with c10f815858ba7a072275d097ea36506d6a548d071b092700c52c9b33b05e955b not found: ID does not exist"
Oct 30 22:35:27.345710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:27.344912    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"]
Oct 30 22:35:27.393129 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:27.393100    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32dd8d-56cf848774-xc89g"]
Oct 30 22:35:28.032175 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:28.032143    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:28.071400 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:28.071359    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="40d4d570-e10e-4be3-955f-36e0e1872fd3" path="/var/lib/kubelet/pods/40d4d570-e10e-4be3-955f-36e0e1872fd3/volumes"
Oct 30 22:35:28.278415 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:28.278374    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:28.582110 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:28.582077    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:28.972922 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:28.972886    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:29.951331 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:29.951294    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:30.091937 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:30.091902    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"]
Oct 30 22:35:30.092499 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:30.092435    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8" podUID="cf6c1371-8fc2-4017-b5b2-510b4707b61e" containerName="istio-proxy" containerID="cri-o://ae4f80a2636b0d97648256f8343a18beb08405532a346e549d664f54869cab50" gracePeriod=30
Oct 30 22:35:30.225074 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:30.224985    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:30.471323 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:30.471286    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:30.734548 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:30.734507    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:32.157045 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:35:32.157007    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:35:33.854990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:33.854959    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:35.217076 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.217050    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:35.224154 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.224128    4918 generic.go:356] "Generic (PLEG): container finished" podID="cf6c1371-8fc2-4017-b5b2-510b4707b61e" containerID="ae4f80a2636b0d97648256f8343a18beb08405532a346e549d664f54869cab50" exitCode=0
Oct 30 22:35:35.224285 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.224201    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8" event={"ID":"cf6c1371-8fc2-4017-b5b2-510b4707b61e","Type":"ContainerDied","Data":"ae4f80a2636b0d97648256f8343a18beb08405532a346e549d664f54869cab50"}
Oct 30 22:35:35.224351 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.224280    4918 scope.go:122] "RemoveContainer" containerID="5f090793a2d5fe857c010d13650303617d5a13df82c434606891de468fa59926"
Oct 30 22:35:35.368888 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.368829    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:35:35.483153 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.483119    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf6c1371-8fc2-4017-b5b2-510b4707b61e-kube-api-access-x5pp5\" (UniqueName: \"kubernetes.io/projected/cf6c1371-8fc2-4017-b5b2-510b4707b61e-kube-api-access-x5pp5\") pod \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") "
Oct 30 22:35:35.483333 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.483190    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-envoy\") pod \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") "
Oct 30 22:35:35.483333 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.483221    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istiod-ca-cert\") pod \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") "
Oct 30 22:35:35.483333 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.483299    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-token\" (UniqueName: \"kubernetes.io/projected/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-token\") pod \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") "
Oct 30 22:35:35.483524 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.483339    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-workload-certs\") pod \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") "
Oct 30 22:35:35.483524 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.483391    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-data\") pod \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") "
Oct 30 22:35:35.483524 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.483420    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-workload-socket\") pod \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") "
Oct 30 22:35:35.483524 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.483453    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-podinfo\") pod \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") "
Oct 30 22:35:35.483524 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.483483    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-credential-socket\") pod \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\" (UID: \"cf6c1371-8fc2-4017-b5b2-510b4707b61e\") "
Oct 30 22:35:35.483832 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.483779    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-workload-certs" pod "cf6c1371-8fc2-4017-b5b2-510b4707b61e" (UID: "cf6c1371-8fc2-4017-b5b2-510b4707b61e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:35.484294 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.484015    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:35.484294 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.484257    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-data" pod "cf6c1371-8fc2-4017-b5b2-510b4707b61e" (UID: "cf6c1371-8fc2-4017-b5b2-510b4707b61e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:35.484475 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.484430    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-credential-socket" pod "cf6c1371-8fc2-4017-b5b2-510b4707b61e" (UID: "cf6c1371-8fc2-4017-b5b2-510b4707b61e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:35.485141 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.485112    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-workload-socket" pod "cf6c1371-8fc2-4017-b5b2-510b4707b61e" (UID: "cf6c1371-8fc2-4017-b5b2-510b4707b61e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:35.485308 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.485286    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istiod-ca-cert" pod "cf6c1371-8fc2-4017-b5b2-510b4707b61e" (UID: "cf6c1371-8fc2-4017-b5b2-510b4707b61e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:35:35.485817 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.485796    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-envoy" pod "cf6c1371-8fc2-4017-b5b2-510b4707b61e" (UID: "cf6c1371-8fc2-4017-b5b2-510b4707b61e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:35.486033 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.486009    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf6c1371-8fc2-4017-b5b2-510b4707b61e-kube-api-access-x5pp5" pod "cf6c1371-8fc2-4017-b5b2-510b4707b61e" (UID: "cf6c1371-8fc2-4017-b5b2-510b4707b61e"). InnerVolumeSpecName "kube-api-access-x5pp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:35.486519 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.486494    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-podinfo" pod "cf6c1371-8fc2-4017-b5b2-510b4707b61e" (UID: "cf6c1371-8fc2-4017-b5b2-510b4707b61e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:35:35.487162 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.487140    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-token" pod "cf6c1371-8fc2-4017-b5b2-510b4707b61e" (UID: "cf6c1371-8fc2-4017-b5b2-510b4707b61e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:35.517666 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.517639    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:35.585847 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.585812    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:35.585847 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.585846    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:35.586129 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.585864    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:35.586129 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.585877    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:35.586129 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.585893    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:35.586129 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.585907    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5pp5\" (UniqueName: \"kubernetes.io/projected/cf6c1371-8fc2-4017-b5b2-510b4707b61e-kube-api-access-x5pp5\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:35.586129 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.585921    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:35.586129 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.585941    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf6c1371-8fc2-4017-b5b2-510b4707b61e-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:35.629092 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.628956    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"]
Oct 30 22:35:35.932800 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:35.932765    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:36.230380 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:36.230306    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"
Oct 30 22:35:36.230380 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:36.230346    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8" event={"ID":"cf6c1371-8fc2-4017-b5b2-510b4707b61e","Type":"ContainerDied","Data":"92fbc42fb1f07dee43d8807451836354d73bae1422fc299f312cbf33a0de257c"}
Oct 30 22:35:36.230883 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:36.230413    4918 scope.go:122] "RemoveContainer" containerID="ae4f80a2636b0d97648256f8343a18beb08405532a346e549d664f54869cab50"
Oct 30 22:35:36.393397 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:36.393363    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"]
Oct 30 22:35:36.443222 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:36.443197    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c04440-openshift-default-56f9469d99-2t8h8"]
Oct 30 22:35:38.072099 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:38.072052    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf6c1371-8fc2-4017-b5b2-510b4707b61e" path="/var/lib/kubelet/pods/cf6c1371-8fc2-4017-b5b2-510b4707b61e/volumes"
Oct 30 22:35:38.953842 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:38.953803    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:42.101408 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:42.101378    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:42.395519 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:42.395486    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:44.011736 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:44.011701    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:46.913120 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:46.913085    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"]
Oct 30 22:35:47.312869 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:47.312789    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:47.625465 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:47.625363    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:48.163459 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.163429    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"]
Oct 30 22:35:48.163926 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.163615    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk" podUID="b3766273-8b07-490e-b256-34bfac3b0483" containerName="maas-api" containerID="cri-o://c66ab1e1ec24913832e3603dba1acf24cf23d60e947bd99af9c73981c1277890" gracePeriod=30
Oct 30 22:35:48.291663 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.291632    4918 generic.go:356] "Generic (PLEG): container finished" podID="b3766273-8b07-490e-b256-34bfac3b0483" containerID="c66ab1e1ec24913832e3603dba1acf24cf23d60e947bd99af9c73981c1277890" exitCode=0
Oct 30 22:35:48.291833 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.291736    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk" event={"ID":"b3766273-8b07-490e-b256-34bfac3b0483","Type":"ContainerDied","Data":"c66ab1e1ec24913832e3603dba1acf24cf23d60e947bd99af9c73981c1277890"}
Oct 30 22:35:48.354855 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.354826    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:48.438273 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.438235    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:35:48.511227 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.511191    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3766273-8b07-490e-b256-34bfac3b0483-kube-api-access-glkwk\" (UniqueName: \"kubernetes.io/projected/b3766273-8b07-490e-b256-34bfac3b0483-kube-api-access-glkwk\") pod \"b3766273-8b07-490e-b256-34bfac3b0483\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") "
Oct 30 22:35:48.511422 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.511254    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b3766273-8b07-490e-b256-34bfac3b0483-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3766273-8b07-490e-b256-34bfac3b0483-openshift-service-ca\") pod \"b3766273-8b07-490e-b256-34bfac3b0483\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") "
Oct 30 22:35:48.511501 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.511420    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-maas-api-tls\") pod \"b3766273-8b07-490e-b256-34bfac3b0483\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") "
Oct 30 22:35:48.511501 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.511463    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-metrics-certs\") pod \"b3766273-8b07-490e-b256-34bfac3b0483\" (UID: \"b3766273-8b07-490e-b256-34bfac3b0483\") "
Oct 30 22:35:48.511716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.511662    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3766273-8b07-490e-b256-34bfac3b0483-openshift-service-ca" pod "b3766273-8b07-490e-b256-34bfac3b0483" (UID: "b3766273-8b07-490e-b256-34bfac3b0483"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:35:48.511919 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.511897    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3766273-8b07-490e-b256-34bfac3b0483-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:48.513951 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.513913    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-metrics-certs" pod "b3766273-8b07-490e-b256-34bfac3b0483" (UID: "b3766273-8b07-490e-b256-34bfac3b0483"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:35:48.514142 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.514120    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3766273-8b07-490e-b256-34bfac3b0483-kube-api-access-glkwk" pod "b3766273-8b07-490e-b256-34bfac3b0483" (UID: "b3766273-8b07-490e-b256-34bfac3b0483"). InnerVolumeSpecName "kube-api-access-glkwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:48.514228 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.514143    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-maas-api-tls" pod "b3766273-8b07-490e-b256-34bfac3b0483" (UID: "b3766273-8b07-490e-b256-34bfac3b0483"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:35:48.612397 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.612364    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:48.612397 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.612389    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3766273-8b07-490e-b256-34bfac3b0483-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:48.612397 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:48.612401    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glkwk\" (UniqueName: \"kubernetes.io/projected/b3766273-8b07-490e-b256-34bfac3b0483-kube-api-access-glkwk\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:49.298807 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:49.298779    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"
Oct 30 22:35:49.298807 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:49.298786    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk" event={"ID":"b3766273-8b07-490e-b256-34bfac3b0483","Type":"ContainerDied","Data":"bae05c789519819cde67ab83f9b36e2c56d863e8cbd77fdb16670ec23a4bda64"}
Oct 30 22:35:49.299320 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:49.298859    4918 scope.go:122] "RemoveContainer" containerID="c66ab1e1ec24913832e3603dba1acf24cf23d60e947bd99af9c73981c1277890"
Oct 30 22:35:49.462957 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:49.462916    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"]
Oct 30 22:35:49.512513 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:49.512482    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w4-55beb8-79544cf689-ql5gk"]
Oct 30 22:35:50.072638 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.072605    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b3766273-8b07-490e-b256-34bfac3b0483" path="/var/lib/kubelet/pods/b3766273-8b07-490e-b256-34bfac3b0483/volumes"
Oct 30 22:35:50.327958 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.327879    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:50.649600 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.649563    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main" containerID="cri-o://fa2ce088a89a41ac53c9f67e9e1c82410590dfce2b6ed0b5de4c72cf14b8f7c9" gracePeriod=45
Oct 30 22:35:50.903124 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.903072    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:35:50.934252 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.934224    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/18bcad2c-343d-490f-9207-fd77e5dfe3aa-tls-certs\" (UniqueName: \"kubernetes.io/secret/18bcad2c-343d-490f-9207-fd77e5dfe3aa-tls-certs\") pod \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") "
Oct 30 22:35:50.934392 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.934325    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18bcad2c-343d-490f-9207-fd77e5dfe3aa-kube-api-access-9c965\" (UniqueName: \"kubernetes.io/projected/18bcad2c-343d-490f-9207-fd77e5dfe3aa-kube-api-access-9c965\") pod \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") "
Oct 30 22:35:50.934392 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.934351    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-home\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-home\") pod \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") "
Oct 30 22:35:50.934392 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.934388    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-tmp-dir\") pod \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") "
Oct 30 22:35:50.934573 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.934412    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-dshm\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-dshm\") pod \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") "
Oct 30 22:35:50.934573 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.934458    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-model-cache\") pod \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\" (UID: \"18bcad2c-343d-490f-9207-fd77e5dfe3aa\") "
Oct 30 22:35:50.934676 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.934656    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-home" pod "18bcad2c-343d-490f-9207-fd77e5dfe3aa" (UID: "18bcad2c-343d-490f-9207-fd77e5dfe3aa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:50.934781 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.934668    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-tmp-dir" pod "18bcad2c-343d-490f-9207-fd77e5dfe3aa" (UID: "18bcad2c-343d-490f-9207-fd77e5dfe3aa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:50.934858 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.934838    4918 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-home\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:50.934922 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.934886    4918 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-tmp-dir\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:50.934973 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.934914    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-model-cache" pod "18bcad2c-343d-490f-9207-fd77e5dfe3aa" (UID: "18bcad2c-343d-490f-9207-fd77e5dfe3aa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:50.936674 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.936651    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18bcad2c-343d-490f-9207-fd77e5dfe3aa-kube-api-access-9c965" pod "18bcad2c-343d-490f-9207-fd77e5dfe3aa" (UID: "18bcad2c-343d-490f-9207-fd77e5dfe3aa"). InnerVolumeSpecName "kube-api-access-9c965". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:50.936816 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.936763    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18bcad2c-343d-490f-9207-fd77e5dfe3aa-tls-certs" pod "18bcad2c-343d-490f-9207-fd77e5dfe3aa" (UID: "18bcad2c-343d-490f-9207-fd77e5dfe3aa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:35:50.936816 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:50.936792    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-dshm" pod "18bcad2c-343d-490f-9207-fd77e5dfe3aa" (UID: "18bcad2c-343d-490f-9207-fd77e5dfe3aa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:51.036644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:51.036605    4918 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-dshm\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:51.036864 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:51.036655    4918 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18bcad2c-343d-490f-9207-fd77e5dfe3aa-model-cache\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:51.036864 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:51.036673    4918 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18bcad2c-343d-490f-9207-fd77e5dfe3aa-tls-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:51.036864 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:51.036711    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c965\" (UniqueName: \"kubernetes.io/projected/18bcad2c-343d-490f-9207-fd77e5dfe3aa-kube-api-access-9c965\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:51.310601 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:51.310520    4918 generic.go:356] "Generic (PLEG): container finished" podID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerID="fa2ce088a89a41ac53c9f67e9e1c82410590dfce2b6ed0b5de4c72cf14b8f7c9" exitCode=0
Oct 30 22:35:51.310601 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:51.310565    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"
Oct 30 22:35:51.310848 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:51.310601    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" event={"ID":"18bcad2c-343d-490f-9207-fd77e5dfe3aa","Type":"ContainerDied","Data":"fa2ce088a89a41ac53c9f67e9e1c82410590dfce2b6ed0b5de4c72cf14b8f7c9"}
Oct 30 22:35:51.310848 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:51.310642    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8" event={"ID":"18bcad2c-343d-490f-9207-fd77e5dfe3aa","Type":"ContainerDied","Data":"66b2c3bc3e02c5ec7325aefc5d148f951714cd411e28eb9a6b26b2b5504368f9"}
Oct 30 22:35:51.310848 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:51.310659    4918 scope.go:122] "RemoveContainer" containerID="fa2ce088a89a41ac53c9f67e9e1c82410590dfce2b6ed0b5de4c72cf14b8f7c9"
Oct 30 22:35:51.320526 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:51.320512    4918 scope.go:122] "RemoveContainer" containerID="fa2ce088a89a41ac53c9f67e9e1c82410590dfce2b6ed0b5de4c72cf14b8f7c9"
Oct 30 22:35:51.320818 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:35:51.320799    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa2ce088a89a41ac53c9f67e9e1c82410590dfce2b6ed0b5de4c72cf14b8f7c9\": container with ID starting with fa2ce088a89a41ac53c9f67e9e1c82410590dfce2b6ed0b5de4c72cf14b8f7c9 not found: ID does not exist" containerID="fa2ce088a89a41ac53c9f67e9e1c82410590dfce2b6ed0b5de4c72cf14b8f7c9"
Oct 30 22:35:51.320879 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:51.320826    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa2ce088a89a41ac53c9f67e9e1c82410590dfce2b6ed0b5de4c72cf14b8f7c9"} err="failed to get container status \"fa2ce088a89a41ac53c9f67e9e1c82410590dfce2b6ed0b5de4c72cf14b8f7c9\": rpc error: code = NotFound desc = could not find container \"fa2ce088a89a41ac53c9f67e9e1c82410590dfce2b6ed0b5de4c72cf14b8f7c9\": container with ID starting with fa2ce088a89a41ac53c9f67e9e1c82410590dfce2b6ed0b5de4c72cf14b8f7c9 not found: ID does not exist"
Oct 30 22:35:51.473587 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:51.473552    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"]
Oct 30 22:35:51.478928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:51.478904    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-b9fbe2/distinct-w6-b9fbe2-kserve-5c797d5f5c-8bwk8"]
Oct 30 22:35:51.913519 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:51.913484    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn" podUID="966cb5c4-9d3a-410f-bd2c-87cf0927bf1f" containerName="payload-pre-processing" containerID="cri-o://dc9eafc69ed8878c7d0c770c32da8c145ab4431949ef6bcea7e78f8d02a9bf38" gracePeriod=25
Oct 30 22:35:52.073289 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.073252    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" path="/var/lib/kubelet/pods/18bcad2c-343d-490f-9207-fd77e5dfe3aa/volumes"
Oct 30 22:35:52.177938 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.177870    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"
Oct 30 22:35:52.248463 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.248435    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/966cb5c4-9d3a-410f-bd2c-87cf0927bf1f-kube-api-access-7jn5c\" (UniqueName: \"kubernetes.io/projected/966cb5c4-9d3a-410f-bd2c-87cf0927bf1f-kube-api-access-7jn5c\") pod \"966cb5c4-9d3a-410f-bd2c-87cf0927bf1f\" (UID: \"966cb5c4-9d3a-410f-bd2c-87cf0927bf1f\") "
Oct 30 22:35:52.248621 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.248533    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/966cb5c4-9d3a-410f-bd2c-87cf0927bf1f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/966cb5c4-9d3a-410f-bd2c-87cf0927bf1f-plugins-config-volume\") pod \"966cb5c4-9d3a-410f-bd2c-87cf0927bf1f\" (UID: \"966cb5c4-9d3a-410f-bd2c-87cf0927bf1f\") "
Oct 30 22:35:52.248889 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.248869    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/966cb5c4-9d3a-410f-bd2c-87cf0927bf1f-plugins-config-volume" pod "966cb5c4-9d3a-410f-bd2c-87cf0927bf1f" (UID: "966cb5c4-9d3a-410f-bd2c-87cf0927bf1f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:35:52.250633 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.250610    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/966cb5c4-9d3a-410f-bd2c-87cf0927bf1f-kube-api-access-7jn5c" pod "966cb5c4-9d3a-410f-bd2c-87cf0927bf1f" (UID: "966cb5c4-9d3a-410f-bd2c-87cf0927bf1f"). InnerVolumeSpecName "kube-api-access-7jn5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:52.317355 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.317327    4918 generic.go:356] "Generic (PLEG): container finished" podID="966cb5c4-9d3a-410f-bd2c-87cf0927bf1f" containerID="dc9eafc69ed8878c7d0c770c32da8c145ab4431949ef6bcea7e78f8d02a9bf38" exitCode=0
Oct 30 22:35:52.317472 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.317385    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"
Oct 30 22:35:52.317472 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.317407    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn" event={"ID":"966cb5c4-9d3a-410f-bd2c-87cf0927bf1f","Type":"ContainerDied","Data":"dc9eafc69ed8878c7d0c770c32da8c145ab4431949ef6bcea7e78f8d02a9bf38"}
Oct 30 22:35:52.317472 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.317461    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn" event={"ID":"966cb5c4-9d3a-410f-bd2c-87cf0927bf1f","Type":"ContainerDied","Data":"229f049e02859e0c07b35434bc37f2b92f198b5f1dbeae76d57c4f45cb7416e6"}
Oct 30 22:35:52.317643 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.317489    4918 scope.go:122] "RemoveContainer" containerID="dc9eafc69ed8878c7d0c770c32da8c145ab4431949ef6bcea7e78f8d02a9bf38"
Oct 30 22:35:52.328573 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.328555    4918 scope.go:122] "RemoveContainer" containerID="dc9eafc69ed8878c7d0c770c32da8c145ab4431949ef6bcea7e78f8d02a9bf38"
Oct 30 22:35:52.328915 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:35:52.328892    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc9eafc69ed8878c7d0c770c32da8c145ab4431949ef6bcea7e78f8d02a9bf38\": container with ID starting with dc9eafc69ed8878c7d0c770c32da8c145ab4431949ef6bcea7e78f8d02a9bf38 not found: ID does not exist" containerID="dc9eafc69ed8878c7d0c770c32da8c145ab4431949ef6bcea7e78f8d02a9bf38"
Oct 30 22:35:52.329009 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.328925    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc9eafc69ed8878c7d0c770c32da8c145ab4431949ef6bcea7e78f8d02a9bf38"} err="failed to get container status \"dc9eafc69ed8878c7d0c770c32da8c145ab4431949ef6bcea7e78f8d02a9bf38\": rpc error: code = NotFound desc = could not find container \"dc9eafc69ed8878c7d0c770c32da8c145ab4431949ef6bcea7e78f8d02a9bf38\": container with ID starting with dc9eafc69ed8878c7d0c770c32da8c145ab4431949ef6bcea7e78f8d02a9bf38 not found: ID does not exist"
Oct 30 22:35:52.350306 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.350284    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/966cb5c4-9d3a-410f-bd2c-87cf0927bf1f-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:52.350306 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.350304    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jn5c\" (UniqueName: \"kubernetes.io/projected/966cb5c4-9d3a-410f-bd2c-87cf0927bf1f-kube-api-access-7jn5c\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:52.480808 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.480755    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"]
Oct 30 22:35:52.485180 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:52.485156    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w4-55beb8-586fcd6b75-8cbjn"]
Oct 30 22:35:54.072730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:54.072673    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="966cb5c4-9d3a-410f-bd2c-87cf0927bf1f" path="/var/lib/kubelet/pods/966cb5c4-9d3a-410f-bd2c-87cf0927bf1f/volumes"
Oct 30 22:35:55.312049 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:35:55.312008    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:00.233189 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:00.233094    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:02.169065 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:36:02.169027    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:36:06.105263 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:06.105223    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:06.397635 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:06.397597    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:07.058378 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:07.058329    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:10.794669 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:10.794635    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"]
Oct 30 22:36:10.795199 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:10.794845    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs" podUID="c637c629-35bf-4b7e-9e5e-85e17cd23837" containerName="maas-api" containerID="cri-o://e3b918c8c2c3043f66d2fae24ae18c2642be67a79eb5483eae59ec869a4d0641" gracePeriod=30
Oct 30 22:36:11.030247 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.030208    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:11.065089 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.065066    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 22:36:11.134985 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.134950    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-metrics-certs\") pod \"c637c629-35bf-4b7e-9e5e-85e17cd23837\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") "
Oct 30 22:36:11.135197 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.135025    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c637c629-35bf-4b7e-9e5e-85e17cd23837-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c637c629-35bf-4b7e-9e5e-85e17cd23837-openshift-service-ca\") pod \"c637c629-35bf-4b7e-9e5e-85e17cd23837\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") "
Oct 30 22:36:11.135197 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.135041    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-maas-api-tls\") pod \"c637c629-35bf-4b7e-9e5e-85e17cd23837\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") "
Oct 30 22:36:11.135197 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.135144    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c637c629-35bf-4b7e-9e5e-85e17cd23837-kube-api-access-pz84d\" (UniqueName: \"kubernetes.io/projected/c637c629-35bf-4b7e-9e5e-85e17cd23837-kube-api-access-pz84d\") pod \"c637c629-35bf-4b7e-9e5e-85e17cd23837\" (UID: \"c637c629-35bf-4b7e-9e5e-85e17cd23837\") "
Oct 30 22:36:11.135410 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.135389    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c637c629-35bf-4b7e-9e5e-85e17cd23837-openshift-service-ca" pod "c637c629-35bf-4b7e-9e5e-85e17cd23837" (UID: "c637c629-35bf-4b7e-9e5e-85e17cd23837"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:36:11.135593 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.135573    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c637c629-35bf-4b7e-9e5e-85e17cd23837-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:11.137421 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.137399    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-metrics-certs" pod "c637c629-35bf-4b7e-9e5e-85e17cd23837" (UID: "c637c629-35bf-4b7e-9e5e-85e17cd23837"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:36:11.137524 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.137438    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-maas-api-tls" pod "c637c629-35bf-4b7e-9e5e-85e17cd23837" (UID: "c637c629-35bf-4b7e-9e5e-85e17cd23837"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:36:11.137524 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.137492    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c637c629-35bf-4b7e-9e5e-85e17cd23837-kube-api-access-pz84d" pod "c637c629-35bf-4b7e-9e5e-85e17cd23837" (UID: "c637c629-35bf-4b7e-9e5e-85e17cd23837"). InnerVolumeSpecName "kube-api-access-pz84d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:11.236818 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.236785    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz84d\" (UniqueName: \"kubernetes.io/projected/c637c629-35bf-4b7e-9e5e-85e17cd23837-kube-api-access-pz84d\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:11.236818 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.236814    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:11.236818 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.236825    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c637c629-35bf-4b7e-9e5e-85e17cd23837-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:11.417449 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.417409    4918 generic.go:356] "Generic (PLEG): container finished" podID="c637c629-35bf-4b7e-9e5e-85e17cd23837" containerID="e3b918c8c2c3043f66d2fae24ae18c2642be67a79eb5483eae59ec869a4d0641" exitCode=0
Oct 30 22:36:11.417627 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.417459    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"
Oct 30 22:36:11.417627 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.417500    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs" event={"ID":"c637c629-35bf-4b7e-9e5e-85e17cd23837","Type":"ContainerDied","Data":"e3b918c8c2c3043f66d2fae24ae18c2642be67a79eb5483eae59ec869a4d0641"}
Oct 30 22:36:11.417627 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.417558    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs" event={"ID":"c637c629-35bf-4b7e-9e5e-85e17cd23837","Type":"ContainerDied","Data":"3acd5fc984f61082bc52e937cf137ee2e6a060e2ccdbfd879f41c1c9f2ac7045"}
Oct 30 22:36:11.417627 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.417580    4918 scope.go:122] "RemoveContainer" containerID="e3b918c8c2c3043f66d2fae24ae18c2642be67a79eb5483eae59ec869a4d0641"
Oct 30 22:36:11.427744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.427721    4918 scope.go:122] "RemoveContainer" containerID="e3b918c8c2c3043f66d2fae24ae18c2642be67a79eb5483eae59ec869a4d0641"
Oct 30 22:36:11.427995 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:36:11.427974    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3b918c8c2c3043f66d2fae24ae18c2642be67a79eb5483eae59ec869a4d0641\": container with ID starting with e3b918c8c2c3043f66d2fae24ae18c2642be67a79eb5483eae59ec869a4d0641 not found: ID does not exist" containerID="e3b918c8c2c3043f66d2fae24ae18c2642be67a79eb5483eae59ec869a4d0641"
Oct 30 22:36:11.428077 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.428002    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3b918c8c2c3043f66d2fae24ae18c2642be67a79eb5483eae59ec869a4d0641"} err="failed to get container status \"e3b918c8c2c3043f66d2fae24ae18c2642be67a79eb5483eae59ec869a4d0641\": rpc error: code = NotFound desc = could not find container \"e3b918c8c2c3043f66d2fae24ae18c2642be67a79eb5483eae59ec869a4d0641\": container with ID starting with e3b918c8c2c3043f66d2fae24ae18c2642be67a79eb5483eae59ec869a4d0641 not found: ID does not exist"
Oct 30 22:36:11.581470 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.581435    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"]
Oct 30 22:36:11.586098 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:11.586075    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-b9fbe2-7d5ddd59cc-gmlgs"]
Oct 30 22:36:12.072468 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:12.072433    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c637c629-35bf-4b7e-9e5e-85e17cd23837" path="/var/lib/kubelet/pods/c637c629-35bf-4b7e-9e5e-85e17cd23837/volumes"
Oct 30 22:36:12.641878 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:12.641839    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:12.950458 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:12.950366    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:13.412032 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:13.411977    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:13.680157 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:13.680076    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:14.187272 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:14.187240    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:14.520054 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:14.519966    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:14.751710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:14.751664    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:15.128548 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:15.128508    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:15.362180 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:15.362106    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"]
Oct 30 22:36:15.362370 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:15.362350    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj" podUID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" containerName="istio-proxy" containerID="cri-o://ba118fd408eb5b2cd5a20376e51df7dac7bd3315e19653bd42a9adcc331ecc00" gracePeriod=30
Oct 30 22:36:15.388695 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:15.388652    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:15.660783 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:15.660752    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:18.170261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:18.170227    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:19.514597 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:19.514560    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:19.750585 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:19.750545    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"]
Oct 30 22:36:19.751172 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:19.751137    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2" podUID="fa1a78dc-c5da-469a-af25-77d846ba4e92" containerName="istio-proxy" containerID="cri-o://67fb6677709f81c38ba3a97332f3db5e4ad844d0abccd0a64259db7a2e257c36" gracePeriod=30
Oct 30 22:36:19.755561 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:19.755523    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:20.019128 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.019097    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:20.621865 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.621836    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:36:20.726095 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.726068    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-kube-api-access-tdvj4\" (UniqueName: \"kubernetes.io/projected/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-kube-api-access-tdvj4\") pod \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") "
Oct 30 22:36:20.726212 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.726110    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-podinfo\") pod \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") "
Oct 30 22:36:20.726212 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.726170    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-workload-certs\") pod \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") "
Oct 30 22:36:20.726321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.726222    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-token\" (UniqueName: \"kubernetes.io/projected/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-token\") pod \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") "
Oct 30 22:36:20.726321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.726243    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-workload-socket\") pod \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") "
Oct 30 22:36:20.726321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.726269    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istiod-ca-cert\") pod \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") "
Oct 30 22:36:20.726321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.726295    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-envoy\") pod \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") "
Oct 30 22:36:20.726528 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.726349    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-credential-socket\") pod \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") "
Oct 30 22:36:20.726528 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.726397    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-data\") pod \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\" (UID: \"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a\") "
Oct 30 22:36:20.726650 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.726568    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-workload-socket" pod "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" (UID: "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:20.726750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.726661    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istiod-ca-cert" pod "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" (UID: "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:36:20.726816 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.726778    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-workload-certs" pod "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" (UID: "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:20.726816 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.726798    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:20.726816 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.726807    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-data" pod "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" (UID: "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:20.727012 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.726993    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-credential-socket" pod "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" (UID: "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:20.728602 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.728578    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-token" pod "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" (UID: "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:20.728734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.728670    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-envoy" pod "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" (UID: "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:20.729000 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.728981    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-podinfo" pod "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" (UID: "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:36:20.729109 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.729017    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-kube-api-access-tdvj4" pod "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" (UID: "e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a"). InnerVolumeSpecName "kube-api-access-tdvj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:20.827299 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.827270    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:20.827299 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.827295    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:20.827299 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.827305    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:20.827514 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.827314    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:20.827514 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.827322    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:20.827514 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.827331    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdvj4\" (UniqueName: \"kubernetes.io/projected/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-kube-api-access-tdvj4\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:20.827514 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.827340    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:20.827514 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.827349    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:20.979513 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:20.979431    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:21.189303 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:21.189262    4918 patch_prober.go:29] interesting pod/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:36:21.189462 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:21.189341    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2" podUID="fa1a78dc-c5da-469a-af25-77d846ba4e92" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:36:21.479962 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:21.479925    4918 generic.go:356] "Generic (PLEG): container finished" podID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" containerID="ba118fd408eb5b2cd5a20376e51df7dac7bd3315e19653bd42a9adcc331ecc00" exitCode=0
Oct 30 22:36:21.480158 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:21.479975    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"
Oct 30 22:36:21.480158 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:21.480013    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj" event={"ID":"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a","Type":"ContainerDied","Data":"ba118fd408eb5b2cd5a20376e51df7dac7bd3315e19653bd42a9adcc331ecc00"}
Oct 30 22:36:21.480158 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:21.480077    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj" event={"ID":"e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a","Type":"ContainerDied","Data":"bc009595747c9f2e7965b6bd3db9cdcb10856942d646e606226890632d80afa5"}
Oct 30 22:36:21.480158 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:21.480107    4918 scope.go:122] "RemoveContainer" containerID="ba118fd408eb5b2cd5a20376e51df7dac7bd3315e19653bd42a9adcc331ecc00"
Oct 30 22:36:21.489800 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:21.489785    4918 scope.go:122] "RemoveContainer" containerID="52225e022e7e6f029c7e29b23ea35a12b30bac220b8f82bfdf277819e3ccacae"
Oct 30 22:36:21.497734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:21.497717    4918 scope.go:122] "RemoveContainer" containerID="ba118fd408eb5b2cd5a20376e51df7dac7bd3315e19653bd42a9adcc331ecc00"
Oct 30 22:36:21.498006 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:36:21.497987    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba118fd408eb5b2cd5a20376e51df7dac7bd3315e19653bd42a9adcc331ecc00\": container with ID starting with ba118fd408eb5b2cd5a20376e51df7dac7bd3315e19653bd42a9adcc331ecc00 not found: ID does not exist" containerID="ba118fd408eb5b2cd5a20376e51df7dac7bd3315e19653bd42a9adcc331ecc00"
Oct 30 22:36:21.498075 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:21.498012    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba118fd408eb5b2cd5a20376e51df7dac7bd3315e19653bd42a9adcc331ecc00"} err="failed to get container status \"ba118fd408eb5b2cd5a20376e51df7dac7bd3315e19653bd42a9adcc331ecc00\": rpc error: code = NotFound desc = could not find container \"ba118fd408eb5b2cd5a20376e51df7dac7bd3315e19653bd42a9adcc331ecc00\": container with ID starting with ba118fd408eb5b2cd5a20376e51df7dac7bd3315e19653bd42a9adcc331ecc00 not found: ID does not exist"
Oct 30 22:36:21.498075 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:21.498030    4918 scope.go:122] "RemoveContainer" containerID="52225e022e7e6f029c7e29b23ea35a12b30bac220b8f82bfdf277819e3ccacae"
Oct 30 22:36:21.498256 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:36:21.498241    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52225e022e7e6f029c7e29b23ea35a12b30bac220b8f82bfdf277819e3ccacae\": container with ID starting with 52225e022e7e6f029c7e29b23ea35a12b30bac220b8f82bfdf277819e3ccacae not found: ID does not exist" containerID="52225e022e7e6f029c7e29b23ea35a12b30bac220b8f82bfdf277819e3ccacae"
Oct 30 22:36:21.498299 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:21.498261    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52225e022e7e6f029c7e29b23ea35a12b30bac220b8f82bfdf277819e3ccacae"} err="failed to get container status \"52225e022e7e6f029c7e29b23ea35a12b30bac220b8f82bfdf277819e3ccacae\": rpc error: code = NotFound desc = could not find container \"52225e022e7e6f029c7e29b23ea35a12b30bac220b8f82bfdf277819e3ccacae\": container with ID starting with 52225e022e7e6f029c7e29b23ea35a12b30bac220b8f82bfdf277819e3ccacae not found: ID does not exist"
Oct 30 22:36:21.644767 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:21.644740    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"]
Oct 30 22:36:21.648504 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:21.648484    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-55beb8-openshift-default-755775fc6f-kmfhj"]
Oct 30 22:36:22.072526 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:22.072491    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" path="/var/lib/kubelet/pods/e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a/volumes"
Oct 30 22:36:23.204922 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:23.204875    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:24.998342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:24.998313    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 22:36:25.065764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.065699    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa1a78dc-c5da-469a-af25-77d846ba4e92-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa1a78dc-c5da-469a-af25-77d846ba4e92-istiod-ca-cert\") pod \"fa1a78dc-c5da-469a-af25-77d846ba4e92\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") "
Oct 30 22:36:25.065898 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.065760    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-envoy\") pod \"fa1a78dc-c5da-469a-af25-77d846ba4e92\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") "
Oct 30 22:36:25.065978 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.065893    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-podinfo\") pod \"fa1a78dc-c5da-469a-af25-77d846ba4e92\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") "
Oct 30 22:36:25.065978 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.065947    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa1a78dc-c5da-469a-af25-77d846ba4e92-kube-api-access-n4vhz\" (UniqueName: \"kubernetes.io/projected/fa1a78dc-c5da-469a-af25-77d846ba4e92-kube-api-access-n4vhz\") pod \"fa1a78dc-c5da-469a-af25-77d846ba4e92\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") "
Oct 30 22:36:25.066099 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.065999    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-data\") pod \"fa1a78dc-c5da-469a-af25-77d846ba4e92\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") "
Oct 30 22:36:25.066099 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.066048    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-workload-socket\") pod \"fa1a78dc-c5da-469a-af25-77d846ba4e92\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") "
Oct 30 22:36:25.066099 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.066095    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-token\" (UniqueName: \"kubernetes.io/projected/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-token\") pod \"fa1a78dc-c5da-469a-af25-77d846ba4e92\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") "
Oct 30 22:36:25.066269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.066093    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa1a78dc-c5da-469a-af25-77d846ba4e92-istiod-ca-cert" pod "fa1a78dc-c5da-469a-af25-77d846ba4e92" (UID: "fa1a78dc-c5da-469a-af25-77d846ba4e92"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:36:25.066269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.066128    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-credential-socket\") pod \"fa1a78dc-c5da-469a-af25-77d846ba4e92\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") "
Oct 30 22:36:25.066269 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.066159    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-workload-certs\") pod \"fa1a78dc-c5da-469a-af25-77d846ba4e92\" (UID: \"fa1a78dc-c5da-469a-af25-77d846ba4e92\") "
Oct 30 22:36:25.066438 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.066293    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-data" pod "fa1a78dc-c5da-469a-af25-77d846ba4e92" (UID: "fa1a78dc-c5da-469a-af25-77d846ba4e92"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:25.066562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.066467    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-workload-socket" pod "fa1a78dc-c5da-469a-af25-77d846ba4e92" (UID: "fa1a78dc-c5da-469a-af25-77d846ba4e92"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:25.066562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.066521    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:25.066562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.066539    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa1a78dc-c5da-469a-af25-77d846ba4e92-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:25.066562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.066565    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-credential-socket" pod "fa1a78dc-c5da-469a-af25-77d846ba4e92" (UID: "fa1a78dc-c5da-469a-af25-77d846ba4e92"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:25.066917 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.066770    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-workload-certs" pod "fa1a78dc-c5da-469a-af25-77d846ba4e92" (UID: "fa1a78dc-c5da-469a-af25-77d846ba4e92"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:25.068135 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.068107    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-envoy" pod "fa1a78dc-c5da-469a-af25-77d846ba4e92" (UID: "fa1a78dc-c5da-469a-af25-77d846ba4e92"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:36:25.068484 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.068466    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-token" pod "fa1a78dc-c5da-469a-af25-77d846ba4e92" (UID: "fa1a78dc-c5da-469a-af25-77d846ba4e92"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:25.068788 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.068769    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-podinfo" pod "fa1a78dc-c5da-469a-af25-77d846ba4e92" (UID: "fa1a78dc-c5da-469a-af25-77d846ba4e92"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:36:25.068788 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.068780    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa1a78dc-c5da-469a-af25-77d846ba4e92-kube-api-access-n4vhz" pod "fa1a78dc-c5da-469a-af25-77d846ba4e92" (UID: "fa1a78dc-c5da-469a-af25-77d846ba4e92"). InnerVolumeSpecName "kube-api-access-n4vhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:25.167419 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.167398    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:25.167548 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.167508    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:25.167548 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.167527    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4vhz\" (UniqueName: \"kubernetes.io/projected/fa1a78dc-c5da-469a-af25-77d846ba4e92-kube-api-access-n4vhz\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:25.167548 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.167541    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:25.167708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.167554    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa1a78dc-c5da-469a-af25-77d846ba4e92-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:25.167708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.167565    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:25.167708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.167578    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa1a78dc-c5da-469a-af25-77d846ba4e92-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:25.502702 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.502646    4918 generic.go:356] "Generic (PLEG): container finished" podID="fa1a78dc-c5da-469a-af25-77d846ba4e92" containerID="67fb6677709f81c38ba3a97332f3db5e4ad844d0abccd0a64259db7a2e257c36" exitCode=0
Oct 30 22:36:25.502928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.502731    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"
Oct 30 22:36:25.502928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.502728    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2" event={"ID":"fa1a78dc-c5da-469a-af25-77d846ba4e92","Type":"ContainerDied","Data":"67fb6677709f81c38ba3a97332f3db5e4ad844d0abccd0a64259db7a2e257c36"}
Oct 30 22:36:25.502928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.502819    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2" event={"ID":"fa1a78dc-c5da-469a-af25-77d846ba4e92","Type":"ContainerDied","Data":"8d547dfdff6a049a4ca5a2d05e525ddafc552992755803fb2b3ea34486f7a27e"}
Oct 30 22:36:25.502928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.502856    4918 scope.go:122] "RemoveContainer" containerID="67fb6677709f81c38ba3a97332f3db5e4ad844d0abccd0a64259db7a2e257c36"
Oct 30 22:36:25.513884 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.513863    4918 scope.go:122] "RemoveContainer" containerID="e1d6dc8bbd0c1f592c7245742a97890fd5ba047dc9555ced13446994ed0cb156"
Oct 30 22:36:25.522821 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.522802    4918 scope.go:122] "RemoveContainer" containerID="67fb6677709f81c38ba3a97332f3db5e4ad844d0abccd0a64259db7a2e257c36"
Oct 30 22:36:25.523114 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:36:25.523081    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67fb6677709f81c38ba3a97332f3db5e4ad844d0abccd0a64259db7a2e257c36\": container with ID starting with 67fb6677709f81c38ba3a97332f3db5e4ad844d0abccd0a64259db7a2e257c36 not found: ID does not exist" containerID="67fb6677709f81c38ba3a97332f3db5e4ad844d0abccd0a64259db7a2e257c36"
Oct 30 22:36:25.523190 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.523112    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67fb6677709f81c38ba3a97332f3db5e4ad844d0abccd0a64259db7a2e257c36"} err="failed to get container status \"67fb6677709f81c38ba3a97332f3db5e4ad844d0abccd0a64259db7a2e257c36\": rpc error: code = NotFound desc = could not find container \"67fb6677709f81c38ba3a97332f3db5e4ad844d0abccd0a64259db7a2e257c36\": container with ID starting with 67fb6677709f81c38ba3a97332f3db5e4ad844d0abccd0a64259db7a2e257c36 not found: ID does not exist"
Oct 30 22:36:25.523190 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.523131    4918 scope.go:122] "RemoveContainer" containerID="e1d6dc8bbd0c1f592c7245742a97890fd5ba047dc9555ced13446994ed0cb156"
Oct 30 22:36:25.523428 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:36:25.523408    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1d6dc8bbd0c1f592c7245742a97890fd5ba047dc9555ced13446994ed0cb156\": container with ID starting with e1d6dc8bbd0c1f592c7245742a97890fd5ba047dc9555ced13446994ed0cb156 not found: ID does not exist" containerID="e1d6dc8bbd0c1f592c7245742a97890fd5ba047dc9555ced13446994ed0cb156"
Oct 30 22:36:25.523481 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.523434    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1d6dc8bbd0c1f592c7245742a97890fd5ba047dc9555ced13446994ed0cb156"} err="failed to get container status \"e1d6dc8bbd0c1f592c7245742a97890fd5ba047dc9555ced13446994ed0cb156\": rpc error: code = NotFound desc = could not find container \"e1d6dc8bbd0c1f592c7245742a97890fd5ba047dc9555ced13446994ed0cb156\": container with ID starting with e1d6dc8bbd0c1f592c7245742a97890fd5ba047dc9555ced13446994ed0cb156 not found: ID does not exist"
Oct 30 22:36:25.667116 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.667082    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"]
Oct 30 22:36:25.716155 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:25.716128    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-b9fbe2-openshift-default-64b8c9665c-c79c2"]
Oct 30 22:36:26.072902 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:26.072871    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa1a78dc-c5da-469a-af25-77d846ba4e92" path="/var/lib/kubelet/pods/fa1a78dc-c5da-469a-af25-77d846ba4e92/volumes"
Oct 30 22:36:26.678253 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:26.678222    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"]
Oct 30 22:36:26.787045 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:26.787002    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"]
Oct 30 22:36:27.132387 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:27.132310    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:27.382071 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:27.382034    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:28.185974 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:28.185936    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:28.718578 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:28.718546    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:29.004784 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:29.004676    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:30.977342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:30.977295    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:31.679391 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:31.679332    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4" podUID="06314e3b-fd5b-4f37-8ec0-f4b187a635e9" containerName="payload-processing" containerID="cri-o://549489d9f01da714bc762ecf66f09a62ae999e4bf6625f950f7180f3f83aca0a" gracePeriod=25
Oct 30 22:36:31.787941 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:31.787899    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv" podUID="33219300-9dcb-4ae5-9511-900ff02b91ef" containerName="payload-pre-processing" containerID="cri-o://ba23044fa6d508f6a9e6387a2471109d401f4eefaea9725cbca24f58d258ab68" gracePeriod=25
Oct 30 22:36:31.941987 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:31.941785    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"
Oct 30 22:36:32.034460 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.034439    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06314e3b-fd5b-4f37-8ec0-f4b187a635e9-kube-api-access-kjzhg\" (UniqueName: \"kubernetes.io/projected/06314e3b-fd5b-4f37-8ec0-f4b187a635e9-kube-api-access-kjzhg\") pod \"06314e3b-fd5b-4f37-8ec0-f4b187a635e9\" (UID: \"06314e3b-fd5b-4f37-8ec0-f4b187a635e9\") "
Oct 30 22:36:32.034820 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.034517    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06314e3b-fd5b-4f37-8ec0-f4b187a635e9-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06314e3b-fd5b-4f37-8ec0-f4b187a635e9-plugins-config-volume\") pod \"06314e3b-fd5b-4f37-8ec0-f4b187a635e9\" (UID: \"06314e3b-fd5b-4f37-8ec0-f4b187a635e9\") "
Oct 30 22:36:32.034967 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.034944    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06314e3b-fd5b-4f37-8ec0-f4b187a635e9-plugins-config-volume" pod "06314e3b-fd5b-4f37-8ec0-f4b187a635e9" (UID: "06314e3b-fd5b-4f37-8ec0-f4b187a635e9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:36:32.036495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.036476    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06314e3b-fd5b-4f37-8ec0-f4b187a635e9-kube-api-access-kjzhg" pod "06314e3b-fd5b-4f37-8ec0-f4b187a635e9" (UID: "06314e3b-fd5b-4f37-8ec0-f4b187a635e9"). InnerVolumeSpecName "kube-api-access-kjzhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:32.050100 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.050080    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"
Oct 30 22:36:32.135719 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.135687    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33219300-9dcb-4ae5-9511-900ff02b91ef-kube-api-access-zsbcb\" (UniqueName: \"kubernetes.io/projected/33219300-9dcb-4ae5-9511-900ff02b91ef-kube-api-access-zsbcb\") pod \"33219300-9dcb-4ae5-9511-900ff02b91ef\" (UID: \"33219300-9dcb-4ae5-9511-900ff02b91ef\") "
Oct 30 22:36:32.135888 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.135745    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/33219300-9dcb-4ae5-9511-900ff02b91ef-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33219300-9dcb-4ae5-9511-900ff02b91ef-plugins-config-volume\") pod \"33219300-9dcb-4ae5-9511-900ff02b91ef\" (UID: \"33219300-9dcb-4ae5-9511-900ff02b91ef\") "
Oct 30 22:36:32.136086 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.136062    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06314e3b-fd5b-4f37-8ec0-f4b187a635e9-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:32.136242 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.136224    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjzhg\" (UniqueName: \"kubernetes.io/projected/06314e3b-fd5b-4f37-8ec0-f4b187a635e9-kube-api-access-kjzhg\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:32.136353 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.136172    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33219300-9dcb-4ae5-9511-900ff02b91ef-plugins-config-volume" pod "33219300-9dcb-4ae5-9511-900ff02b91ef" (UID: "33219300-9dcb-4ae5-9511-900ff02b91ef"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:36:32.137773 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.137752    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33219300-9dcb-4ae5-9511-900ff02b91ef-kube-api-access-zsbcb" pod "33219300-9dcb-4ae5-9511-900ff02b91ef" (UID: "33219300-9dcb-4ae5-9511-900ff02b91ef"). InnerVolumeSpecName "kube-api-access-zsbcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:32.157068 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:36:32.157035    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:36:32.236963 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.236883    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33219300-9dcb-4ae5-9511-900ff02b91ef-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:32.236963 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.236912    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsbcb\" (UniqueName: \"kubernetes.io/projected/33219300-9dcb-4ae5-9511-900ff02b91ef-kube-api-access-zsbcb\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:32.541181 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.541100    4918 generic.go:356] "Generic (PLEG): container finished" podID="33219300-9dcb-4ae5-9511-900ff02b91ef" containerID="ba23044fa6d508f6a9e6387a2471109d401f4eefaea9725cbca24f58d258ab68" exitCode=0
Oct 30 22:36:32.541181 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.541148    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"
Oct 30 22:36:32.541372 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.541180    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv" event={"ID":"33219300-9dcb-4ae5-9511-900ff02b91ef","Type":"ContainerDied","Data":"ba23044fa6d508f6a9e6387a2471109d401f4eefaea9725cbca24f58d258ab68"}
Oct 30 22:36:32.541372 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.541233    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv" event={"ID":"33219300-9dcb-4ae5-9511-900ff02b91ef","Type":"ContainerDied","Data":"5d120ef3a414f1910d73f4898628a217cfc05b19163341db5340d46ac7a75177"}
Oct 30 22:36:32.541372 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.541256    4918 scope.go:122] "RemoveContainer" containerID="ba23044fa6d508f6a9e6387a2471109d401f4eefaea9725cbca24f58d258ab68"
Oct 30 22:36:32.542882 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.542859    4918 generic.go:356] "Generic (PLEG): container finished" podID="06314e3b-fd5b-4f37-8ec0-f4b187a635e9" containerID="549489d9f01da714bc762ecf66f09a62ae999e4bf6625f950f7180f3f83aca0a" exitCode=0
Oct 30 22:36:32.543017 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.542890    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4" event={"ID":"06314e3b-fd5b-4f37-8ec0-f4b187a635e9","Type":"ContainerDied","Data":"549489d9f01da714bc762ecf66f09a62ae999e4bf6625f950f7180f3f83aca0a"}
Oct 30 22:36:32.543017 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.542916    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"
Oct 30 22:36:32.543017 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.542935    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4" event={"ID":"06314e3b-fd5b-4f37-8ec0-f4b187a635e9","Type":"ContainerDied","Data":"e2b3b893f40e12c0b51846ca4c5f3a099d9e5e574579c4763cc7269f4bb5ae92"}
Oct 30 22:36:32.550614 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.550587    4918 scope.go:122] "RemoveContainer" containerID="ba23044fa6d508f6a9e6387a2471109d401f4eefaea9725cbca24f58d258ab68"
Oct 30 22:36:32.550889 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:36:32.550870    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba23044fa6d508f6a9e6387a2471109d401f4eefaea9725cbca24f58d258ab68\": container with ID starting with ba23044fa6d508f6a9e6387a2471109d401f4eefaea9725cbca24f58d258ab68 not found: ID does not exist" containerID="ba23044fa6d508f6a9e6387a2471109d401f4eefaea9725cbca24f58d258ab68"
Oct 30 22:36:32.550940 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.550896    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba23044fa6d508f6a9e6387a2471109d401f4eefaea9725cbca24f58d258ab68"} err="failed to get container status \"ba23044fa6d508f6a9e6387a2471109d401f4eefaea9725cbca24f58d258ab68\": rpc error: code = NotFound desc = could not find container \"ba23044fa6d508f6a9e6387a2471109d401f4eefaea9725cbca24f58d258ab68\": container with ID starting with ba23044fa6d508f6a9e6387a2471109d401f4eefaea9725cbca24f58d258ab68 not found: ID does not exist"
Oct 30 22:36:32.550940 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.550912    4918 scope.go:122] "RemoveContainer" containerID="549489d9f01da714bc762ecf66f09a62ae999e4bf6625f950f7180f3f83aca0a"
Oct 30 22:36:32.558589 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.558572    4918 scope.go:122] "RemoveContainer" containerID="549489d9f01da714bc762ecf66f09a62ae999e4bf6625f950f7180f3f83aca0a"
Oct 30 22:36:32.558958 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:36:32.558940    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"549489d9f01da714bc762ecf66f09a62ae999e4bf6625f950f7180f3f83aca0a\": container with ID starting with 549489d9f01da714bc762ecf66f09a62ae999e4bf6625f950f7180f3f83aca0a not found: ID does not exist" containerID="549489d9f01da714bc762ecf66f09a62ae999e4bf6625f950f7180f3f83aca0a"
Oct 30 22:36:32.559016 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.558964    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"549489d9f01da714bc762ecf66f09a62ae999e4bf6625f950f7180f3f83aca0a"} err="failed to get container status \"549489d9f01da714bc762ecf66f09a62ae999e4bf6625f950f7180f3f83aca0a\": rpc error: code = NotFound desc = could not find container \"549489d9f01da714bc762ecf66f09a62ae999e4bf6625f950f7180f3f83aca0a\": container with ID starting with 549489d9f01da714bc762ecf66f09a62ae999e4bf6625f950f7180f3f83aca0a not found: ID does not exist"
Oct 30 22:36:32.704463 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.704439    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"]
Oct 30 22:36:32.753432 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.753399    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w4-d1ca4b-799c6c6989-vglp4"]
Oct 30 22:36:32.817739 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.817673    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"]
Oct 30 22:36:32.823496 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:32.823475    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w4-d1ca4b-5bcf95c4c-s5vvv"]
Oct 30 22:36:33.026998 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:33.026961    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:34.071322 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:34.071290    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="06314e3b-fd5b-4f37-8ec0-f4b187a635e9" path="/var/lib/kubelet/pods/06314e3b-fd5b-4f37-8ec0-f4b187a635e9/volumes"
Oct 30 22:36:34.071725 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:34.071631    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33219300-9dcb-4ae5-9511-900ff02b91ef" path="/var/lib/kubelet/pods/33219300-9dcb-4ae5-9511-900ff02b91ef/volumes"
Oct 30 22:36:37.104169 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.104136    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"]
Oct 30 22:36:37.104593 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.104318    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5" podUID="74f7d9ce-7772-4b84-8a7b-c0612ad81e8f" containerName="maas-api" containerID="cri-o://f7787fc64d63f2b0e10e29729c83d643f7dda876f4067fa2c847205bc8e581cb" gracePeriod=30
Oct 30 22:36:37.121193 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.121164    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5" podUID="74f7d9ce-7772-4b84-8a7b-c0612ad81e8f" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.123:8443/health\": dial tcp 10.132.0.123:8443: connect: connection refused"
Oct 30 22:36:37.300720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.300648    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:37.360861 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.360793    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:36:37.480556 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.480498    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-kube-api-access-4skgk\" (UniqueName: \"kubernetes.io/projected/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-kube-api-access-4skgk\") pod \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") "
Oct 30 22:36:37.489448 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.480597    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-openshift-service-ca\") pod \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") "
Oct 30 22:36:37.489448 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.480630    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-maas-api-tls\") pod \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") "
Oct 30 22:36:37.489448 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.480755    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-metrics-certs\") pod \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\" (UID: \"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f\") "
Oct 30 22:36:37.489448 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.481614    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-openshift-service-ca" pod "74f7d9ce-7772-4b84-8a7b-c0612ad81e8f" (UID: "74f7d9ce-7772-4b84-8a7b-c0612ad81e8f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:36:37.489448 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.485274    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-metrics-certs" pod "74f7d9ce-7772-4b84-8a7b-c0612ad81e8f" (UID: "74f7d9ce-7772-4b84-8a7b-c0612ad81e8f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:36:37.498258 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.498187    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-kube-api-access-4skgk" pod "74f7d9ce-7772-4b84-8a7b-c0612ad81e8f" (UID: "74f7d9ce-7772-4b84-8a7b-c0612ad81e8f"). InnerVolumeSpecName "kube-api-access-4skgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:36:37.500188 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.500147    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-maas-api-tls" pod "74f7d9ce-7772-4b84-8a7b-c0612ad81e8f" (UID: "74f7d9ce-7772-4b84-8a7b-c0612ad81e8f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:36:37.575588 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.575562    4918 generic.go:356] "Generic (PLEG): container finished" podID="74f7d9ce-7772-4b84-8a7b-c0612ad81e8f" containerID="f7787fc64d63f2b0e10e29729c83d643f7dda876f4067fa2c847205bc8e581cb" exitCode=0
Oct 30 22:36:37.575729 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.575615    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"
Oct 30 22:36:37.575729 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.575657    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5" event={"ID":"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f","Type":"ContainerDied","Data":"f7787fc64d63f2b0e10e29729c83d643f7dda876f4067fa2c847205bc8e581cb"}
Oct 30 22:36:37.575811 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.575734    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5" event={"ID":"74f7d9ce-7772-4b84-8a7b-c0612ad81e8f","Type":"ContainerDied","Data":"6c21a7743cb6d07744e0e640eaafaf95cbeb57ad8b7464d1447fd4cbbc1dba25"}
Oct 30 22:36:37.575811 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.575757    4918 scope.go:122] "RemoveContainer" containerID="f7787fc64d63f2b0e10e29729c83d643f7dda876f4067fa2c847205bc8e581cb"
Oct 30 22:36:37.581516 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.581496    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4skgk\" (UniqueName: \"kubernetes.io/projected/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-kube-api-access-4skgk\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:37.581610 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.581517    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:37.581610 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.581532    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:37.581610 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.581546    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:36:37.585720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.585704    4918 scope.go:122] "RemoveContainer" containerID="f7787fc64d63f2b0e10e29729c83d643f7dda876f4067fa2c847205bc8e581cb"
Oct 30 22:36:37.585980 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:36:37.585957    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7787fc64d63f2b0e10e29729c83d643f7dda876f4067fa2c847205bc8e581cb\": container with ID starting with f7787fc64d63f2b0e10e29729c83d643f7dda876f4067fa2c847205bc8e581cb not found: ID does not exist" containerID="f7787fc64d63f2b0e10e29729c83d643f7dda876f4067fa2c847205bc8e581cb"
Oct 30 22:36:37.586068 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.585986    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7787fc64d63f2b0e10e29729c83d643f7dda876f4067fa2c847205bc8e581cb"} err="failed to get container status \"f7787fc64d63f2b0e10e29729c83d643f7dda876f4067fa2c847205bc8e581cb\": rpc error: code = NotFound desc = could not find container \"f7787fc64d63f2b0e10e29729c83d643f7dda876f4067fa2c847205bc8e581cb\": container with ID starting with f7787fc64d63f2b0e10e29729c83d643f7dda876f4067fa2c847205bc8e581cb not found: ID does not exist"
Oct 30 22:36:37.746234 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.746200    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"]
Oct 30 22:36:37.753610 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:37.753585    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w4-d1ca4b-8699bf9cb4-gq8g5"]
Oct 30 22:36:38.073304 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:38.073225    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="74f7d9ce-7772-4b84-8a7b-c0612ad81e8f" path="/var/lib/kubelet/pods/74f7d9ce-7772-4b84-8a7b-c0612ad81e8f/volumes"
Oct 30 22:36:38.953478 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:38.953436    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:39.220644 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:39.220552    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:39.453975 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:39.453940    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:43.446530 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:43.446493    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:43.697581 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:43.697501    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:44.344925 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:44.344890    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:49.208268 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:49.208228    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:49.901173 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:49.901133    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:54.106114 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:54.106074    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:56.336259 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:56.336222    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:56.595449 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:56.595369    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:56.600168 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:56.600148    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"]
Oct 30 22:36:56.600351 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:56.600334    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n" podUID="b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" containerName="istio-proxy" containerID="cri-o://11f43408dbba68f50ff9a675393ed1bf2919209fcc1d658e026d80e85cbedcb7" gracePeriod=30
Oct 30 22:36:56.834514 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:56.834476    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:57.176487 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:57.176458    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:59.255200 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:36:59.255160    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:01.856385 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.856360    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:37:01.992122 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992086    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-credential-socket\") pod \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") "
Oct 30 22:37:01.992122 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992128    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-workload-certs\") pod \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") "
Oct 30 22:37:01.992362 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992157    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-token\" (UniqueName: \"kubernetes.io/projected/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-token\") pod \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") "
Oct 30 22:37:01.992362 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992190    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-data\") pod \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") "
Oct 30 22:37:01.992362 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992240    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-envoy\") pod \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") "
Oct 30 22:37:01.992362 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992293    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-podinfo\") pod \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") "
Oct 30 22:37:01.992362 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992325    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-workload-socket\") pod \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") "
Oct 30 22:37:01.992622 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992374    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-kube-api-access-fvfc5\" (UniqueName: \"kubernetes.io/projected/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-kube-api-access-fvfc5\") pod \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") "
Oct 30 22:37:01.992622 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992387    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-credential-socket" pod "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" (UID: "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:01.992622 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992421    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istiod-ca-cert\") pod \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\" (UID: \"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6\") "
Oct 30 22:37:01.992622 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992505    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-workload-certs" pod "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" (UID: "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:01.992622 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992523    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-data" pod "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" (UID: "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:01.992889 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992753    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-workload-socket" pod "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" (UID: "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:01.992889 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992804    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:01.992889 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992828    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:01.992889 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992844    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:01.992889 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.992851    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istiod-ca-cert" pod "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" (UID: "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:37:01.994714 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.994672    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-token" pod "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" (UID: "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:37:01.994858 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.994731    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-kube-api-access-fvfc5" pod "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" (UID: "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6"). InnerVolumeSpecName "kube-api-access-fvfc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:37:01.994858 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.994770    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-envoy" pod "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" (UID: "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:37:01.994961 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:01.994926    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-podinfo" pod "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" (UID: "b4ed359a-7eea-49c4-b2b9-0c9ca46393d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:37:02.093741 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.093708    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:02.093741 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.093731    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:02.093741 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.093743    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:02.093952 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.093752    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:02.093952 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.093761    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:02.093952 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.093770    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvfc5\" (UniqueName: \"kubernetes.io/projected/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6-kube-api-access-fvfc5\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:02.157296 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:37:02.157254    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:37:02.355248 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.355150    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:02.698160 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.698129    4918 generic.go:356] "Generic (PLEG): container finished" podID="b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" containerID="11f43408dbba68f50ff9a675393ed1bf2919209fcc1d658e026d80e85cbedcb7" exitCode=0
Oct 30 22:37:02.698347 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.698186    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"
Oct 30 22:37:02.698347 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.698209    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n" event={"ID":"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6","Type":"ContainerDied","Data":"11f43408dbba68f50ff9a675393ed1bf2919209fcc1d658e026d80e85cbedcb7"}
Oct 30 22:37:02.698347 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.698265    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n" event={"ID":"b4ed359a-7eea-49c4-b2b9-0c9ca46393d6","Type":"ContainerDied","Data":"d7888a9f398a593b77cd6aa53078254579f52c9f735317ee83b704a3290a0749"}
Oct 30 22:37:02.698347 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.698289    4918 scope.go:122] "RemoveContainer" containerID="11f43408dbba68f50ff9a675393ed1bf2919209fcc1d658e026d80e85cbedcb7"
Oct 30 22:37:02.707389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.707371    4918 scope.go:122] "RemoveContainer" containerID="a9f5102059e43d895d91cae02c3deafbbb925ba13fdd048b326573ebf11dbe6a"
Oct 30 22:37:02.715494 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.715475    4918 scope.go:122] "RemoveContainer" containerID="11f43408dbba68f50ff9a675393ed1bf2919209fcc1d658e026d80e85cbedcb7"
Oct 30 22:37:02.715771 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:37:02.715751    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11f43408dbba68f50ff9a675393ed1bf2919209fcc1d658e026d80e85cbedcb7\": container with ID starting with 11f43408dbba68f50ff9a675393ed1bf2919209fcc1d658e026d80e85cbedcb7 not found: ID does not exist" containerID="11f43408dbba68f50ff9a675393ed1bf2919209fcc1d658e026d80e85cbedcb7"
Oct 30 22:37:02.715855 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.715780    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11f43408dbba68f50ff9a675393ed1bf2919209fcc1d658e026d80e85cbedcb7"} err="failed to get container status \"11f43408dbba68f50ff9a675393ed1bf2919209fcc1d658e026d80e85cbedcb7\": rpc error: code = NotFound desc = could not find container \"11f43408dbba68f50ff9a675393ed1bf2919209fcc1d658e026d80e85cbedcb7\": container with ID starting with 11f43408dbba68f50ff9a675393ed1bf2919209fcc1d658e026d80e85cbedcb7 not found: ID does not exist"
Oct 30 22:37:02.715855 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.715797    4918 scope.go:122] "RemoveContainer" containerID="a9f5102059e43d895d91cae02c3deafbbb925ba13fdd048b326573ebf11dbe6a"
Oct 30 22:37:02.716035 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:37:02.716022    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9f5102059e43d895d91cae02c3deafbbb925ba13fdd048b326573ebf11dbe6a\": container with ID starting with a9f5102059e43d895d91cae02c3deafbbb925ba13fdd048b326573ebf11dbe6a not found: ID does not exist" containerID="a9f5102059e43d895d91cae02c3deafbbb925ba13fdd048b326573ebf11dbe6a"
Oct 30 22:37:02.716080 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.716040    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9f5102059e43d895d91cae02c3deafbbb925ba13fdd048b326573ebf11dbe6a"} err="failed to get container status \"a9f5102059e43d895d91cae02c3deafbbb925ba13fdd048b326573ebf11dbe6a\": rpc error: code = NotFound desc = could not find container \"a9f5102059e43d895d91cae02c3deafbbb925ba13fdd048b326573ebf11dbe6a\": container with ID starting with a9f5102059e43d895d91cae02c3deafbbb925ba13fdd048b326573ebf11dbe6a not found: ID does not exist"
Oct 30 22:37:02.868172 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.868138    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"]
Oct 30 22:37:02.917372 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:02.917335    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w4-d1ca4b-openshift-default-6bf77dddd7-2kc9n"]
Oct 30 22:37:04.071925 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:04.071893    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" path="/var/lib/kubelet/pods/b4ed359a-7eea-49c4-b2b9-0c9ca46393d6/volumes"
Oct 30 22:37:04.443187 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:04.443152    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:08.093891 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:08.093847    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"]
Oct 30 22:37:08.467034 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:08.466991    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:08.767235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:08.767139    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:13.094556 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:13.094496    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv" podUID="627ab374-d53d-4ade-a310-a61333cc74b2" containerName="payload-pre-processing" containerID="cri-o://934dab25e02268cae87267f00db962fd057e41386b578d0172bdbfa5f6f97486" gracePeriod=25
Oct 30 22:37:20.789235 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:20.789183    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv" podUID="627ab374-d53d-4ade-a310-a61333cc74b2" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:37:23.675346 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:23.675304    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"]
Oct 30 22:37:23.675827 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:23.675580    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5" podUID="0579a89d-adad-4b2a-ab61-1b8aee98905b" containerName="maas-api" containerID="cri-o://1f8aa9115842cf2e94b5a1f6363cb354c3e4c395637e734a215a8ebe9f08e5ca" gracePeriod=30
Oct 30 22:37:23.812913 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:23.812878    4918 generic.go:356] "Generic (PLEG): container finished" podID="0579a89d-adad-4b2a-ab61-1b8aee98905b" containerID="1f8aa9115842cf2e94b5a1f6363cb354c3e4c395637e734a215a8ebe9f08e5ca" exitCode=0
Oct 30 22:37:23.813101 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:23.812947    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5" event={"ID":"0579a89d-adad-4b2a-ab61-1b8aee98905b","Type":"ContainerDied","Data":"1f8aa9115842cf2e94b5a1f6363cb354c3e4c395637e734a215a8ebe9f08e5ca"}
Oct 30 22:37:23.889593 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:23.889555    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:23.931938 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:23.931881    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 22:37:23.986876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:23.986848    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0579a89d-adad-4b2a-ab61-1b8aee98905b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0579a89d-adad-4b2a-ab61-1b8aee98905b-openshift-service-ca\") pod \"0579a89d-adad-4b2a-ab61-1b8aee98905b\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") "
Oct 30 22:37:23.987011 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:23.986883    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-metrics-certs\") pod \"0579a89d-adad-4b2a-ab61-1b8aee98905b\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") "
Oct 30 22:37:23.987011 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:23.986944    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0579a89d-adad-4b2a-ab61-1b8aee98905b-kube-api-access-r6bpm\" (UniqueName: \"kubernetes.io/projected/0579a89d-adad-4b2a-ab61-1b8aee98905b-kube-api-access-r6bpm\") pod \"0579a89d-adad-4b2a-ab61-1b8aee98905b\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") "
Oct 30 22:37:23.987011 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:23.987003    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-maas-api-tls\") pod \"0579a89d-adad-4b2a-ab61-1b8aee98905b\" (UID: \"0579a89d-adad-4b2a-ab61-1b8aee98905b\") "
Oct 30 22:37:23.987272 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:23.987249    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0579a89d-adad-4b2a-ab61-1b8aee98905b-openshift-service-ca" pod "0579a89d-adad-4b2a-ab61-1b8aee98905b" (UID: "0579a89d-adad-4b2a-ab61-1b8aee98905b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:37:23.989080 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:23.989047    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-metrics-certs" pod "0579a89d-adad-4b2a-ab61-1b8aee98905b" (UID: "0579a89d-adad-4b2a-ab61-1b8aee98905b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:37:23.989188 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:23.989107    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0579a89d-adad-4b2a-ab61-1b8aee98905b-kube-api-access-r6bpm" pod "0579a89d-adad-4b2a-ab61-1b8aee98905b" (UID: "0579a89d-adad-4b2a-ab61-1b8aee98905b"). InnerVolumeSpecName "kube-api-access-r6bpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:37:23.989188 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:23.989135    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-maas-api-tls" pod "0579a89d-adad-4b2a-ab61-1b8aee98905b" (UID: "0579a89d-adad-4b2a-ab61-1b8aee98905b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:37:24.088343 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:24.088317    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:24.088343 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:24.088344    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0579a89d-adad-4b2a-ab61-1b8aee98905b-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:24.088494 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:24.088354    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0579a89d-adad-4b2a-ab61-1b8aee98905b-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:24.088494 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:24.088363    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6bpm\" (UniqueName: \"kubernetes.io/projected/0579a89d-adad-4b2a-ab61-1b8aee98905b-kube-api-access-r6bpm\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:24.524266 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:24.524237    4918 scope.go:122] "RemoveContainer" containerID="1f8aa9115842cf2e94b5a1f6363cb354c3e4c395637e734a215a8ebe9f08e5ca"
Oct 30 22:37:24.817901 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:24.817812    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5" event={"ID":"0579a89d-adad-4b2a-ab61-1b8aee98905b","Type":"ContainerDied","Data":"ef8c0b126c68e490c0c5a8d2666a1e0a78a1d849c5872bfc4326314ca7062b06"}
Oct 30 22:37:24.817901 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:24.817857    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"
Oct 30 22:37:24.862391 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:24.862340    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:25.046886 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:25.046860    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"]
Oct 30 22:37:25.051186 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:25.051163    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-536975-66b74bd49b-98nd5"]
Oct 30 22:37:25.116744 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:25.116646    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:25.469339 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:25.469302    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:25.826220 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:25.826112    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:26.071853 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:26.071823    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0579a89d-adad-4b2a-ab61-1b8aee98905b" path="/var/lib/kubelet/pods/0579a89d-adad-4b2a-ab61-1b8aee98905b/volumes"
Oct 30 22:37:26.434308 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:26.434271    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:30.788313 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:30.788233    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv" podUID="627ab374-d53d-4ade-a310-a61333cc74b2" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:37:31.279781 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:31.279724    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:31.602094 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:31.602010    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:32.157523 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:37:32.157487    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:37:33.323182 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.323143    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:33.344431 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.344408    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"
Oct 30 22:37:33.463974 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.463942    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/627ab374-d53d-4ade-a310-a61333cc74b2-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/627ab374-d53d-4ade-a310-a61333cc74b2-plugins-config-volume\") pod \"627ab374-d53d-4ade-a310-a61333cc74b2\" (UID: \"627ab374-d53d-4ade-a310-a61333cc74b2\") "
Oct 30 22:37:33.464140 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.464030    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/627ab374-d53d-4ade-a310-a61333cc74b2-kube-api-access-j8tt5\" (UniqueName: \"kubernetes.io/projected/627ab374-d53d-4ade-a310-a61333cc74b2-kube-api-access-j8tt5\") pod \"627ab374-d53d-4ade-a310-a61333cc74b2\" (UID: \"627ab374-d53d-4ade-a310-a61333cc74b2\") "
Oct 30 22:37:33.464421 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.464392    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/627ab374-d53d-4ade-a310-a61333cc74b2-plugins-config-volume" pod "627ab374-d53d-4ade-a310-a61333cc74b2" (UID: "627ab374-d53d-4ade-a310-a61333cc74b2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:37:33.466715 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.466666    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/627ab374-d53d-4ade-a310-a61333cc74b2-kube-api-access-j8tt5" pod "627ab374-d53d-4ade-a310-a61333cc74b2" (UID: "627ab374-d53d-4ade-a310-a61333cc74b2"). InnerVolumeSpecName "kube-api-access-j8tt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:37:33.565556 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.565519    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8tt5\" (UniqueName: \"kubernetes.io/projected/627ab374-d53d-4ade-a310-a61333cc74b2-kube-api-access-j8tt5\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:33.565556 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.565549    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/627ab374-d53d-4ade-a310-a61333cc74b2-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:37:33.634001 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.633955    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:33.862303 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.862223    4918 generic.go:356] "Generic (PLEG): container finished" podID="627ab374-d53d-4ade-a310-a61333cc74b2" containerID="934dab25e02268cae87267f00db962fd057e41386b578d0172bdbfa5f6f97486" exitCode=0
Oct 30 22:37:33.862303 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.862276    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"
Oct 30 22:37:33.862522 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.862314    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv" event={"ID":"627ab374-d53d-4ade-a310-a61333cc74b2","Type":"ContainerDied","Data":"934dab25e02268cae87267f00db962fd057e41386b578d0172bdbfa5f6f97486"}
Oct 30 22:37:33.862522 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.862367    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv" event={"ID":"627ab374-d53d-4ade-a310-a61333cc74b2","Type":"ContainerDied","Data":"9db98d689d25bb11c08e058780ada08ad2e37169cfe653ac997f949f225e8316"}
Oct 30 22:37:33.862522 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.862405    4918 scope.go:122] "RemoveContainer" containerID="934dab25e02268cae87267f00db962fd057e41386b578d0172bdbfa5f6f97486"
Oct 30 22:37:33.872302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.872283    4918 scope.go:122] "RemoveContainer" containerID="934dab25e02268cae87267f00db962fd057e41386b578d0172bdbfa5f6f97486"
Oct 30 22:37:33.872628 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:37:33.872607    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"934dab25e02268cae87267f00db962fd057e41386b578d0172bdbfa5f6f97486\": container with ID starting with 934dab25e02268cae87267f00db962fd057e41386b578d0172bdbfa5f6f97486 not found: ID does not exist" containerID="934dab25e02268cae87267f00db962fd057e41386b578d0172bdbfa5f6f97486"
Oct 30 22:37:33.872725 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.872637    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"934dab25e02268cae87267f00db962fd057e41386b578d0172bdbfa5f6f97486"} err="failed to get container status \"934dab25e02268cae87267f00db962fd057e41386b578d0172bdbfa5f6f97486\": rpc error: code = NotFound desc = could not find container \"934dab25e02268cae87267f00db962fd057e41386b578d0172bdbfa5f6f97486\": container with ID starting with 934dab25e02268cae87267f00db962fd057e41386b578d0172bdbfa5f6f97486 not found: ID does not exist"
Oct 30 22:37:33.948383 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:33.948363    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:34.030136 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:34.030114    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"]
Oct 30 22:37:34.079354 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:34.079329    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-536975-85b7797d79-lgbvv"]
Oct 30 22:37:36.070313 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:36.070279    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="627ab374-d53d-4ade-a310-a61333cc74b2" path="/var/lib/kubelet/pods/627ab374-d53d-4ade-a310-a61333cc74b2/volumes"
Oct 30 22:37:39.828291 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:39.828252    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:40.640268 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:40.640234    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:40.898646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:40.898560    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:41.158135 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:41.158049    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:47.177165 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:47.177128    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:52.965111 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:52.965077    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:54.266969 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:37:54.266925    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:02.157093 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:38:02.157051    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:38:15.248415 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248342    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"]
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248718    4918 cpu_manager.go:414] "containerMap: removing container" podUID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" containerName="istio-proxy"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248730    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" containerName="istio-proxy"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248746    4918 cpu_manager.go:414] "containerMap: removing container" podUID="29baa21c-a90a-44d3-815d-595c1dc1b14f" containerName="maas-api"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248751    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29baa21c-a90a-44d3-815d-595c1dc1b14f" containerName="maas-api"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248763    4918 cpu_manager.go:414] "containerMap: removing container" podUID="06314e3b-fd5b-4f37-8ec0-f4b187a635e9" containerName="payload-processing"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248770    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06314e3b-fd5b-4f37-8ec0-f4b187a635e9" containerName="payload-processing"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248779    4918 cpu_manager.go:414] "containerMap: removing container" podUID="fa1a78dc-c5da-469a-af25-77d846ba4e92" containerName="istio-proxy"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248786    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa1a78dc-c5da-469a-af25-77d846ba4e92" containerName="istio-proxy"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248795    4918 cpu_manager.go:414] "containerMap: removing container" podUID="966cb5c4-9d3a-410f-bd2c-87cf0927bf1f" containerName="payload-pre-processing"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248800    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="966cb5c4-9d3a-410f-bd2c-87cf0927bf1f" containerName="payload-pre-processing"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248807    4918 cpu_manager.go:414] "containerMap: removing container" podUID="aeb7445e-8468-474e-be2d-4b67b15e7a2a" containerName="main"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248811    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aeb7445e-8468-474e-be2d-4b67b15e7a2a" containerName="main"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248821    4918 cpu_manager.go:414] "containerMap: removing container" podUID="33219300-9dcb-4ae5-9511-900ff02b91ef" containerName="payload-pre-processing"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248826    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33219300-9dcb-4ae5-9511-900ff02b91ef" containerName="payload-pre-processing"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248835    4918 cpu_manager.go:414] "containerMap: removing container" podUID="cf6c1371-8fc2-4017-b5b2-510b4707b61e" containerName="istio-proxy"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248839    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf6c1371-8fc2-4017-b5b2-510b4707b61e" containerName="istio-proxy"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248846    4918 cpu_manager.go:414] "containerMap: removing container" podUID="c637c629-35bf-4b7e-9e5e-85e17cd23837" containerName="maas-api"
Oct 30 22:38:15.248844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248850    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c637c629-35bf-4b7e-9e5e-85e17cd23837" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248859    4918 cpu_manager.go:414] "containerMap: removing container" podUID="131996b0-d9f3-4da0-86a7-c998ebd3407f" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248868    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="131996b0-d9f3-4da0-86a7-c998ebd3407f" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248877    4918 cpu_manager.go:414] "containerMap: removing container" podUID="b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" containerName="istio-proxy"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248881    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" containerName="istio-proxy"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248893    4918 cpu_manager.go:414] "containerMap: removing container" podUID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" containerName="istio-proxy"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248897    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" containerName="istio-proxy"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248902    4918 cpu_manager.go:414] "containerMap: removing container" podUID="001d2e93-a0fb-4b18-9380-d3adacd51379" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248906    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="001d2e93-a0fb-4b18-9380-d3adacd51379" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248916    4918 cpu_manager.go:414] "containerMap: removing container" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248920    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248926    4918 cpu_manager.go:414] "containerMap: removing container" podUID="74f7d9ce-7772-4b84-8a7b-c0612ad81e8f" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248930    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="74f7d9ce-7772-4b84-8a7b-c0612ad81e8f" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248938    4918 cpu_manager.go:414] "containerMap: removing container" podUID="627ab374-d53d-4ade-a310-a61333cc74b2" containerName="payload-pre-processing"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248945    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="627ab374-d53d-4ade-a310-a61333cc74b2" containerName="payload-pre-processing"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248957    4918 cpu_manager.go:414] "containerMap: removing container" podUID="fa1a78dc-c5da-469a-af25-77d846ba4e92" containerName="istio-proxy"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248962    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa1a78dc-c5da-469a-af25-77d846ba4e92" containerName="istio-proxy"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248967    4918 cpu_manager.go:414] "containerMap: removing container" podUID="40d4d570-e10e-4be3-955f-36e0e1872fd3" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248972    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="40d4d570-e10e-4be3-955f-36e0e1872fd3" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248980    4918 cpu_manager.go:414] "containerMap: removing container" podUID="b3766273-8b07-490e-b256-34bfac3b0483" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248984    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b3766273-8b07-490e-b256-34bfac3b0483" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248991    4918 cpu_manager.go:414] "containerMap: removing container" podUID="0579a89d-adad-4b2a-ab61-1b8aee98905b" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.248995    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0579a89d-adad-4b2a-ab61-1b8aee98905b" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249058    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf6c1371-8fc2-4017-b5b2-510b4707b61e" containerName="istio-proxy"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249066    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="c637c629-35bf-4b7e-9e5e-85e17cd23837" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249073    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="131996b0-d9f3-4da0-86a7-c998ebd3407f" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249078    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" containerName="istio-proxy"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249083    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" containerName="istio-proxy"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249088    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="001d2e93-a0fb-4b18-9380-d3adacd51379" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249095    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="18bcad2c-343d-490f-9207-fd77e5dfe3aa" containerName="main"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249104    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="74f7d9ce-7772-4b84-8a7b-c0612ad81e8f" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249113    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="627ab374-d53d-4ade-a310-a61333cc74b2" containerName="payload-pre-processing"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249119    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa1a78dc-c5da-469a-af25-77d846ba4e92" containerName="istio-proxy"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249124    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="40d4d570-e10e-4be3-955f-36e0e1872fd3" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249129    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" containerName="istio-proxy"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249134    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="b3766273-8b07-490e-b256-34bfac3b0483" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249139    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="0579a89d-adad-4b2a-ab61-1b8aee98905b" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249144    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="4ac242a8-aab1-4e8b-83fd-5c25425d417a" containerName="istio-proxy"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249150    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="29baa21c-a90a-44d3-815d-595c1dc1b14f" containerName="maas-api"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249154    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="06314e3b-fd5b-4f37-8ec0-f4b187a635e9" containerName="payload-processing"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249159    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa1a78dc-c5da-469a-af25-77d846ba4e92" containerName="istio-proxy"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249164    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="966cb5c4-9d3a-410f-bd2c-87cf0927bf1f" containerName="payload-pre-processing"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249169    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="aeb7445e-8468-474e-be2d-4b67b15e7a2a" containerName="main"
Oct 30 22:38:15.249428 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.249174    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="33219300-9dcb-4ae5-9511-900ff02b91ef" containerName="payload-pre-processing"
Oct 30 22:38:15.252318 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.252303    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.304098 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.304070    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-v5mg8\""
Oct 30 22:38:15.354860 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.354832    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"]
Oct 30 22:38:15.422787 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.422760    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/821a7805-3799-4db3-81fb-4b2f9e63bd8d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.423011 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.422792    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/821a7805-3799-4db3-81fb-4b2f9e63bd8d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.423011 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.422894    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/821a7805-3799-4db3-81fb-4b2f9e63bd8d-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.423011 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.422911    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55vb5\" (UniqueName: \"kubernetes.io/projected/821a7805-3799-4db3-81fb-4b2f9e63bd8d-kube-api-access-55vb5\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.423011 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.422982    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/821a7805-3799-4db3-81fb-4b2f9e63bd8d-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.423226 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.423026    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/821a7805-3799-4db3-81fb-4b2f9e63bd8d-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.423226 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.423103    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/821a7805-3799-4db3-81fb-4b2f9e63bd8d-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.423226 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.423158    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/821a7805-3799-4db3-81fb-4b2f9e63bd8d-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.423226 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.423197    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/821a7805-3799-4db3-81fb-4b2f9e63bd8d-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.524104 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.524012    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/821a7805-3799-4db3-81fb-4b2f9e63bd8d-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.524104 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.524060    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55vb5\" (UniqueName: \"kubernetes.io/projected/821a7805-3799-4db3-81fb-4b2f9e63bd8d-kube-api-access-55vb5\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.524104 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.524092    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/821a7805-3799-4db3-81fb-4b2f9e63bd8d-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.524394 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.524118    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/821a7805-3799-4db3-81fb-4b2f9e63bd8d-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.524394 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.524144    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/821a7805-3799-4db3-81fb-4b2f9e63bd8d-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.524394 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.524174    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/821a7805-3799-4db3-81fb-4b2f9e63bd8d-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.524394 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.524225    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/821a7805-3799-4db3-81fb-4b2f9e63bd8d-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.524394 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.524281    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/821a7805-3799-4db3-81fb-4b2f9e63bd8d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.524394 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.524311    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/821a7805-3799-4db3-81fb-4b2f9e63bd8d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.524742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.524458    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/821a7805-3799-4db3-81fb-4b2f9e63bd8d-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.524742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.524616    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/821a7805-3799-4db3-81fb-4b2f9e63bd8d-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.524742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.524658    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/821a7805-3799-4db3-81fb-4b2f9e63bd8d-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.524742 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.524711    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/821a7805-3799-4db3-81fb-4b2f9e63bd8d-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.525064 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.525043    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/821a7805-3799-4db3-81fb-4b2f9e63bd8d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.526652 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.526631    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/821a7805-3799-4db3-81fb-4b2f9e63bd8d-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.526864 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.526847    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/821a7805-3799-4db3-81fb-4b2f9e63bd8d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.584538 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.584515    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/821a7805-3799-4db3-81fb-4b2f9e63bd8d-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.584746 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.584729    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55vb5\" (UniqueName: \"kubernetes.io/projected/821a7805-3799-4db3-81fb-4b2f9e63bd8d-kube-api-access-55vb5\") pod \"maas-default-gateway-openshift-default-6cc458d887-5sbz9\" (UID: \"821a7805-3799-4db3-81fb-4b2f9e63bd8d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:15.864620 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:15.864555    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:16.292892 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:16.292751    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"]
Oct 30 22:38:16.295553 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:38:16.295516    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod821a7805_3799_4db3_81fb_4b2f9e63bd8d.slice/crio-ec52b1110ec9b2c06197879dbb32470ad8a938f95ace7669e5f886fd71220dc7 WatchSource:0}: Error finding container ec52b1110ec9b2c06197879dbb32470ad8a938f95ace7669e5f886fd71220dc7: Status 404 returned error can't find the container with id ec52b1110ec9b2c06197879dbb32470ad8a938f95ace7669e5f886fd71220dc7
Oct 30 22:38:16.297540 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:16.297508    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:38:16.297625 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:16.297576    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:38:16.297625 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:16.297609    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:38:17.066952 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:17.066914    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9" event={"ID":"821a7805-3799-4db3-81fb-4b2f9e63bd8d","Type":"ContainerStarted","Data":"c05abd101aadb64975e5f6fc23e89eba55ed72e36a515149861339b52b81f95f"}
Oct 30 22:38:17.067128 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:17.066971    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9" event={"ID":"821a7805-3799-4db3-81fb-4b2f9e63bd8d","Type":"ContainerStarted","Data":"ec52b1110ec9b2c06197879dbb32470ad8a938f95ace7669e5f886fd71220dc7"}
Oct 30 22:38:17.286852 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:17.286801    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9" podStartSLOduration=2.286788152 podStartE2EDuration="2.286788152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:38:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:38:17.236407196 +0000 UTC m=+3235.285014894" watchObservedRunningTime="2026-10-30 22:38:17.286788152 +0000 UTC m=+3235.335395846"
Oct 30 22:38:17.864983 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:17.864948    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:17.866824 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:17.866794    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-5sbz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.138:15021/healthz/ready\": dial tcp 10.132.0.138:15021: connect: connection refused" start-of-body=
Oct 30 22:38:17.866980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:17.866861    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9" podUID="821a7805-3799-4db3-81fb-4b2f9e63bd8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.138:15021/healthz/ready\": dial tcp 10.132.0.138:15021: connect: connection refused"
Oct 30 22:38:18.865911 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:18.865875    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-5sbz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.138:15021/healthz/ready\": dial tcp 10.132.0.138:15021: connect: connection refused" start-of-body=
Oct 30 22:38:18.866322 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:18.865948    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9" podUID="821a7805-3799-4db3-81fb-4b2f9e63bd8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.138:15021/healthz/ready\": dial tcp 10.132.0.138:15021: connect: connection refused"
Oct 30 22:38:19.865352 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:19.865308    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-5sbz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.138:15021/healthz/ready\": dial tcp 10.132.0.138:15021: connect: connection refused" start-of-body=
Oct 30 22:38:19.865584 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:19.865380    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9" podUID="821a7805-3799-4db3-81fb-4b2f9e63bd8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.138:15021/healthz/ready\": dial tcp 10.132.0.138:15021: connect: connection refused"
Oct 30 22:38:20.865931 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:20.865892    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-5sbz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.138:15021/healthz/ready\": dial tcp 10.132.0.138:15021: connect: connection refused" start-of-body=
Oct 30 22:38:20.866331 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:20.865948    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9" podUID="821a7805-3799-4db3-81fb-4b2f9e63bd8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.138:15021/healthz/ready\": dial tcp 10.132.0.138:15021: connect: connection refused"
Oct 30 22:38:21.865641 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:21.865600    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-5sbz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.138:15021/healthz/ready\": dial tcp 10.132.0.138:15021: connect: connection refused" start-of-body=
Oct 30 22:38:21.865849 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:21.865718    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9" podUID="821a7805-3799-4db3-81fb-4b2f9e63bd8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.138:15021/healthz/ready\": dial tcp 10.132.0.138:15021: connect: connection refused"
Oct 30 22:38:22.865169 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:22.865130    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-5sbz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.138:15021/healthz/ready\": dial tcp 10.132.0.138:15021: connect: connection refused" start-of-body=
Oct 30 22:38:22.865646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:22.865183    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9" podUID="821a7805-3799-4db3-81fb-4b2f9e63bd8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.138:15021/healthz/ready\": dial tcp 10.132.0.138:15021: connect: connection refused"
Oct 30 22:38:24.499283 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:24.499244    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:24.499862 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:24.499841    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:24.501244 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:24.501222    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9"
Oct 30 22:38:32.156072 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:38:32.156032    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:38:33.127248 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:33.127213    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:33.382874 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:33.382780    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:35.414456 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:38:35.414417    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:02.158141 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:39:02.158054    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:39:07.742052 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:39:07.742016    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:08.005446 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:39:08.005361    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:11.362879 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:39:11.362843    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:11.623130 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:39:11.623046    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:22.465105 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:39:22.465078    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:39:22.494612 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:39:22.494584    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:39:32.082350 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:39:32.082313    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:39:32.157184 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:39:32.157138    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:40:01.059778 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.059741    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"]
Oct 30 22:40:01.062342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.060142    4918 cpu_manager.go:414] "containerMap: removing container" podUID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" containerName="istio-proxy"
Oct 30 22:40:01.062342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.060154    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9ce2ffe-a1e7-4116-be92-bf72fa2e5a2a" containerName="istio-proxy"
Oct 30 22:40:01.062342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.060187    4918 cpu_manager.go:414] "containerMap: removing container" podUID="cf6c1371-8fc2-4017-b5b2-510b4707b61e" containerName="istio-proxy"
Oct 30 22:40:01.062342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.060193    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf6c1371-8fc2-4017-b5b2-510b4707b61e" containerName="istio-proxy"
Oct 30 22:40:01.062342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.060201    4918 cpu_manager.go:414] "containerMap: removing container" podUID="b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" containerName="istio-proxy"
Oct 30 22:40:01.062342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.060206    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" containerName="istio-proxy"
Oct 30 22:40:01.062342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.060262    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf6c1371-8fc2-4017-b5b2-510b4707b61e" containerName="istio-proxy"
Oct 30 22:40:01.062342 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.060271    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="b4ed359a-7eea-49c4-b2b9-0c9ca46393d6" containerName="istio-proxy"
Oct 30 22:40:01.063297 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.063274    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.132735 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.132669    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50077ca0-3a9d-468c-ac63-cee24e5cabf2-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.132735 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.132732    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50077ca0-3a9d-468c-ac63-cee24e5cabf2-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.133006 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.132818    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50077ca0-3a9d-468c-ac63-cee24e5cabf2-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.133006 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.132856    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50077ca0-3a9d-468c-ac63-cee24e5cabf2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.133006 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.132920    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86dql\" (UniqueName: \"kubernetes.io/projected/50077ca0-3a9d-468c-ac63-cee24e5cabf2-kube-api-access-86dql\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.133006 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.132951    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50077ca0-3a9d-468c-ac63-cee24e5cabf2-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.133006 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.132978    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50077ca0-3a9d-468c-ac63-cee24e5cabf2-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.133212 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.133100    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50077ca0-3a9d-468c-ac63-cee24e5cabf2-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.133212 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.133148    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50077ca0-3a9d-468c-ac63-cee24e5cabf2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.167243 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.167209    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"]
Oct 30 22:40:01.233800 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.233765    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50077ca0-3a9d-468c-ac63-cee24e5cabf2-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.234015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.233822    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50077ca0-3a9d-468c-ac63-cee24e5cabf2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.234015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.233847    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50077ca0-3a9d-468c-ac63-cee24e5cabf2-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.234015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.233865    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50077ca0-3a9d-468c-ac63-cee24e5cabf2-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.234015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.233892    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50077ca0-3a9d-468c-ac63-cee24e5cabf2-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.234015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.233923    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50077ca0-3a9d-468c-ac63-cee24e5cabf2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.234015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.233962    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86dql\" (UniqueName: \"kubernetes.io/projected/50077ca0-3a9d-468c-ac63-cee24e5cabf2-kube-api-access-86dql\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.234015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.233998    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50077ca0-3a9d-468c-ac63-cee24e5cabf2-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.234408 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.234023    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50077ca0-3a9d-468c-ac63-cee24e5cabf2-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.234408 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.234288    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50077ca0-3a9d-468c-ac63-cee24e5cabf2-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.234408 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.234364    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50077ca0-3a9d-468c-ac63-cee24e5cabf2-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.234579 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.234421    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50077ca0-3a9d-468c-ac63-cee24e5cabf2-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.234739 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.234715    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50077ca0-3a9d-468c-ac63-cee24e5cabf2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.234836 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.234822    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50077ca0-3a9d-468c-ac63-cee24e5cabf2-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.236557 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.236529    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50077ca0-3a9d-468c-ac63-cee24e5cabf2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.236695 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.236575    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50077ca0-3a9d-468c-ac63-cee24e5cabf2-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.300125 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.300089    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50077ca0-3a9d-468c-ac63-cee24e5cabf2-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.300314 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.300225    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86dql\" (UniqueName: \"kubernetes.io/projected/50077ca0-3a9d-468c-ac63-cee24e5cabf2-kube-api-access-86dql\") pod \"maas-default-gateway-openshift-default-6cc458d887-ksktz\" (UID: \"50077ca0-3a9d-468c-ac63-cee24e5cabf2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.377255 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.377153    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:01.809285 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.809097    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"]
Oct 30 22:40:01.812024 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:40:01.811997    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50077ca0_3a9d_468c_ac63_cee24e5cabf2.slice/crio-7289de07eda7c1e6e9a9639cf23c4cf91f2dc13d68a1770a6257ce967c714f4e WatchSource:0}: Error finding container 7289de07eda7c1e6e9a9639cf23c4cf91f2dc13d68a1770a6257ce967c714f4e: Status 404 returned error can't find the container with id 7289de07eda7c1e6e9a9639cf23c4cf91f2dc13d68a1770a6257ce967c714f4e
Oct 30 22:40:01.814177 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.814146    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:40:01.814261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.814214    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:40:01.814261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:01.814244    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:40:02.158345 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:40:02.158296    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:40:02.532260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:02.532173    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz" event={"ID":"50077ca0-3a9d-468c-ac63-cee24e5cabf2","Type":"ContainerStarted","Data":"d39901ece293e893e1a3853ce3e0379376964c8526ba175296964f09ec6b7553"}
Oct 30 22:40:02.532260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:02.532234    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz" event={"ID":"50077ca0-3a9d-468c-ac63-cee24e5cabf2","Type":"ContainerStarted","Data":"7289de07eda7c1e6e9a9639cf23c4cf91f2dc13d68a1770a6257ce967c714f4e"}
Oct 30 22:40:02.712706 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:02.705824    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz" podStartSLOduration=1.7058039090000001 podStartE2EDuration="1.705803909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:40:02.703157629 +0000 UTC m=+3340.751765325" watchObservedRunningTime="2026-10-30 22:40:02.705803909 +0000 UTC m=+3340.754411605"
Oct 30 22:40:03.377487 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:03.377444    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:03.379039 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:03.379015    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-ksktz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 22:40:03.379152 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:03.379063    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz" podUID="50077ca0-3a9d-468c-ac63-cee24e5cabf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 22:40:04.377738 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:04.377698    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-ksktz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 22:40:04.378259 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:04.377764    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz" podUID="50077ca0-3a9d-468c-ac63-cee24e5cabf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 22:40:05.377707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:05.377647    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-ksktz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 22:40:05.377914 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:05.377738    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz" podUID="50077ca0-3a9d-468c-ac63-cee24e5cabf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 22:40:06.378600 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:06.378560    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-ksktz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 22:40:06.379059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:06.378636    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz" podUID="50077ca0-3a9d-468c-ac63-cee24e5cabf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 22:40:07.378485 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:07.378437    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-ksktz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 22:40:07.378704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:07.378519    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz" podUID="50077ca0-3a9d-468c-ac63-cee24e5cabf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 22:40:08.377967 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:08.377930    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-ksktz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused" start-of-body=
Oct 30 22:40:08.378144 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:08.377999    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz" podUID="50077ca0-3a9d-468c-ac63-cee24e5cabf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": dial tcp 10.132.0.139:15021: connect: connection refused"
Oct 30 22:40:10.041509 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:10.041478    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:10.042056 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:10.041887    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:10.042734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:10.042715    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz"
Oct 30 22:40:16.190241 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.190208    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"]
Oct 30 22:40:16.193675 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.193654    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.296953 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.296919    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"]
Oct 30 22:40:16.299071 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.299049    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/132065c1-06b5-45d6-883c-464cec396f68-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.299192 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.299090    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/132065c1-06b5-45d6-883c-464cec396f68-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.299192 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.299116    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/132065c1-06b5-45d6-883c-464cec396f68-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.299293 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.299252    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/132065c1-06b5-45d6-883c-464cec396f68-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.299348 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.299289    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/132065c1-06b5-45d6-883c-464cec396f68-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.299348 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.299312    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/132065c1-06b5-45d6-883c-464cec396f68-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.299431 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.299412    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvj2b\" (UniqueName: \"kubernetes.io/projected/132065c1-06b5-45d6-883c-464cec396f68-kube-api-access-cvj2b\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.299471 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.299454    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/132065c1-06b5-45d6-883c-464cec396f68-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.299524 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.299486    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/132065c1-06b5-45d6-883c-464cec396f68-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.400003 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.399975    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/132065c1-06b5-45d6-883c-464cec396f68-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.400162 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.400026    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/132065c1-06b5-45d6-883c-464cec396f68-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.400162 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.400057    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/132065c1-06b5-45d6-883c-464cec396f68-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.400301 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.400182    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/132065c1-06b5-45d6-883c-464cec396f68-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.400301 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.400252    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvj2b\" (UniqueName: \"kubernetes.io/projected/132065c1-06b5-45d6-883c-464cec396f68-kube-api-access-cvj2b\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.400415 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.400313    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/132065c1-06b5-45d6-883c-464cec396f68-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.400415 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.400381    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/132065c1-06b5-45d6-883c-464cec396f68-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.400415 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.400391    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/132065c1-06b5-45d6-883c-464cec396f68-istio-data\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.400576 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.400430    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/132065c1-06b5-45d6-883c-464cec396f68-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.400576 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.400444    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/132065c1-06b5-45d6-883c-464cec396f68-workload-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.400576 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.400468    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/132065c1-06b5-45d6-883c-464cec396f68-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.400799 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.400779    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/132065c1-06b5-45d6-883c-464cec396f68-credential-socket\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.400853 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.400801    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/132065c1-06b5-45d6-883c-464cec396f68-workload-certs\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.401222 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.401200    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/132065c1-06b5-45d6-883c-464cec396f68-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.402590 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.402566    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/132065c1-06b5-45d6-883c-464cec396f68-istio-envoy\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.402671 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.402616    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/132065c1-06b5-45d6-883c-464cec396f68-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.461256 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.461206    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/132065c1-06b5-45d6-883c-464cec396f68-istio-token\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.462050 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.462029    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvj2b\" (UniqueName: \"kubernetes.io/projected/132065c1-06b5-45d6-883c-464cec396f68-kube-api-access-cvj2b\") pod \"maas-default-gateway-openshift-default-6cc458d887-8vv2c\" (UID: \"132065c1-06b5-45d6-883c-464cec396f68\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.507322 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.507302    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:16.935852 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.935827    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"]
Oct 30 22:40:16.938621 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:40:16.938589    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod132065c1_06b5_45d6_883c_464cec396f68.slice/crio-3576f457331e08fa9eeba6a4e1b24fdd4e259d62852a9c0e8e4e7ebfed6ec40e WatchSource:0}: Error finding container 3576f457331e08fa9eeba6a4e1b24fdd4e259d62852a9c0e8e4e7ebfed6ec40e: Status 404 returned error can't find the container with id 3576f457331e08fa9eeba6a4e1b24fdd4e259d62852a9c0e8e4e7ebfed6ec40e
Oct 30 22:40:16.940773 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.940743    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:40:16.940862 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.940817    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:40:16.940862 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:16.940850    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:40:17.612149 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:17.612099    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c" event={"ID":"132065c1-06b5-45d6-883c-464cec396f68","Type":"ContainerStarted","Data":"4dccf02bfc4aacd56e183409d49a2cbbfa9ea077a728d6a88d85221b0008326c"}
Oct 30 22:40:17.612918 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:17.612884    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c" event={"ID":"132065c1-06b5-45d6-883c-464cec396f68","Type":"ContainerStarted","Data":"3576f457331e08fa9eeba6a4e1b24fdd4e259d62852a9c0e8e4e7ebfed6ec40e"}
Oct 30 22:40:17.734030 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:17.733968    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c" podStartSLOduration=1.733951663 podStartE2EDuration="1.733951663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:40:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:40:17.733455971 +0000 UTC m=+3355.782063667" watchObservedRunningTime="2026-10-30 22:40:17.733951663 +0000 UTC m=+3355.782559358"
Oct 30 22:40:18.518710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:18.515053    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:18.518710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:18.517423    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-8vv2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:40:18.518710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:18.517477    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c" podUID="132065c1-06b5-45d6-883c-464cec396f68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:40:19.512709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:19.509109    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-8vv2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:40:19.512709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:19.509171    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c" podUID="132065c1-06b5-45d6-883c-464cec396f68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:40:20.516710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:20.515779    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-8vv2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:40:20.516710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:20.515845    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c" podUID="132065c1-06b5-45d6-883c-464cec396f68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:40:21.508118 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:21.508077    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-8vv2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:40:21.508540 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:21.508509    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c" podUID="132065c1-06b5-45d6-883c-464cec396f68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:40:22.517815 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:22.517779    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-8vv2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:40:22.518215 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:22.517835    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c" podUID="132065c1-06b5-45d6-883c-464cec396f68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:40:23.508023 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:23.507988    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-8vv2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused" start-of-body=
Oct 30 22:40:23.508206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:23.508048    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c" podUID="132065c1-06b5-45d6-883c-464cec396f68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": dial tcp 10.132.0.140:15021: connect: connection refused"
Oct 30 22:40:24.665217 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:24.665181    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:24.974568 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:24.974466    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:25.188016 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:25.187984    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:25.188903 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:25.188874    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:25.189756 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:25.189733    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c"
Oct 30 22:40:32.149031 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:32.148933    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:32.157853 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:40:32.157822    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:40:32.454963 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:32.454884    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:40:33.244535 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:40:33.244492    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:02.157757 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:41:02.157712    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:41:07.034708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:41:07.022056    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:41:32.158757 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:41:32.158718    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:41:32.686210 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:41:32.686183    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:42:02.157637 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:42:02.157557    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:42:32.157569 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:42:32.157519    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:42:33.016158 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:42:33.016119    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:43:02.188464 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:43:02.188426    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:43:32.156992 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:43:32.156911    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:43:33.377343 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:43:33.377305    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:44:02.188797 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:44:02.188744    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:44:22.493127 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:44:22.493096    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:44:22.523438 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:44:22.523418    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:44:32.157669 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:44:32.157629    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:44:33.716481 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:44:33.716446    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:45:02.157362 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:45:02.157323    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:45:32.157267 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:45:32.157228    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:45:34.038822 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:45:34.038785    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:45:40.553856 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:45:40.553803    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-5sbz9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.138:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:45:40.554505 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:45:40.554469    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9" podUID="821a7805-3799-4db3-81fb-4b2f9e63bd8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.138:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:46:02.157316 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:46:02.157275    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:46:32.157389 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:46:32.157309    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:46:34.494551 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:34.494511    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:46:34.932343 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:34.932304    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:46:35.373138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.368257    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"]
Oct 30 22:46:35.384508 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.384472    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.413951 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.413914    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istiod-ca-cert\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.414118 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.413956    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-workload-socket\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.414118 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.414061    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-credential-socket\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.414206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.414115    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-podinfo\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.414206 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.414181    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-envoy\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.414281 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.414204    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ggbn\" (UniqueName: \"kubernetes.io/projected/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-kube-api-access-4ggbn\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.414317 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.414304    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-token\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.414399 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.414378    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-workload-certs\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.414452 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.414414    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-data\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.437275 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.437253    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-single-main-d0a613-openshift-default-dockercfg-hwpm4\""
Oct 30 22:46:35.488128 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.488101    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"]
Oct 30 22:46:35.516992 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.516951    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-credential-socket\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.517734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.517706    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-podinfo\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.517914 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.517896    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-envoy\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.518046 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.518029    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ggbn\" (UniqueName: \"kubernetes.io/projected/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-kube-api-access-4ggbn\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.525305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.518167    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-token\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.525305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.518246    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-workload-certs\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.525305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.518283    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-data\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.525305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.518330    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istiod-ca-cert\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.525305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.518362    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-workload-socket\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.525305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.518888    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-workload-socket\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.525305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.519407    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-credential-socket\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.525305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.521037    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-data\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.525305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.521293    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-workload-certs\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.525305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.522049    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istiod-ca-cert\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.527386 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.527355    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-podinfo\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.528050 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.528023    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-envoy\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.596005 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.595960    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-token\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.596183 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.596161    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ggbn\" (UniqueName: \"kubernetes.io/projected/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-kube-api-access-4ggbn\") pod \"e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") " pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.596263 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.596167    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:46:35.707615 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.707302    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:35.918313 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:35.918271    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:46:36.144052 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:36.144031    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"]
Oct 30 22:46:36.146801 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:46:36.146774    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc31f7d0e_104b_44ca_b3dd_1a0c5a079691.slice/crio-189ce5a4b5c5b3cd5e946b07bc60bd6ca8a87fa19f708d46f32639ea64e123ea WatchSource:0}: Error finding container 189ce5a4b5c5b3cd5e946b07bc60bd6ca8a87fa19f708d46f32639ea64e123ea: Status 404 returned error can't find the container with id 189ce5a4b5c5b3cd5e946b07bc60bd6ca8a87fa19f708d46f32639ea64e123ea
Oct 30 22:46:36.148876 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:36.148835    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:46:36.148980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:36.148920    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:46:36.148980 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:36.148963    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:46:36.549630 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:36.549550    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw" event={"ID":"c31f7d0e-104b-44ca-b3dd-1a0c5a079691","Type":"ContainerStarted","Data":"d3ab48dc754e848c3a13b2445e6c659129534aa837b54806c487a57566bdc91c"}
Oct 30 22:46:36.549630 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:36.549605    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw" event={"ID":"c31f7d0e-104b-44ca-b3dd-1a0c5a079691","Type":"ContainerStarted","Data":"189ce5a4b5c5b3cd5e946b07bc60bd6ca8a87fa19f708d46f32639ea64e123ea"}
Oct 30 22:46:36.671086 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:36.671039    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw" podStartSLOduration=1.671027262 podStartE2EDuration="1.671027262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:46:36.668750315 +0000 UTC m=+3734.717358004" watchObservedRunningTime="2026-10-30 22:46:36.671027262 +0000 UTC m=+3734.719634954"
Oct 30 22:46:36.708328 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:36.708290    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:37.713792 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:37.713762    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:38.559608 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:38.559575    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:38.560545 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:38.560525    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:46:39.719245 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:39.719200    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:46:40.031599 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:40.031517    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:46:43.076350 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:43.076305    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:46:43.345305 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:43.345217    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:46:43.520136 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:43.519997    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"]
Oct 30 22:46:43.524816 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:43.524793    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"
Oct 30 22:46:43.601043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:43.600972    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w45cc\" (UniqueName: \"kubernetes.io/projected/c7da1736-9d9c-4c82-a28e-319220f04627-kube-api-access-w45cc\") pod \"payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js\" (UID: \"c7da1736-9d9c-4c82-a28e-319220f04627\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"
Oct 30 22:46:43.601179 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:43.601143    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7da1736-9d9c-4c82-a28e-319220f04627-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js\" (UID: \"c7da1736-9d9c-4c82-a28e-319220f04627\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"
Oct 30 22:46:43.625790 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:43.625764    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-single-main-d0a613\""
Oct 30 22:46:43.625790 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:43.625778    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-single-m-5ef07a66-dockercfg-vrksx\""
Oct 30 22:46:43.627707 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:43.627670    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"]
Oct 30 22:46:43.702001 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:43.701973    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7da1736-9d9c-4c82-a28e-319220f04627-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js\" (UID: \"c7da1736-9d9c-4c82-a28e-319220f04627\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"
Oct 30 22:46:43.702116 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:43.702032    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w45cc\" (UniqueName: \"kubernetes.io/projected/c7da1736-9d9c-4c82-a28e-319220f04627-kube-api-access-w45cc\") pod \"payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js\" (UID: \"c7da1736-9d9c-4c82-a28e-319220f04627\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"
Oct 30 22:46:43.702619 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:43.702602    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7da1736-9d9c-4c82-a28e-319220f04627-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js\" (UID: \"c7da1736-9d9c-4c82-a28e-319220f04627\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"
Oct 30 22:46:43.762946 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:43.762918    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w45cc\" (UniqueName: \"kubernetes.io/projected/c7da1736-9d9c-4c82-a28e-319220f04627-kube-api-access-w45cc\") pod \"payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js\" (UID: \"c7da1736-9d9c-4c82-a28e-319220f04627\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"
Oct 30 22:46:43.841182 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:43.841156    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"
Oct 30 22:46:44.222207 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:44.222186    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"]
Oct 30 22:46:44.224848 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:46:44.224809    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7da1736_9d9c_4c82_a28e_319220f04627.slice/crio-ac06265025b785950be62353998243aa7d7688257242ca043c4cd599bd52bea6 WatchSource:0}: Error finding container ac06265025b785950be62353998243aa7d7688257242ca043c4cd599bd52bea6: Status 404 returned error can't find the container with id ac06265025b785950be62353998243aa7d7688257242ca043c4cd599bd52bea6
Oct 30 22:46:44.587884 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:44.587810    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js" event={"ID":"c7da1736-9d9c-4c82-a28e-319220f04627","Type":"ContainerStarted","Data":"3a697f5beb6c68bba1ca39874088e366b6482389772d225737b95e96f8b77c2d"}
Oct 30 22:46:44.587884 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:44.587864    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js" event={"ID":"c7da1736-9d9c-4c82-a28e-319220f04627","Type":"ContainerStarted","Data":"ac06265025b785950be62353998243aa7d7688257242ca043c4cd599bd52bea6"}
Oct 30 22:46:44.588066 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:44.587928    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"
Oct 30 22:46:44.706260 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:44.706210    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js" podStartSLOduration=1.706195846 podStartE2EDuration="1.706195846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:46:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:46:44.704731433 +0000 UTC m=+3742.753339128" watchObservedRunningTime="2026-10-30 22:46:44.706195846 +0000 UTC m=+3742.754803579"
Oct 30 22:46:45.871671 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:45.871640    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"]
Oct 30 22:46:45.875077 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:45.875052    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:45.927046 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:45.927022    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-d0a613-serving-cert\""
Oct 30 22:46:45.978521 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:45.978496    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"]
Oct 30 22:46:46.022624 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.022592    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64zdq\" (UniqueName: \"kubernetes.io/projected/663ba044-1aed-4fad-8496-0f1267f06c32-kube-api-access-64zdq\") pod \"maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:46.022822 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.022640    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/663ba044-1aed-4fad-8496-0f1267f06c32-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:46.022892 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.022817    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:46.022892 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.022861    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-metrics-certs\") pod \"maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:46.135750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.134659    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:46.135750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.134763    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-metrics-certs\") pod \"maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:46.135750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.134853    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64zdq\" (UniqueName: \"kubernetes.io/projected/663ba044-1aed-4fad-8496-0f1267f06c32-kube-api-access-64zdq\") pod \"maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:46.135750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.134891    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/663ba044-1aed-4fad-8496-0f1267f06c32-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:46.136066 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.135772    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/663ba044-1aed-4fad-8496-0f1267f06c32-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:46.136066 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:46:46.135892    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-serving-cert: secret "maas-api-e2e-worker-single-main-d0a613-serving-cert" not found
Oct 30 22:46:46.136066 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:46:46.135961    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-maas-api-tls podName:663ba044-1aed-4fad-8496-0f1267f06c32 nodeName:}" failed. No retries permitted until 2026-10-30 22:46:46.635937402 +0000 UTC m=+3744.684545077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-maas-api-tls") pod "maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn" (UID: "663ba044-1aed-4fad-8496-0f1267f06c32") : secret "maas-api-e2e-worker-single-main-d0a613-serving-cert" not found
Oct 30 22:46:46.140459 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.140243    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-metrics-certs\") pod \"maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:46.160236 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.160197    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:46:46.199199 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.199173    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64zdq\" (UniqueName: \"kubernetes.io/projected/663ba044-1aed-4fad-8496-0f1267f06c32-kube-api-access-64zdq\") pod \"maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:46.471137 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.471073    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:46:46.640621 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.640592    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:46.643191 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.643165    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:46.711816 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.711790    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:46:46.788379 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:46.788318    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:47.165319 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:47.165287    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"]
Oct 30 22:46:47.167713 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:46:47.167668    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663ba044_1aed_4fad_8496_0f1267f06c32.slice/crio-f9d9098778372961d4132c3d4e5278bd59cd553efae96e5de6a9aad8b9ebd25c WatchSource:0}: Error finding container f9d9098778372961d4132c3d4e5278bd59cd553efae96e5de6a9aad8b9ebd25c: Status 404 returned error can't find the container with id f9d9098778372961d4132c3d4e5278bd59cd553efae96e5de6a9aad8b9ebd25c
Oct 30 22:46:47.169565 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:47.169544    4918 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:46:47.603472 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:47.603369    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn" event={"ID":"663ba044-1aed-4fad-8496-0f1267f06c32","Type":"ContainerStarted","Data":"f9d9098778372961d4132c3d4e5278bd59cd553efae96e5de6a9aad8b9ebd25c"}
Oct 30 22:46:48.610870 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:48.610829    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn" event={"ID":"663ba044-1aed-4fad-8496-0f1267f06c32","Type":"ContainerStarted","Data":"0475ca834365c7792ad586581f0a30d067dafd2468e80e9283cb05ef554cf02c"}
Oct 30 22:46:48.611389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:48.610974    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:48.729399 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:48.729346    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn" podStartSLOduration=2.911591338 podStartE2EDuration="3.729331346s" totalImagesPullingTime="817.740008ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:46:48.727328367 +0000 UTC m=+3746.775936063" watchObservedRunningTime="2026-10-30 22:46:48.729331346 +0000 UTC m=+3746.777939040"
Oct 30 22:46:51.218413 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:51.218381    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:46:54.626288 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:54.626254    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:46:55.618213 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:55.618179    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"
Oct 30 22:46:56.227736 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:46:56.224446    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:01.125845 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:01.125800    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:02.157634 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:47:02.157592    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:47:03.685883 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:03.685849    4918 generic.go:356] "Generic (PLEG): container finished" podID="c31f7d0e-104b-44ca-b3dd-1a0c5a079691" containerID="d3ab48dc754e848c3a13b2445e6c659129534aa837b54806c487a57566bdc91c" exitCode=0
Oct 30 22:47:03.686329 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:03.685922    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw" event={"ID":"c31f7d0e-104b-44ca-b3dd-1a0c5a079691","Type":"ContainerDied","Data":"d3ab48dc754e848c3a13b2445e6c659129534aa837b54806c487a57566bdc91c"}
Oct 30 22:47:03.686377 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:03.686340    4918 scope.go:122] "RemoveContainer" containerID="d3ab48dc754e848c3a13b2445e6c659129534aa837b54806c487a57566bdc91c"
Oct 30 22:47:03.687536 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:03.687509    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:47:03.687595 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:03.687583    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:47:03.687632 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:03.687616    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:47:04.719162 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:04.719115    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw" event={"ID":"c31f7d0e-104b-44ca-b3dd-1a0c5a079691","Type":"ContainerStarted","Data":"2ba62f99dc81dd2a4f29bde9d0e45590e00351ec6dd348ed131de2f9222ac7aa"}
Oct 30 22:47:05.714709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:05.713877    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:47:05.715710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:05.715307    4918 patch_prober.go:29] interesting pod/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 22:47:05.715710 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:05.715380    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw" podUID="c31f7d0e-104b-44ca-b3dd-1a0c5a079691" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 22:47:06.418547 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:06.418505    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:06.714201 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:06.714110    4918 patch_prober.go:29] interesting pod/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 22:47:06.714481 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:06.714448    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw" podUID="c31f7d0e-104b-44ca-b3dd-1a0c5a079691" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 22:47:07.711708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:07.711158    4918 patch_prober.go:29] interesting pod/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 22:47:07.711708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:07.711223    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw" podUID="c31f7d0e-104b-44ca-b3dd-1a0c5a079691" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 22:47:08.560181 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:08.560148    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:47:08.713709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:08.713120    4918 patch_prober.go:29] interesting pod/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 22:47:08.713709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:08.713201    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw" podUID="c31f7d0e-104b-44ca-b3dd-1a0c5a079691" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 22:47:09.419209 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:09.419177    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:09.709025 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:09.708934    4918 patch_prober.go:29] interesting pod/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused" start-of-body=
Oct 30 22:47:09.709025 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:09.709009    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw" podUID="c31f7d0e-104b-44ca-b3dd-1a0c5a079691" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.141:15021/healthz/ready\": dial tcp 10.132.0.141:15021: connect: connection refused"
Oct 30 22:47:10.713095 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:10.713066    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:47:10.714035 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:10.714012    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:47:11.322613 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:11.322574    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:16.215406 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:16.215367    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:20.207327 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:20.207292    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:20.460918 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:20.460811    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:21.133936 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:21.133884    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:23.997779 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:23.997737    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:26.018995 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:26.018956    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:30.842623 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:30.842584    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:32.156440 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:47:32.156403    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:47:34.771730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:34.771700    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:35.893232 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:35.893203    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:40.613325 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:40.613291    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:45.529575 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:45.529533    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:50.407381 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:50.407345    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:47:55.419688 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:47:55.419653    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:00.298729 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:00.298624    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:02.156739 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:48:02.156669    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:48:05.211126 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:05.211089    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:08.470592 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:08.470549    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:11.135924 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:11.135890    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:15.021908 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:15.021875    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:19.699222 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:19.699191    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:19.934381 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:19.934349    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:24.664750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:24.664677    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:25.121106 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:25.121009    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:30.013116 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:30.013075    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:30.395177 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:30.395144    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"]
Oct 30 22:48:30.854794 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:30.854717    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:31.142862 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:31.142834    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:32.158439 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:48:32.158402    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:48:34.105520 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:34.105485    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"]
Oct 30 22:48:34.105963 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:34.105706    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn" podUID="663ba044-1aed-4fad-8496-0f1267f06c32" containerName="maas-api" containerID="cri-o://0475ca834365c7792ad586581f0a30d067dafd2468e80e9283cb05ef554cf02c" gracePeriod=30
Oct 30 22:48:34.357398 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:34.357311    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:34.616903 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:34.616804    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn" podUID="663ba044-1aed-4fad-8496-0f1267f06c32" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.143:8443/health\": dial tcp 10.132.0.143:8443: connect: connection refused"
Oct 30 22:48:35.134045 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.134006    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:35.355566 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.355542    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:48:35.395815 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.395784    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js" podUID="c7da1736-9d9c-4c82-a28e-319220f04627" containerName="payload-processing" containerID="cri-o://3a697f5beb6c68bba1ca39874088e366b6482389772d225737b95e96f8b77c2d" gracePeriod=25
Oct 30 22:48:35.475953 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.475925    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/663ba044-1aed-4fad-8496-0f1267f06c32-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/663ba044-1aed-4fad-8496-0f1267f06c32-openshift-service-ca\") pod \"663ba044-1aed-4fad-8496-0f1267f06c32\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") "
Oct 30 22:48:35.476106 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.476036    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-metrics-certs\" (UniqueName: \"kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-metrics-certs\") pod \"663ba044-1aed-4fad-8496-0f1267f06c32\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") "
Oct 30 22:48:35.476182 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.476112    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/663ba044-1aed-4fad-8496-0f1267f06c32-kube-api-access-64zdq\" (UniqueName: \"kubernetes.io/projected/663ba044-1aed-4fad-8496-0f1267f06c32-kube-api-access-64zdq\") pod \"663ba044-1aed-4fad-8496-0f1267f06c32\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") "
Oct 30 22:48:35.476249 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.476186    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-maas-api-tls\") pod \"663ba044-1aed-4fad-8496-0f1267f06c32\" (UID: \"663ba044-1aed-4fad-8496-0f1267f06c32\") "
Oct 30 22:48:35.476359 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.476338    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/663ba044-1aed-4fad-8496-0f1267f06c32-openshift-service-ca" pod "663ba044-1aed-4fad-8496-0f1267f06c32" (UID: "663ba044-1aed-4fad-8496-0f1267f06c32"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:48:35.476537 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.476514    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/663ba044-1aed-4fad-8496-0f1267f06c32-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:48:35.478492 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.478460    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-metrics-certs" pod "663ba044-1aed-4fad-8496-0f1267f06c32" (UID: "663ba044-1aed-4fad-8496-0f1267f06c32"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:48:35.478589 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.478565    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-maas-api-tls" pod "663ba044-1aed-4fad-8496-0f1267f06c32" (UID: "663ba044-1aed-4fad-8496-0f1267f06c32"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:48:35.478906 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.478793    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/663ba044-1aed-4fad-8496-0f1267f06c32-kube-api-access-64zdq" pod "663ba044-1aed-4fad-8496-0f1267f06c32" (UID: "663ba044-1aed-4fad-8496-0f1267f06c32"). InnerVolumeSpecName "kube-api-access-64zdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:48:35.577541 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.577514    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:48:35.577541 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.577541    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64zdq\" (UniqueName: \"kubernetes.io/projected/663ba044-1aed-4fad-8496-0f1267f06c32-kube-api-access-64zdq\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:48:35.577716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.577552    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/663ba044-1aed-4fad-8496-0f1267f06c32-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:48:35.594418 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.594386    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js" podUID="c7da1736-9d9c-4c82-a28e-319220f04627" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:48:35.881163 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:35.881073    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:36.159372 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:36.159341    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:36.166531 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:36.166506    4918 generic.go:356] "Generic (PLEG): container finished" podID="663ba044-1aed-4fad-8496-0f1267f06c32" containerID="0475ca834365c7792ad586581f0a30d067dafd2468e80e9283cb05ef554cf02c" exitCode=0
Oct 30 22:48:36.166676 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:36.166556    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"
Oct 30 22:48:36.166676 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:36.166588    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn" event={"ID":"663ba044-1aed-4fad-8496-0f1267f06c32","Type":"ContainerDied","Data":"0475ca834365c7792ad586581f0a30d067dafd2468e80e9283cb05ef554cf02c"}
Oct 30 22:48:36.166676 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:36.166649    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn" event={"ID":"663ba044-1aed-4fad-8496-0f1267f06c32","Type":"ContainerDied","Data":"f9d9098778372961d4132c3d4e5278bd59cd553efae96e5de6a9aad8b9ebd25c"}
Oct 30 22:48:36.166821 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:36.166691    4918 scope.go:122] "RemoveContainer" containerID="0475ca834365c7792ad586581f0a30d067dafd2468e80e9283cb05ef554cf02c"
Oct 30 22:48:36.175570 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:36.175549    4918 scope.go:122] "RemoveContainer" containerID="0475ca834365c7792ad586581f0a30d067dafd2468e80e9283cb05ef554cf02c"
Oct 30 22:48:36.175869 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:48:36.175837    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0475ca834365c7792ad586581f0a30d067dafd2468e80e9283cb05ef554cf02c\": container with ID starting with 0475ca834365c7792ad586581f0a30d067dafd2468e80e9283cb05ef554cf02c not found: ID does not exist" containerID="0475ca834365c7792ad586581f0a30d067dafd2468e80e9283cb05ef554cf02c"
Oct 30 22:48:36.175971 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:36.175874    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0475ca834365c7792ad586581f0a30d067dafd2468e80e9283cb05ef554cf02c"} err="failed to get container status \"0475ca834365c7792ad586581f0a30d067dafd2468e80e9283cb05ef554cf02c\": rpc error: code = NotFound desc = could not find container \"0475ca834365c7792ad586581f0a30d067dafd2468e80e9283cb05ef554cf02c\": container with ID starting with 0475ca834365c7792ad586581f0a30d067dafd2468e80e9283cb05ef554cf02c not found: ID does not exist"
Oct 30 22:48:36.330921 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:36.330895    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"]
Oct 30 22:48:36.379989 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:36.379963    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-d0a613-69d894f4c7-x2bzn"]
Oct 30 22:48:36.921030 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:36.920997    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:38.071096 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:38.071057    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="663ba044-1aed-4fad-8496-0f1267f06c32" path="/var/lib/kubelet/pods/663ba044-1aed-4fad-8496-0f1267f06c32/volumes"
Oct 30 22:48:42.925099 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:42.925061    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:43.172978 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:43.172947    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"]
Oct 30 22:48:43.173182 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:43.173147    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw" podUID="c31f7d0e-104b-44ca-b3dd-1a0c5a079691" containerName="istio-proxy" containerID="cri-o://2ba62f99dc81dd2a4f29bde9d0e45590e00351ec6dd348ed131de2f9222ac7aa" gracePeriod=30
Oct 30 22:48:43.207966 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:43.207894    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:43.449241 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:43.449200    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:45.594399 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:45.594352    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js" podUID="c7da1736-9d9c-4c82-a28e-319220f04627" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:48:48.431630 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.431608    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:48:48.603751 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.603647    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-envoy\") pod \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") "
Oct 30 22:48:48.603751 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.603706    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-podinfo\") pod \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") "
Oct 30 22:48:48.603971 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.603761    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-token\" (UniqueName: \"kubernetes.io/projected/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-token\") pod \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") "
Oct 30 22:48:48.603971 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.603817    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-credential-socket\") pod \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") "
Oct 30 22:48:48.603971 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.603879    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-workload-socket\") pod \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") "
Oct 30 22:48:48.603971 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.603926    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istiod-ca-cert\") pod \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") "
Oct 30 22:48:48.603971 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.603962    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-data\") pod \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") "
Oct 30 22:48:48.604170 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.604017    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-workload-certs\") pod \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") "
Oct 30 22:48:48.604170 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.604071    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-kube-api-access-4ggbn\" (UniqueName: \"kubernetes.io/projected/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-kube-api-access-4ggbn\") pod \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\" (UID: \"c31f7d0e-104b-44ca-b3dd-1a0c5a079691\") "
Oct 30 22:48:48.604866 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.604552    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-workload-socket" pod "c31f7d0e-104b-44ca-b3dd-1a0c5a079691" (UID: "c31f7d0e-104b-44ca-b3dd-1a0c5a079691"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:48:48.604866 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.604728    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-data" pod "c31f7d0e-104b-44ca-b3dd-1a0c5a079691" (UID: "c31f7d0e-104b-44ca-b3dd-1a0c5a079691"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:48:48.605086 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.605050    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istiod-ca-cert" pod "c31f7d0e-104b-44ca-b3dd-1a0c5a079691" (UID: "c31f7d0e-104b-44ca-b3dd-1a0c5a079691"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:48:48.605452 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.605313    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-workload-certs" pod "c31f7d0e-104b-44ca-b3dd-1a0c5a079691" (UID: "c31f7d0e-104b-44ca-b3dd-1a0c5a079691"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:48:48.605769 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.605660    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-credential-socket" pod "c31f7d0e-104b-44ca-b3dd-1a0c5a079691" (UID: "c31f7d0e-104b-44ca-b3dd-1a0c5a079691"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:48:48.608734 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.608711    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-token" pod "c31f7d0e-104b-44ca-b3dd-1a0c5a079691" (UID: "c31f7d0e-104b-44ca-b3dd-1a0c5a079691"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:48:48.609991 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.609964    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-envoy" pod "c31f7d0e-104b-44ca-b3dd-1a0c5a079691" (UID: "c31f7d0e-104b-44ca-b3dd-1a0c5a079691"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:48:48.610077 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.609968    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-kube-api-access-4ggbn" pod "c31f7d0e-104b-44ca-b3dd-1a0c5a079691" (UID: "c31f7d0e-104b-44ca-b3dd-1a0c5a079691"). InnerVolumeSpecName "kube-api-access-4ggbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:48:48.611302 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.611277    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-podinfo" pod "c31f7d0e-104b-44ca-b3dd-1a0c5a079691" (UID: "c31f7d0e-104b-44ca-b3dd-1a0c5a079691"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:48:48.705285 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.705263    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ggbn\" (UniqueName: \"kubernetes.io/projected/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-kube-api-access-4ggbn\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:48:48.705285 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.705287    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:48:48.705435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.705296    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:48:48.705435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.705307    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:48:48.705435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.705315    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:48:48.705435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.705324    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:48:48.705435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.705336    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:48:48.705435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.705345    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:48:48.705435 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:48.705353    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c31f7d0e-104b-44ca-b3dd-1a0c5a079691-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:48:49.241365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:49.241322    4918 generic.go:356] "Generic (PLEG): container finished" podID="c31f7d0e-104b-44ca-b3dd-1a0c5a079691" containerID="2ba62f99dc81dd2a4f29bde9d0e45590e00351ec6dd348ed131de2f9222ac7aa" exitCode=0
Oct 30 22:48:49.241537 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:49.241432    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw" event={"ID":"c31f7d0e-104b-44ca-b3dd-1a0c5a079691","Type":"ContainerDied","Data":"2ba62f99dc81dd2a4f29bde9d0e45590e00351ec6dd348ed131de2f9222ac7aa"}
Oct 30 22:48:49.241537 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:49.241462    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"
Oct 30 22:48:49.241537 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:49.241507    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw" event={"ID":"c31f7d0e-104b-44ca-b3dd-1a0c5a079691","Type":"ContainerDied","Data":"189ce5a4b5c5b3cd5e946b07bc60bd6ca8a87fa19f708d46f32639ea64e123ea"}
Oct 30 22:48:49.241537 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:49.241528    4918 scope.go:122] "RemoveContainer" containerID="2ba62f99dc81dd2a4f29bde9d0e45590e00351ec6dd348ed131de2f9222ac7aa"
Oct 30 22:48:49.251190 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:49.251174    4918 scope.go:122] "RemoveContainer" containerID="d3ab48dc754e848c3a13b2445e6c659129534aa837b54806c487a57566bdc91c"
Oct 30 22:48:49.259669 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:49.259655    4918 scope.go:122] "RemoveContainer" containerID="2ba62f99dc81dd2a4f29bde9d0e45590e00351ec6dd348ed131de2f9222ac7aa"
Oct 30 22:48:49.259969 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:48:49.259951    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ba62f99dc81dd2a4f29bde9d0e45590e00351ec6dd348ed131de2f9222ac7aa\": container with ID starting with 2ba62f99dc81dd2a4f29bde9d0e45590e00351ec6dd348ed131de2f9222ac7aa not found: ID does not exist" containerID="2ba62f99dc81dd2a4f29bde9d0e45590e00351ec6dd348ed131de2f9222ac7aa"
Oct 30 22:48:49.260015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:49.259976    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ba62f99dc81dd2a4f29bde9d0e45590e00351ec6dd348ed131de2f9222ac7aa"} err="failed to get container status \"2ba62f99dc81dd2a4f29bde9d0e45590e00351ec6dd348ed131de2f9222ac7aa\": rpc error: code = NotFound desc = could not find container \"2ba62f99dc81dd2a4f29bde9d0e45590e00351ec6dd348ed131de2f9222ac7aa\": container with ID starting with 2ba62f99dc81dd2a4f29bde9d0e45590e00351ec6dd348ed131de2f9222ac7aa not found: ID does not exist"
Oct 30 22:48:49.260015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:49.259992    4918 scope.go:122] "RemoveContainer" containerID="d3ab48dc754e848c3a13b2445e6c659129534aa837b54806c487a57566bdc91c"
Oct 30 22:48:49.260188 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:48:49.260175    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3ab48dc754e848c3a13b2445e6c659129534aa837b54806c487a57566bdc91c\": container with ID starting with d3ab48dc754e848c3a13b2445e6c659129534aa837b54806c487a57566bdc91c not found: ID does not exist" containerID="d3ab48dc754e848c3a13b2445e6c659129534aa837b54806c487a57566bdc91c"
Oct 30 22:48:49.260228 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:49.260191    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3ab48dc754e848c3a13b2445e6c659129534aa837b54806c487a57566bdc91c"} err="failed to get container status \"d3ab48dc754e848c3a13b2445e6c659129534aa837b54806c487a57566bdc91c\": rpc error: code = NotFound desc = could not find container \"d3ab48dc754e848c3a13b2445e6c659129534aa837b54806c487a57566bdc91c\": container with ID starting with d3ab48dc754e848c3a13b2445e6c659129534aa837b54806c487a57566bdc91c not found: ID does not exist"
Oct 30 22:48:49.455104 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:49.455074    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"]
Oct 30 22:48:49.504419 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:49.504347    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-single-main-d0a613-openshift-default-7c8cbcd5456b2gw"]
Oct 30 22:48:49.743600 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:49.743568    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:48:50.071842 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:50.071813    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c31f7d0e-104b-44ca-b3dd-1a0c5a079691" path="/var/lib/kubelet/pods/c31f7d0e-104b-44ca-b3dd-1a0c5a079691/volumes"
Oct 30 22:48:55.650411 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:55.650386    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"
Oct 30 22:48:55.661152 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:55.661098    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7da1736-9d9c-4c82-a28e-319220f04627-kube-api-access-w45cc\" (UniqueName: \"kubernetes.io/projected/c7da1736-9d9c-4c82-a28e-319220f04627-kube-api-access-w45cc\") pod \"c7da1736-9d9c-4c82-a28e-319220f04627\" (UID: \"c7da1736-9d9c-4c82-a28e-319220f04627\") "
Oct 30 22:48:55.661257 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:55.661197    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c7da1736-9d9c-4c82-a28e-319220f04627-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7da1736-9d9c-4c82-a28e-319220f04627-plugins-config-volume\") pod \"c7da1736-9d9c-4c82-a28e-319220f04627\" (UID: \"c7da1736-9d9c-4c82-a28e-319220f04627\") "
Oct 30 22:48:55.661628 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:55.661602    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7da1736-9d9c-4c82-a28e-319220f04627-plugins-config-volume" pod "c7da1736-9d9c-4c82-a28e-319220f04627" (UID: "c7da1736-9d9c-4c82-a28e-319220f04627"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:48:55.663202 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:55.663182    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7da1736-9d9c-4c82-a28e-319220f04627-kube-api-access-w45cc" pod "c7da1736-9d9c-4c82-a28e-319220f04627" (UID: "c7da1736-9d9c-4c82-a28e-319220f04627"). InnerVolumeSpecName "kube-api-access-w45cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:48:55.762321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:55.762297    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w45cc\" (UniqueName: \"kubernetes.io/projected/c7da1736-9d9c-4c82-a28e-319220f04627-kube-api-access-w45cc\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:48:55.762321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:55.762322    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c7da1736-9d9c-4c82-a28e-319220f04627-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:48:56.276837 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:56.276803    4918 generic.go:356] "Generic (PLEG): container finished" podID="c7da1736-9d9c-4c82-a28e-319220f04627" containerID="3a697f5beb6c68bba1ca39874088e366b6482389772d225737b95e96f8b77c2d" exitCode=0
Oct 30 22:48:56.277000 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:56.276860    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"
Oct 30 22:48:56.277000 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:56.276871    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js" event={"ID":"c7da1736-9d9c-4c82-a28e-319220f04627","Type":"ContainerDied","Data":"3a697f5beb6c68bba1ca39874088e366b6482389772d225737b95e96f8b77c2d"}
Oct 30 22:48:56.277000 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:56.276911    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js" event={"ID":"c7da1736-9d9c-4c82-a28e-319220f04627","Type":"ContainerDied","Data":"ac06265025b785950be62353998243aa7d7688257242ca043c4cd599bd52bea6"}
Oct 30 22:48:56.277000 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:56.276932    4918 scope.go:122] "RemoveContainer" containerID="3a697f5beb6c68bba1ca39874088e366b6482389772d225737b95e96f8b77c2d"
Oct 30 22:48:56.285738 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:56.285717    4918 scope.go:122] "RemoveContainer" containerID="3a697f5beb6c68bba1ca39874088e366b6482389772d225737b95e96f8b77c2d"
Oct 30 22:48:56.285993 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:48:56.285972    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a697f5beb6c68bba1ca39874088e366b6482389772d225737b95e96f8b77c2d\": container with ID starting with 3a697f5beb6c68bba1ca39874088e366b6482389772d225737b95e96f8b77c2d not found: ID does not exist" containerID="3a697f5beb6c68bba1ca39874088e366b6482389772d225737b95e96f8b77c2d"
Oct 30 22:48:56.286045 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:56.286003    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a697f5beb6c68bba1ca39874088e366b6482389772d225737b95e96f8b77c2d"} err="failed to get container status \"3a697f5beb6c68bba1ca39874088e366b6482389772d225737b95e96f8b77c2d\": rpc error: code = NotFound desc = could not find container \"3a697f5beb6c68bba1ca39874088e366b6482389772d225737b95e96f8b77c2d\": container with ID starting with 3a697f5beb6c68bba1ca39874088e366b6482389772d225737b95e96f8b77c2d not found: ID does not exist"
Oct 30 22:48:56.439816 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:56.439789    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"]
Oct 30 22:48:56.488574 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:56.488552    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js"]
Oct 30 22:48:56.593836 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:56.593807    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-d0a613-69fd485f8pm2js" podUID="c7da1736-9d9c-4c82-a28e-319220f04627" containerName="payload-processing" probeResult="failure" output="timeout: failed to connect service \"10.132.0.142:50052\" within 1s: context deadline exceeded"
Oct 30 22:48:56.593953 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:48:56.593929    4918 logging.go:55] [core] [Channel #3608 SubChannel #3609]grpc: addrConn.createTransport failed to connect to {Addr: "10.132.0.142:50052", ServerName: "10.132.0.142:50052", BalancerAttributes: {"<%!p(pickfirstleaf.managedByPickfirstKeyType={})>": "<%!p(bool=true)>" }}. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.132.0.142:50052: operation was canceled"
Oct 30 22:48:58.071896 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:48:58.071861    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c7da1736-9d9c-4c82-a28e-319220f04627" path="/var/lib/kubelet/pods/c7da1736-9d9c-4c82-a28e-319220f04627/volumes"
Oct 30 22:49:00.914204 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:49:00.914160    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:49:02.157241 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:49:02.157205    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:49:02.551300 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:49:02.551198    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:49:08.604468 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:49:08.604431    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:49:22.519937 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:49:22.519910    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:49:22.550516 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:49:22.550493    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:49:32.161061 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:49:32.160977    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:49:35.356442 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:49:35.356406    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:49:36.611768 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:49:36.611730    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:50:02.158347 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:50:02.158309    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:50:32.157265 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:50:32.157229    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:50:35.896634 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:50:35.896596    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:02.157837 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:51:02.157740    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:51:10.555431 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:10.554922    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-5sbz9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.138:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:51:10.555431 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:10.554988    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9" podUID="821a7805-3799-4db3-81fb-4b2f9e63bd8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.138:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:51:11.085834 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:11.085793    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-ksktz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:51:11.086038 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:11.085867    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz" podUID="50077ca0-3a9d-468c-ac63-cee24e5cabf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:51:11.230932 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:11.230829    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-8vv2c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.140:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:51:11.230932 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:11.230911    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-8vv2c" podUID="132065c1-06b5-45d6-883c-464cec396f68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.140:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:51:32.156940 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:51:32.156902    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:51:32.454029 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:32.453947    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:32.956728 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:32.956696    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"]
Oct 30 22:51:32.957087 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:32.957075    4918 cpu_manager.go:414] "containerMap: removing container" podUID="c31f7d0e-104b-44ca-b3dd-1a0c5a079691" containerName="istio-proxy"
Oct 30 22:51:32.957138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:32.957088    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c31f7d0e-104b-44ca-b3dd-1a0c5a079691" containerName="istio-proxy"
Oct 30 22:51:32.957138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:32.957096    4918 cpu_manager.go:414] "containerMap: removing container" podUID="663ba044-1aed-4fad-8496-0f1267f06c32" containerName="maas-api"
Oct 30 22:51:32.957138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:32.957102    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="663ba044-1aed-4fad-8496-0f1267f06c32" containerName="maas-api"
Oct 30 22:51:32.957138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:32.957117    4918 cpu_manager.go:414] "containerMap: removing container" podUID="c31f7d0e-104b-44ca-b3dd-1a0c5a079691" containerName="istio-proxy"
Oct 30 22:51:32.957138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:32.957123    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c31f7d0e-104b-44ca-b3dd-1a0c5a079691" containerName="istio-proxy"
Oct 30 22:51:32.957138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:32.957133    4918 cpu_manager.go:414] "containerMap: removing container" podUID="c7da1736-9d9c-4c82-a28e-319220f04627" containerName="payload-processing"
Oct 30 22:51:32.957138 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:32.957138    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c7da1736-9d9c-4c82-a28e-319220f04627" containerName="payload-processing"
Oct 30 22:51:32.957354 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:32.957201    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="c31f7d0e-104b-44ca-b3dd-1a0c5a079691" containerName="istio-proxy"
Oct 30 22:51:32.957354 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:32.957209    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="663ba044-1aed-4fad-8496-0f1267f06c32" containerName="maas-api"
Oct 30 22:51:32.957354 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:32.957218    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="c31f7d0e-104b-44ca-b3dd-1a0c5a079691" containerName="istio-proxy"
Oct 30 22:51:32.957354 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:32.957224    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="c7da1736-9d9c-4c82-a28e-319220f04627" containerName="payload-processing"
Oct 30 22:51:32.960248 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:32.960232    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.013962 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.013921    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-single-main-bf99ca-openshift-default-dockercfg-mnn97\""
Oct 30 22:51:33.053174 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.053125    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istiod-ca-cert\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.053355 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.053241    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-credential-socket\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.053355 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.053275    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-envoy\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.053468 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.053397    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-data\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.053468 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.053425    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-podinfo\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.053468 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.053444    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-workload-certs\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.053604 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.053472    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-workload-socket\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.053604 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.053550    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4h6t\" (UniqueName: \"kubernetes.io/projected/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-kube-api-access-j4h6t\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.053604 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.053595    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-token\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.077731 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.077675    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"]
Oct 30 22:51:33.155144 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.155105    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-data\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.155329 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.155166    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-podinfo\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.155329 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.155192    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-workload-certs\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.155329 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.155234    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-workload-socket\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.155329 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.155251    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4h6t\" (UniqueName: \"kubernetes.io/projected/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-kube-api-access-j4h6t\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.155562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.155384    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-token\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.155562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.155399    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-data\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.155562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.155432    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istiod-ca-cert\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.155562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.155514    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-credential-socket\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.155562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.155540    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-workload-certs\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.155562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.155553    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-envoy\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.155914 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.155875    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-workload-socket\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.156145 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.156124    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istiod-ca-cert\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.156224 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.156164    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-credential-socket\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.157989 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.157922    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:33.157989 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.157984    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-envoy\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.158458 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.158058    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-podinfo\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.217590 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.217513    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-token\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.217590 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.217541    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4h6t\" (UniqueName: \"kubernetes.io/projected/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-kube-api-access-j4h6t\") pod \"e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") " pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.283485 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.283438    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:33.467386 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.467358    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:33.726761 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.726736    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"]
Oct 30 22:51:33.729555 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:51:33.729523    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c79fb0_acdd_423d_8269_0e5ba8d95ad0.slice/crio-57917d39425e8ea3e91750dcdde037f0502d1fd2cb41498a1b582e4357f38d31 WatchSource:0}: Error finding container 57917d39425e8ea3e91750dcdde037f0502d1fd2cb41498a1b582e4357f38d31: Status 404 returned error can't find the container with id 57917d39425e8ea3e91750dcdde037f0502d1fd2cb41498a1b582e4357f38d31
Oct 30 22:51:33.731763 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.731730    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:51:33.731880 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.731811    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:51:33.731880 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:33.731856    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:51:34.096211 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:34.096120    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk" event={"ID":"20c79fb0-acdd-423d-8269-0e5ba8d95ad0","Type":"ContainerStarted","Data":"357bdd85ff70884375455dc26b3a45b53dccbec3db9447063c851260d5ced782"}
Oct 30 22:51:34.096211 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:34.096207    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk" event={"ID":"20c79fb0-acdd-423d-8269-0e5ba8d95ad0","Type":"ContainerStarted","Data":"57917d39425e8ea3e91750dcdde037f0502d1fd2cb41498a1b582e4357f38d31"}
Oct 30 22:51:34.218217 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:34.218166    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk" podStartSLOduration=2.218152846 podStartE2EDuration="2.218152846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:51:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:51:34.216330231 +0000 UTC m=+4032.264937929" watchObservedRunningTime="2026-10-30 22:51:34.218152846 +0000 UTC m=+4032.266760541"
Oct 30 22:51:34.284069 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:34.284042    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:34.288756 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:34.288734    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:35.100829 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:35.100798    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:35.101948 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:35.101919    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:51:36.189878 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:36.189848    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:37.305120 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:37.305085    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:37.581764 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:37.581655    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:40.524851 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:40.524811    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:40.777286 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:40.777197    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:40.993154 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:40.993102    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"]
Oct 30 22:51:40.998286 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:40.998223    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"
Oct 30 22:51:41.051974 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:41.051893    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-single-m-1804da4b-dockercfg-njx2v\""
Oct 30 22:51:41.053948 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:41.053915    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"]
Oct 30 22:51:41.101169 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:41.101146    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-single-main-bf99ca\""
Oct 30 22:51:41.125173 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:41.125143    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rgvz\" (UniqueName: \"kubernetes.io/projected/e0b218f4-c6f2-4ad3-845d-23737a2e544b-kube-api-access-4rgvz\") pod \"payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5\" (UID: \"e0b218f4-c6f2-4ad3-845d-23737a2e544b\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"
Oct 30 22:51:41.125321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:41.125302    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0b218f4-c6f2-4ad3-845d-23737a2e544b-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5\" (UID: \"e0b218f4-c6f2-4ad3-845d-23737a2e544b\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"
Oct 30 22:51:41.226449 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:41.226415    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rgvz\" (UniqueName: \"kubernetes.io/projected/e0b218f4-c6f2-4ad3-845d-23737a2e544b-kube-api-access-4rgvz\") pod \"payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5\" (UID: \"e0b218f4-c6f2-4ad3-845d-23737a2e544b\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"
Oct 30 22:51:41.226615 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:41.226535    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0b218f4-c6f2-4ad3-845d-23737a2e544b-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5\" (UID: \"e0b218f4-c6f2-4ad3-845d-23737a2e544b\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"
Oct 30 22:51:41.227218 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:41.227195    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0b218f4-c6f2-4ad3-845d-23737a2e544b-plugins-config-volume\") pod \"payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5\" (UID: \"e0b218f4-c6f2-4ad3-845d-23737a2e544b\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"
Oct 30 22:51:41.287455 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:41.287428    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rgvz\" (UniqueName: \"kubernetes.io/projected/e0b218f4-c6f2-4ad3-845d-23737a2e544b-kube-api-access-4rgvz\") pod \"payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5\" (UID: \"e0b218f4-c6f2-4ad3-845d-23737a2e544b\") " pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"
Oct 30 22:51:41.319127 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:41.319070    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"
Oct 30 22:51:41.695389 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:41.695366    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"]
Oct 30 22:51:41.698376 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:51:41.698349    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0b218f4_c6f2_4ad3_845d_23737a2e544b.slice/crio-616190fd3c789b8189fd2078a34b039e2a6a12fef1cec4947e232964451bf812 WatchSource:0}: Error finding container 616190fd3c789b8189fd2078a34b039e2a6a12fef1cec4947e232964451bf812: Status 404 returned error can't find the container with id 616190fd3c789b8189fd2078a34b039e2a6a12fef1cec4947e232964451bf812
Oct 30 22:51:42.132981 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:42.132894    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5" event={"ID":"e0b218f4-c6f2-4ad3-845d-23737a2e544b","Type":"ContainerStarted","Data":"b7abb5a140978f626ab10d631dcaa3c35207786c7ea295b1c276d6bea1b9509e"}
Oct 30 22:51:42.132981 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:42.132946    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"
Oct 30 22:51:42.132981 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:42.132965    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5" event={"ID":"e0b218f4-c6f2-4ad3-845d-23737a2e544b","Type":"ContainerStarted","Data":"616190fd3c789b8189fd2078a34b039e2a6a12fef1cec4947e232964451bf812"}
Oct 30 22:51:42.249103 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:42.249054    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5" podStartSLOduration=2.2490396280000002 podStartE2EDuration="2.249039628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:51:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:51:42.247444374 +0000 UTC m=+4040.296052070" watchObservedRunningTime="2026-10-30 22:51:42.249039628 +0000 UTC m=+4040.297647360"
Oct 30 22:51:43.458179 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.458144    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"]
Oct 30 22:51:43.462402 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.462383    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:43.545560 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.545527    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpz4d\" (UniqueName: \"kubernetes.io/projected/80e17f0e-3d69-41fc-90a9-5dba5cde217e-kube-api-access-xpz4d\") pod \"maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:43.545560 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.545564    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:43.545795 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.545592    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-metrics-certs\") pod \"maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:43.545795 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.545742    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e17f0e-3d69-41fc-90a9-5dba5cde217e-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:43.559398 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.559354    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-bf99ca-serving-cert\""
Oct 30 22:51:43.567018 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.566986    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"]
Oct 30 22:51:43.646931 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.646896    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpz4d\" (UniqueName: \"kubernetes.io/projected/80e17f0e-3d69-41fc-90a9-5dba5cde217e-kube-api-access-xpz4d\") pod \"maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:43.647113 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.646935    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:43.647113 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.646964    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-metrics-certs\") pod \"maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:43.647113 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.646997    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e17f0e-3d69-41fc-90a9-5dba5cde217e-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:43.647113 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:51:43.647063    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-serving-cert: secret "maas-api-e2e-worker-single-main-bf99ca-serving-cert" not found
Oct 30 22:51:43.647449 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:51:43.647145    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-maas-api-tls podName:80e17f0e-3d69-41fc-90a9-5dba5cde217e nodeName:}" failed. No retries permitted until 2026-10-30 22:51:44.147126713 +0000 UTC m=+4042.195734403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-maas-api-tls") pod "maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv" (UID: "80e17f0e-3d69-41fc-90a9-5dba5cde217e") : secret "maas-api-e2e-worker-single-main-bf99ca-serving-cert" not found
Oct 30 22:51:43.647613 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.647594    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e17f0e-3d69-41fc-90a9-5dba5cde217e-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:43.649613 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.649588    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-metrics-certs\") pod \"maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:43.686935 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.686908    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:43.710859 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.710809    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpz4d\" (UniqueName: \"kubernetes.io/projected/80e17f0e-3d69-41fc-90a9-5dba5cde217e-kube-api-access-xpz4d\") pod \"maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:43.941201 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:43.941168    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:44.151175 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:44.151145    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:44.153732 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:44.153715    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:44.196170 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:44.196144    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:44.375026 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:44.374998    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:44.751209 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:44.751134    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"]
Oct 30 22:51:44.754235 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:51:44.754208    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e17f0e_3d69_41fc_90a9_5dba5cde217e.slice/crio-f24a3944f5d633b052ca658d0da67e5052dae584e4c9b311790e05760f6f8d00 WatchSource:0}: Error finding container f24a3944f5d633b052ca658d0da67e5052dae584e4c9b311790e05760f6f8d00: Status 404 returned error can't find the container with id f24a3944f5d633b052ca658d0da67e5052dae584e4c9b311790e05760f6f8d00
Oct 30 22:51:45.148427 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:45.148394    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv" event={"ID":"80e17f0e-3d69-41fc-90a9-5dba5cde217e","Type":"ContainerStarted","Data":"f24a3944f5d633b052ca658d0da67e5052dae584e4c9b311790e05760f6f8d00"}
Oct 30 22:51:46.154470 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:46.154431    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv" event={"ID":"80e17f0e-3d69-41fc-90a9-5dba5cde217e","Type":"ContainerStarted","Data":"2ee6b35031e1a5ae7d27c02825121c0c4dd0a3a5d9172c41485628238107808a"}
Oct 30 22:51:46.154909 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:46.154548    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:46.271889 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:46.271835    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv" podStartSLOduration=2.516036276 podStartE2EDuration="3.271820071s" totalImagesPullingTime="755.783795ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:51:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:51:46.271014135 +0000 UTC m=+4044.319621830" watchObservedRunningTime="2026-10-30 22:51:46.271820071 +0000 UTC m=+4044.320427757"
Oct 30 22:51:48.713287 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:48.713257    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:52.164906 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:52.164873    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:51:53.141078 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:53.141045    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"
Oct 30 22:51:53.618396 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:53.618292    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:51:58.428313 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:51:58.428271    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:01.249291 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:01.249258    4918 generic.go:356] "Generic (PLEG): container finished" podID="20c79fb0-acdd-423d-8269-0e5ba8d95ad0" containerID="357bdd85ff70884375455dc26b3a45b53dccbec3db9447063c851260d5ced782" exitCode=0
Oct 30 22:52:01.249747 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:01.249330    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk" event={"ID":"20c79fb0-acdd-423d-8269-0e5ba8d95ad0","Type":"ContainerDied","Data":"357bdd85ff70884375455dc26b3a45b53dccbec3db9447063c851260d5ced782"}
Oct 30 22:52:01.249805 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:01.249777    4918 scope.go:122] "RemoveContainer" containerID="357bdd85ff70884375455dc26b3a45b53dccbec3db9447063c851260d5ced782"
Oct 30 22:52:01.250984 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:01.250954    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:52:01.251079 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:01.251022    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:52:01.251079 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:01.251052    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:52:02.129794 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:02.129759    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:02.156984 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:52:02.156951    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:52:02.255670 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:02.255635    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk" event={"ID":"20c79fb0-acdd-423d-8269-0e5ba8d95ad0","Type":"ContainerStarted","Data":"f25a7777a681c85478c6d41ccbcbafdd8e4ff339384b03dcc90b3e29e0353e79"}
Oct 30 22:52:02.284395 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:02.284364    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:52:02.285540 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:02.285514    4918 patch_prober.go:29] interesting pod/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.144:15021/healthz/ready\": dial tcp 10.132.0.144:15021: connect: connection refused" start-of-body=
Oct 30 22:52:02.285667 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:02.285560    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk" podUID="20c79fb0-acdd-423d-8269-0e5ba8d95ad0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.144:15021/healthz/ready\": dial tcp 10.132.0.144:15021: connect: connection refused"
Oct 30 22:52:02.832054 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:02.832009    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:03.088159 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:03.088074    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:03.284002 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:03.283967    4918 patch_prober.go:29] interesting pod/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.144:15021/healthz/ready\": dial tcp 10.132.0.144:15021: connect: connection refused" start-of-body=
Oct 30 22:52:03.284410 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:03.284016    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk" podUID="20c79fb0-acdd-423d-8269-0e5ba8d95ad0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.144:15021/healthz/ready\": dial tcp 10.132.0.144:15021: connect: connection refused"
Oct 30 22:52:03.641112 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:03.641078    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:04.284390 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:04.284351    4918 patch_prober.go:29] interesting pod/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.144:15021/healthz/ready\": dial tcp 10.132.0.144:15021: connect: connection refused" start-of-body=
Oct 30 22:52:04.284829 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:04.284421    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk" podUID="20c79fb0-acdd-423d-8269-0e5ba8d95ad0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.144:15021/healthz/ready\": dial tcp 10.132.0.144:15021: connect: connection refused"
Oct 30 22:52:05.117708 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:05.113795    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:52:05.284494 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:05.284458    4918 patch_prober.go:29] interesting pod/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.144:15021/healthz/ready\": dial tcp 10.132.0.144:15021: connect: connection refused" start-of-body=
Oct 30 22:52:05.284928 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:05.284508    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk" podUID="20c79fb0-acdd-423d-8269-0e5ba8d95ad0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.144:15021/healthz/ready\": dial tcp 10.132.0.144:15021: connect: connection refused"
Oct 30 22:52:06.239559 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:06.239520    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:06.284415 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:06.284381    4918 patch_prober.go:29] interesting pod/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.144:15021/healthz/ready\": dial tcp 10.132.0.144:15021: connect: connection refused" start-of-body=
Oct 30 22:52:06.284591 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:06.284435    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk" podUID="20c79fb0-acdd-423d-8269-0e5ba8d95ad0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.144:15021/healthz/ready\": dial tcp 10.132.0.144:15021: connect: connection refused"
Oct 30 22:52:07.284895 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:07.284854    4918 patch_prober.go:29] interesting pod/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.144:15021/healthz/ready\": dial tcp 10.132.0.144:15021: connect: connection refused" start-of-body=
Oct 30 22:52:07.285308 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:07.284938    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk" podUID="20c79fb0-acdd-423d-8269-0e5ba8d95ad0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.144:15021/healthz/ready\": dial tcp 10.132.0.144:15021: connect: connection refused"
Oct 30 22:52:08.288439 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:08.288408    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:52:08.289583 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:08.289564    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:52:08.573437 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:08.573329    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:13.455455 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:13.455416    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:18.317767 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:18.317729    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:23.239070 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:23.239024    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:28.140495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:28.140456    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:32.157701 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:52:32.157603    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:52:33.015893 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:33.015858    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:36.564495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:36.564455    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:37.828240 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:37.828206    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:42.714201 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:42.714166    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:47.553740 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:47.553704    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:52.576351 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:52.576306    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:52:57.432365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:52:57.432327    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:02.158072 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:53:02.158035    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:53:02.248772 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:02.248725    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:02.566010 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:02.565917    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:07.273477 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:07.273433    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:07.588802 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:07.588712    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:12.080863 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:12.080826    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:12.332094 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:12.332002    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:12.587480 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:12.587394    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:13.027617 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:13.027585    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"]
Oct 30 22:53:13.489745 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:13.489709    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:13.722736 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:13.722698    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:17.207300 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:17.207262    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:18.028082 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:18.028021    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5" podUID="e0b218f4-c6f2-4ad3-845d-23737a2e544b" containerName="payload-processing" containerID="cri-o://b7abb5a140978f626ab10d631dcaa3c35207786c7ea295b1c276d6bea1b9509e" gracePeriod=25
Oct 30 22:53:21.289780 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:21.289736    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"]
Oct 30 22:53:21.290282 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:21.290045    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv" podUID="80e17f0e-3d69-41fc-90a9-5dba5cde217e" containerName="maas-api" containerID="cri-o://2ee6b35031e1a5ae7d27c02825121c0c4dd0a3a5d9172c41485628238107808a" gracePeriod=30
Oct 30 22:53:21.493410 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:21.493368    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:22.160241 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.160202    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv" podUID="80e17f0e-3d69-41fc-90a9-5dba5cde217e" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.146:8443/health\": dial tcp 10.132.0.146:8443: connect: connection refused"
Oct 30 22:53:22.546284 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.546259    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:53:22.641640 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.641610    4918 generic.go:356] "Generic (PLEG): container finished" podID="80e17f0e-3d69-41fc-90a9-5dba5cde217e" containerID="2ee6b35031e1a5ae7d27c02825121c0c4dd0a3a5d9172c41485628238107808a" exitCode=0
Oct 30 22:53:22.641815 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.641663    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"
Oct 30 22:53:22.641815 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.641716    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv" event={"ID":"80e17f0e-3d69-41fc-90a9-5dba5cde217e","Type":"ContainerDied","Data":"2ee6b35031e1a5ae7d27c02825121c0c4dd0a3a5d9172c41485628238107808a"}
Oct 30 22:53:22.641815 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.641769    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv" event={"ID":"80e17f0e-3d69-41fc-90a9-5dba5cde217e","Type":"ContainerDied","Data":"f24a3944f5d633b052ca658d0da67e5052dae584e4c9b311790e05760f6f8d00"}
Oct 30 22:53:22.641815 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.641782    4918 scope.go:122] "RemoveContainer" containerID="2ee6b35031e1a5ae7d27c02825121c0c4dd0a3a5d9172c41485628238107808a"
Oct 30 22:53:22.656548 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.656526    4918 scope.go:122] "RemoveContainer" containerID="2ee6b35031e1a5ae7d27c02825121c0c4dd0a3a5d9172c41485628238107808a"
Oct 30 22:53:22.656880 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:53:22.656861    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ee6b35031e1a5ae7d27c02825121c0c4dd0a3a5d9172c41485628238107808a\": container with ID starting with 2ee6b35031e1a5ae7d27c02825121c0c4dd0a3a5d9172c41485628238107808a not found: ID does not exist" containerID="2ee6b35031e1a5ae7d27c02825121c0c4dd0a3a5d9172c41485628238107808a"
Oct 30 22:53:22.656934 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.656891    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ee6b35031e1a5ae7d27c02825121c0c4dd0a3a5d9172c41485628238107808a"} err="failed to get container status \"2ee6b35031e1a5ae7d27c02825121c0c4dd0a3a5d9172c41485628238107808a\": rpc error: code = NotFound desc = could not find container \"2ee6b35031e1a5ae7d27c02825121c0c4dd0a3a5d9172c41485628238107808a\": container with ID starting with 2ee6b35031e1a5ae7d27c02825121c0c4dd0a3a5d9172c41485628238107808a not found: ID does not exist"
Oct 30 22:53:22.700584 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.700555    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/80e17f0e-3d69-41fc-90a9-5dba5cde217e-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e17f0e-3d69-41fc-90a9-5dba5cde217e-openshift-service-ca\") pod \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") "
Oct 30 22:53:22.700760 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.700617    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-maas-api-tls\") pod \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") "
Oct 30 22:53:22.700760 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.700731    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/80e17f0e-3d69-41fc-90a9-5dba5cde217e-kube-api-access-xpz4d\" (UniqueName: \"kubernetes.io/projected/80e17f0e-3d69-41fc-90a9-5dba5cde217e-kube-api-access-xpz4d\") pod \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") "
Oct 30 22:53:22.700857 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.700776    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-metrics-certs\") pod \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\" (UID: \"80e17f0e-3d69-41fc-90a9-5dba5cde217e\") "
Oct 30 22:53:22.701008 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.700978    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e17f0e-3d69-41fc-90a9-5dba5cde217e-openshift-service-ca" pod "80e17f0e-3d69-41fc-90a9-5dba5cde217e" (UID: "80e17f0e-3d69-41fc-90a9-5dba5cde217e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:53:22.701141 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.701110    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e17f0e-3d69-41fc-90a9-5dba5cde217e-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:53:22.703037 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.703005    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-metrics-certs" pod "80e17f0e-3d69-41fc-90a9-5dba5cde217e" (UID: "80e17f0e-3d69-41fc-90a9-5dba5cde217e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:53:22.703132 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.703101    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-maas-api-tls" pod "80e17f0e-3d69-41fc-90a9-5dba5cde217e" (UID: "80e17f0e-3d69-41fc-90a9-5dba5cde217e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:53:22.703173 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.703125    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80e17f0e-3d69-41fc-90a9-5dba5cde217e-kube-api-access-xpz4d" pod "80e17f0e-3d69-41fc-90a9-5dba5cde217e" (UID: "80e17f0e-3d69-41fc-90a9-5dba5cde217e"). InnerVolumeSpecName "kube-api-access-xpz4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:53:22.802447 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.802369    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpz4d\" (UniqueName: \"kubernetes.io/projected/80e17f0e-3d69-41fc-90a9-5dba5cde217e-kube-api-access-xpz4d\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:53:22.802447 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.802400    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:53:22.802447 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:22.802413    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e17f0e-3d69-41fc-90a9-5dba5cde217e-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:53:23.008513 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:23.008482    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:23.062646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:23.062575    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"]
Oct 30 22:53:23.111410 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:23.111383    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-bf99ca-6cf8fd8b64-mrtbv"]
Oct 30 22:53:23.139202 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:23.139172    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5" podUID="e0b218f4-c6f2-4ad3-845d-23737a2e544b" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:53:23.314177 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:23.314093    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:24.071806 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:24.071772    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="80e17f0e-3d69-41fc-90a9-5dba5cde217e" path="/var/lib/kubelet/pods/80e17f0e-3d69-41fc-90a9-5dba5cde217e/volumes"
Oct 30 22:53:24.077142 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:24.077112    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:30.320596 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:30.320551    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:30.590437 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:30.590341    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"]
Oct 30 22:53:30.590597 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:30.590555    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk" podUID="20c79fb0-acdd-423d-8269-0e5ba8d95ad0" containerName="istio-proxy" containerID="cri-o://f25a7777a681c85478c6d41ccbcbafdd8e4ff339384b03dcc90b3e29e0353e79" gracePeriod=30
Oct 30 22:53:30.616414 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:30.616386    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:30.903278 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:30.903245    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:32.156553 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:53:32.156519    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:53:33.139076 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:33.139037    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5" podUID="e0b218f4-c6f2-4ad3-845d-23737a2e544b" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 30 22:53:35.710485 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.710446    4918 generic.go:356] "Generic (PLEG): container finished" podID="20c79fb0-acdd-423d-8269-0e5ba8d95ad0" containerID="f25a7777a681c85478c6d41ccbcbafdd8e4ff339384b03dcc90b3e29e0353e79" exitCode=0
Oct 30 22:53:35.710956 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.710512    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk" event={"ID":"20c79fb0-acdd-423d-8269-0e5ba8d95ad0","Type":"ContainerDied","Data":"f25a7777a681c85478c6d41ccbcbafdd8e4ff339384b03dcc90b3e29e0353e79"}
Oct 30 22:53:35.710956 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.710572    4918 scope.go:122] "RemoveContainer" containerID="357bdd85ff70884375455dc26b3a45b53dccbec3db9447063c851260d5ced782"
Oct 30 22:53:35.847144 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.847121    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:53:35.919468 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.919446    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-kube-api-access-j4h6t\" (UniqueName: \"kubernetes.io/projected/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-kube-api-access-j4h6t\") pod \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") "
Oct 30 22:53:35.919593 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.919480    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-envoy\") pod \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") "
Oct 30 22:53:35.919593 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.919499    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-workload-certs\") pod \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") "
Oct 30 22:53:35.919593 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.919516    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-workload-socket\") pod \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") "
Oct 30 22:53:35.919593 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.919574    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istiod-ca-cert\") pod \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") "
Oct 30 22:53:35.919838 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.919605    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-podinfo\") pod \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") "
Oct 30 22:53:35.919838 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.919648    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-data\") pod \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") "
Oct 30 22:53:35.919838 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.919676    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-credential-socket\") pod \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") "
Oct 30 22:53:35.919838 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.919746    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-token\" (UniqueName: \"kubernetes.io/projected/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-token\") pod \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\" (UID: \"20c79fb0-acdd-423d-8269-0e5ba8d95ad0\") "
Oct 30 22:53:35.920060 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.919835    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-workload-certs" pod "20c79fb0-acdd-423d-8269-0e5ba8d95ad0" (UID: "20c79fb0-acdd-423d-8269-0e5ba8d95ad0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:53:35.920060 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.919893    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-workload-socket" pod "20c79fb0-acdd-423d-8269-0e5ba8d95ad0" (UID: "20c79fb0-acdd-423d-8269-0e5ba8d95ad0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:53:35.920175 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.920069    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-credential-socket" pod "20c79fb0-acdd-423d-8269-0e5ba8d95ad0" (UID: "20c79fb0-acdd-423d-8269-0e5ba8d95ad0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:53:35.920175 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.920090    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-data" pod "20c79fb0-acdd-423d-8269-0e5ba8d95ad0" (UID: "20c79fb0-acdd-423d-8269-0e5ba8d95ad0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:53:35.920175 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.920130    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istiod-ca-cert" pod "20c79fb0-acdd-423d-8269-0e5ba8d95ad0" (UID: "20c79fb0-acdd-423d-8269-0e5ba8d95ad0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:53:35.920331 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.920175    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:53:35.920397 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.920335    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:53:35.921704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.921655    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-envoy" pod "20c79fb0-acdd-423d-8269-0e5ba8d95ad0" (UID: "20c79fb0-acdd-423d-8269-0e5ba8d95ad0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:53:35.921890 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.921872    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-kube-api-access-j4h6t" pod "20c79fb0-acdd-423d-8269-0e5ba8d95ad0" (UID: "20c79fb0-acdd-423d-8269-0e5ba8d95ad0"). InnerVolumeSpecName "kube-api-access-j4h6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:53:35.922073 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.922055    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-podinfo" pod "20c79fb0-acdd-423d-8269-0e5ba8d95ad0" (UID: "20c79fb0-acdd-423d-8269-0e5ba8d95ad0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:53:35.922136 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:35.922082    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-token" pod "20c79fb0-acdd-423d-8269-0e5ba8d95ad0" (UID: "20c79fb0-acdd-423d-8269-0e5ba8d95ad0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:53:36.021348 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:36.021322    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:53:36.021348 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:36.021348    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:53:36.021518 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:36.021358    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:53:36.021518 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:36.021366    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:53:36.021518 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:36.021375    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:53:36.021518 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:36.021383    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4h6t\" (UniqueName: \"kubernetes.io/projected/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-kube-api-access-j4h6t\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:53:36.021518 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:36.021391    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20c79fb0-acdd-423d-8269-0e5ba8d95ad0-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:53:36.716900 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:36.716861    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"
Oct 30 22:53:36.717350 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:36.716909    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk" event={"ID":"20c79fb0-acdd-423d-8269-0e5ba8d95ad0","Type":"ContainerDied","Data":"57917d39425e8ea3e91750dcdde037f0502d1fd2cb41498a1b582e4357f38d31"}
Oct 30 22:53:36.717350 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:36.716969    4918 scope.go:122] "RemoveContainer" containerID="f25a7777a681c85478c6d41ccbcbafdd8e4ff339384b03dcc90b3e29e0353e79"
Oct 30 22:53:36.880397 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:36.880364    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"]
Oct 30 22:53:36.887664 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:36.887637    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-single-main-bf99ca-openshift-default-846bd77dd5pmfvk"]
Oct 30 22:53:36.910493 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:36.910463    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:37.337132 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:37.337092    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:38.072476 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.072442    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="20c79fb0-acdd-423d-8269-0e5ba8d95ad0" path="/var/lib/kubelet/pods/20c79fb0-acdd-423d-8269-0e5ba8d95ad0/volumes"
Oct 30 22:53:38.286986 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.286934    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"
Oct 30 22:53:38.346100 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.346064    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e0b218f4-c6f2-4ad3-845d-23737a2e544b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0b218f4-c6f2-4ad3-845d-23737a2e544b-plugins-config-volume\") pod \"e0b218f4-c6f2-4ad3-845d-23737a2e544b\" (UID: \"e0b218f4-c6f2-4ad3-845d-23737a2e544b\") "
Oct 30 22:53:38.346252 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.346206    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e0b218f4-c6f2-4ad3-845d-23737a2e544b-kube-api-access-4rgvz\" (UniqueName: \"kubernetes.io/projected/e0b218f4-c6f2-4ad3-845d-23737a2e544b-kube-api-access-4rgvz\") pod \"e0b218f4-c6f2-4ad3-845d-23737a2e544b\" (UID: \"e0b218f4-c6f2-4ad3-845d-23737a2e544b\") "
Oct 30 22:53:38.346614 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.346592    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0b218f4-c6f2-4ad3-845d-23737a2e544b-plugins-config-volume" pod "e0b218f4-c6f2-4ad3-845d-23737a2e544b" (UID: "e0b218f4-c6f2-4ad3-845d-23737a2e544b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:53:38.348436 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.348413    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0b218f4-c6f2-4ad3-845d-23737a2e544b-kube-api-access-4rgvz" pod "e0b218f4-c6f2-4ad3-845d-23737a2e544b" (UID: "e0b218f4-c6f2-4ad3-845d-23737a2e544b"). InnerVolumeSpecName "kube-api-access-4rgvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:53:38.447216 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.447192    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rgvz\" (UniqueName: \"kubernetes.io/projected/e0b218f4-c6f2-4ad3-845d-23737a2e544b-kube-api-access-4rgvz\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:53:38.447216 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.447216    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0b218f4-c6f2-4ad3-845d-23737a2e544b-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:53:38.728579 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.728542    4918 generic.go:356] "Generic (PLEG): container finished" podID="e0b218f4-c6f2-4ad3-845d-23737a2e544b" containerID="b7abb5a140978f626ab10d631dcaa3c35207786c7ea295b1c276d6bea1b9509e" exitCode=0
Oct 30 22:53:38.728800 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.728603    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"
Oct 30 22:53:38.728800 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.728636    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5" event={"ID":"e0b218f4-c6f2-4ad3-845d-23737a2e544b","Type":"ContainerDied","Data":"b7abb5a140978f626ab10d631dcaa3c35207786c7ea295b1c276d6bea1b9509e"}
Oct 30 22:53:38.728800 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.728748    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5" event={"ID":"e0b218f4-c6f2-4ad3-845d-23737a2e544b","Type":"ContainerDied","Data":"616190fd3c789b8189fd2078a34b039e2a6a12fef1cec4947e232964451bf812"}
Oct 30 22:53:38.728800 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.728782    4918 scope.go:122] "RemoveContainer" containerID="b7abb5a140978f626ab10d631dcaa3c35207786c7ea295b1c276d6bea1b9509e"
Oct 30 22:53:38.737806 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.737790    4918 scope.go:122] "RemoveContainer" containerID="b7abb5a140978f626ab10d631dcaa3c35207786c7ea295b1c276d6bea1b9509e"
Oct 30 22:53:38.738070 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:53:38.738048    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7abb5a140978f626ab10d631dcaa3c35207786c7ea295b1c276d6bea1b9509e\": container with ID starting with b7abb5a140978f626ab10d631dcaa3c35207786c7ea295b1c276d6bea1b9509e not found: ID does not exist" containerID="b7abb5a140978f626ab10d631dcaa3c35207786c7ea295b1c276d6bea1b9509e"
Oct 30 22:53:38.738143 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.738078    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7abb5a140978f626ab10d631dcaa3c35207786c7ea295b1c276d6bea1b9509e"} err="failed to get container status \"b7abb5a140978f626ab10d631dcaa3c35207786c7ea295b1c276d6bea1b9509e\": rpc error: code = NotFound desc = could not find container \"b7abb5a140978f626ab10d631dcaa3c35207786c7ea295b1c276d6bea1b9509e\": container with ID starting with b7abb5a140978f626ab10d631dcaa3c35207786c7ea295b1c276d6bea1b9509e not found: ID does not exist"
Oct 30 22:53:38.891107 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.891084    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"]
Oct 30 22:53:38.940204 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:38.940178    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-single-main-bf99ca-c87bd956cxbmq5"]
Oct 30 22:53:40.072024 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:40.071993    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e0b218f4-c6f2-4ad3-845d-23737a2e544b" path="/var/lib/kubelet/pods/e0b218f4-c6f2-4ad3-845d-23737a2e544b/volumes"
Oct 30 22:53:44.707729 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:44.705826    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:53:44.971844 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:53:44.971765    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:02.158151 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:54:02.158063    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:54:08.326422 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:54:08.326385    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:16.659271 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:54:16.659232    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:21.039057 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:54:21.039011    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:54:22.546198 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:54:22.546167    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:54:22.578831 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:54:22.578803    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:54:32.159921 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:54:32.159882    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:54:37.243646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:54:37.243605    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:02.157968 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:55:02.157910    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:55:07.361895 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:55:07.361837    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:12.135872 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:55:12.135821    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:20.674740 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:55:20.674663    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:55:32.157388 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:55:32.157290    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:55:37.742145 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:55:37.742109    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:02.157963 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:56:02.157905    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:56:02.185422 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.185389    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"]
Oct 30 22:56:02.185820 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.185807    4918 cpu_manager.go:414] "containerMap: removing container" podUID="e0b218f4-c6f2-4ad3-845d-23737a2e544b" containerName="payload-processing"
Oct 30 22:56:02.185872 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.185822    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0b218f4-c6f2-4ad3-845d-23737a2e544b" containerName="payload-processing"
Oct 30 22:56:02.185872 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.185850    4918 cpu_manager.go:414] "containerMap: removing container" podUID="20c79fb0-acdd-423d-8269-0e5ba8d95ad0" containerName="istio-proxy"
Oct 30 22:56:02.185872 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.185856    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="20c79fb0-acdd-423d-8269-0e5ba8d95ad0" containerName="istio-proxy"
Oct 30 22:56:02.185872 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.185865    4918 cpu_manager.go:414] "containerMap: removing container" podUID="20c79fb0-acdd-423d-8269-0e5ba8d95ad0" containerName="istio-proxy"
Oct 30 22:56:02.185872 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.185870    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="20c79fb0-acdd-423d-8269-0e5ba8d95ad0" containerName="istio-proxy"
Oct 30 22:56:02.186043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.185893    4918 cpu_manager.go:414] "containerMap: removing container" podUID="80e17f0e-3d69-41fc-90a9-5dba5cde217e" containerName="maas-api"
Oct 30 22:56:02.186043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.185898    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="80e17f0e-3d69-41fc-90a9-5dba5cde217e" containerName="maas-api"
Oct 30 22:56:02.186043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.185971    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="80e17f0e-3d69-41fc-90a9-5dba5cde217e" containerName="maas-api"
Oct 30 22:56:02.186043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.185979    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="e0b218f4-c6f2-4ad3-845d-23737a2e544b" containerName="payload-processing"
Oct 30 22:56:02.186043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.185988    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="20c79fb0-acdd-423d-8269-0e5ba8d95ad0" containerName="istio-proxy"
Oct 30 22:56:02.186043 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.185994    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="20c79fb0-acdd-423d-8269-0e5ba8d95ad0" containerName="istio-proxy"
Oct 30 22:56:02.189074 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.189056    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"
Oct 30 22:56:02.280637 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.280603    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94436381-7870-42af-894e-d4a6d14db855-openshift-service-ca\") pod \"maas-api-64576576bd-fz2pj\" (UID: \"94436381-7870-42af-894e-d4a6d14db855\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"
Oct 30 22:56:02.280824 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.280652    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94436381-7870-42af-894e-d4a6d14db855-maas-api-tls\") pod \"maas-api-64576576bd-fz2pj\" (UID: \"94436381-7870-42af-894e-d4a6d14db855\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"
Oct 30 22:56:02.280824 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.280791    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8686x\" (UniqueName: \"kubernetes.io/projected/94436381-7870-42af-894e-d4a6d14db855-kube-api-access-8686x\") pod \"maas-api-64576576bd-fz2pj\" (UID: \"94436381-7870-42af-894e-d4a6d14db855\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"
Oct 30 22:56:02.280905 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.280885    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94436381-7870-42af-894e-d4a6d14db855-metrics-certs\") pod \"maas-api-64576576bd-fz2pj\" (UID: \"94436381-7870-42af-894e-d4a6d14db855\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"
Oct 30 22:56:02.292730 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.292700    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"]
Oct 30 22:56:02.381795 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.381742    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94436381-7870-42af-894e-d4a6d14db855-openshift-service-ca\") pod \"maas-api-64576576bd-fz2pj\" (UID: \"94436381-7870-42af-894e-d4a6d14db855\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"
Oct 30 22:56:02.382010 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.381812    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94436381-7870-42af-894e-d4a6d14db855-maas-api-tls\") pod \"maas-api-64576576bd-fz2pj\" (UID: \"94436381-7870-42af-894e-d4a6d14db855\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"
Oct 30 22:56:02.382010 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.381860    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8686x\" (UniqueName: \"kubernetes.io/projected/94436381-7870-42af-894e-d4a6d14db855-kube-api-access-8686x\") pod \"maas-api-64576576bd-fz2pj\" (UID: \"94436381-7870-42af-894e-d4a6d14db855\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"
Oct 30 22:56:02.382010 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.381895    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94436381-7870-42af-894e-d4a6d14db855-metrics-certs\") pod \"maas-api-64576576bd-fz2pj\" (UID: \"94436381-7870-42af-894e-d4a6d14db855\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"
Oct 30 22:56:02.382551 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.382522    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94436381-7870-42af-894e-d4a6d14db855-openshift-service-ca\") pod \"maas-api-64576576bd-fz2pj\" (UID: \"94436381-7870-42af-894e-d4a6d14db855\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"
Oct 30 22:56:02.384473 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.384454    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94436381-7870-42af-894e-d4a6d14db855-metrics-certs\") pod \"maas-api-64576576bd-fz2pj\" (UID: \"94436381-7870-42af-894e-d4a6d14db855\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"
Oct 30 22:56:02.384621 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.384601    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94436381-7870-42af-894e-d4a6d14db855-maas-api-tls\") pod \"maas-api-64576576bd-fz2pj\" (UID: \"94436381-7870-42af-894e-d4a6d14db855\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"
Oct 30 22:56:02.443093 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.443031    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8686x\" (UniqueName: \"kubernetes.io/projected/94436381-7870-42af-894e-d4a6d14db855-kube-api-access-8686x\") pod \"maas-api-64576576bd-fz2pj\" (UID: \"94436381-7870-42af-894e-d4a6d14db855\") " pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"
Oct 30 22:56:02.502085 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.502054    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"
Oct 30 22:56:02.878549 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.878455    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"]
Oct 30 22:56:02.882610 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:56:02.882578    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94436381_7870_42af_894e_d4a6d14db855.slice/crio-a4a1d6d0f43a736a8c5cce038dde38932f203db59f4e2c59d9c626e328e9343e WatchSource:0}: Error finding container a4a1d6d0f43a736a8c5cce038dde38932f203db59f4e2c59d9c626e328e9343e: Status 404 returned error can't find the container with id a4a1d6d0f43a736a8c5cce038dde38932f203db59f4e2c59d9c626e328e9343e
Oct 30 22:56:02.883917 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:02.883901    4918 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 22:56:03.510349 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:03.510305    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj" event={"ID":"94436381-7870-42af-894e-d4a6d14db855","Type":"ContainerStarted","Data":"a4a1d6d0f43a736a8c5cce038dde38932f203db59f4e2c59d9c626e328e9343e"}
Oct 30 22:56:04.516083 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:04.516041    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj" event={"ID":"94436381-7870-42af-894e-d4a6d14db855","Type":"ContainerStarted","Data":"20ad0398c223b19c6ff3187c4f744c68e24256aad88c5b553a6a5790958fd111"}
Oct 30 22:56:04.516580 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:04.516199    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"
Oct 30 22:56:04.635086 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:04.635033    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj" podStartSLOduration=1.662008783 podStartE2EDuration="2.635019794s" totalImagesPullingTime="973.011011ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:56:04.63272561 +0000 UTC m=+4302.681333307" watchObservedRunningTime="2026-10-30 22:56:04.635019794 +0000 UTC m=+4302.683627489"
Oct 30 22:56:08.593765 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:08.593726    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:09.260998 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:09.260959    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:09.561495 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:09.561410    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:10.526037 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:10.526008    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-64576576bd-fz2pj"
Oct 30 22:56:12.685717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:12.685671    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:12.954529 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:12.954428    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:15.887787 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:15.887548    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:16.151261 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:16.151231    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:16.343622 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:16.343590    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"]
Oct 30 22:56:16.350289 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:16.350228    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"
Oct 30 22:56:16.404646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:16.404582    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"]
Oct 30 22:56:16.451740 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:16.451709    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-a75435c5\""
Oct 30 22:56:16.451873 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:16.451813    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-a75435c5-dockercfg-m8zg8\""
Oct 30 22:56:16.525373 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:16.525344    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/590b31e3-2d41-429c-9e72-0c7a64c901ff-plugins-config-volume\") pod \"payload-processing-e2e-ait-a75435c5-7d7889497-scc6q\" (UID: \"590b31e3-2d41-429c-9e72-0c7a64c901ff\") " pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"
Oct 30 22:56:16.525517 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:16.525403    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npj8s\" (UniqueName: \"kubernetes.io/projected/590b31e3-2d41-429c-9e72-0c7a64c901ff-kube-api-access-npj8s\") pod \"payload-processing-e2e-ait-a75435c5-7d7889497-scc6q\" (UID: \"590b31e3-2d41-429c-9e72-0c7a64c901ff\") " pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"
Oct 30 22:56:16.626549 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:16.626520    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npj8s\" (UniqueName: \"kubernetes.io/projected/590b31e3-2d41-429c-9e72-0c7a64c901ff-kube-api-access-npj8s\") pod \"payload-processing-e2e-ait-a75435c5-7d7889497-scc6q\" (UID: \"590b31e3-2d41-429c-9e72-0c7a64c901ff\") " pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"
Oct 30 22:56:16.626717 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:16.626615    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/590b31e3-2d41-429c-9e72-0c7a64c901ff-plugins-config-volume\") pod \"payload-processing-e2e-ait-a75435c5-7d7889497-scc6q\" (UID: \"590b31e3-2d41-429c-9e72-0c7a64c901ff\") " pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"
Oct 30 22:56:16.627321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:16.627302    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/590b31e3-2d41-429c-9e72-0c7a64c901ff-plugins-config-volume\") pod \"payload-processing-e2e-ait-a75435c5-7d7889497-scc6q\" (UID: \"590b31e3-2d41-429c-9e72-0c7a64c901ff\") " pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"
Oct 30 22:56:16.686987 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:16.686932    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npj8s\" (UniqueName: \"kubernetes.io/projected/590b31e3-2d41-429c-9e72-0c7a64c901ff-kube-api-access-npj8s\") pod \"payload-processing-e2e-ait-a75435c5-7d7889497-scc6q\" (UID: \"590b31e3-2d41-429c-9e72-0c7a64c901ff\") " pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"
Oct 30 22:56:16.967368 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:16.967293    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"
Oct 30 22:56:17.341968 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.341873    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"]
Oct 30 22:56:17.345238 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:56:17.345208    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod590b31e3_2d41_429c_9e72_0c7a64c901ff.slice/crio-9382845634b46de998729ccee6ad13333972b0d35594eb10f0c9b365a82c2375 WatchSource:0}: Error finding container 9382845634b46de998729ccee6ad13333972b0d35594eb10f0c9b365a82c2375: Status 404 returned error can't find the container with id 9382845634b46de998729ccee6ad13333972b0d35594eb10f0c9b365a82c2375
Oct 30 22:56:17.575496 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.575459    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q" event={"ID":"590b31e3-2d41-429c-9e72-0c7a64c901ff","Type":"ContainerStarted","Data":"420dd0f183ab17a5e9545e9a7422eb543572acd31e5965d280a303af7ac3e1f8"}
Oct 30 22:56:17.575651 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.575522    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q" event={"ID":"590b31e3-2d41-429c-9e72-0c7a64c901ff","Type":"ContainerStarted","Data":"9382845634b46de998729ccee6ad13333972b0d35594eb10f0c9b365a82c2375"}
Oct 30 22:56:17.575651 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.575551    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"
Oct 30 22:56:17.678048 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.678021    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"]
Oct 30 22:56:17.681559 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.681541    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:17.721751 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.721703    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q" podStartSLOduration=1.7216758479999998 podStartE2EDuration="1.721675848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:56:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:56:17.689695984 +0000 UTC m=+4315.738303670" watchObservedRunningTime="2026-10-30 22:56:17.721675848 +0000 UTC m=+4315.770283542"
Oct 30 22:56:17.733353 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.733327    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a75435c5-serving-cert\""
Oct 30 22:56:17.733957 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.733926    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"]
Oct 30 22:56:17.837340 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.837308    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-metrics-certs\") pod \"maas-api-e2e-ait-a75435c5-66795848b8-cxkm4\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:17.837511 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.837382    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-maas-api-tls\") pod \"maas-api-e2e-ait-a75435c5-66795848b8-cxkm4\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:17.837511 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.837491    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxbvq\" (UniqueName: \"kubernetes.io/projected/7526d873-80b9-4028-9b46-dbd354acbc4c-kube-api-access-bxbvq\") pod \"maas-api-e2e-ait-a75435c5-66795848b8-cxkm4\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:17.837615 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.837534    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7526d873-80b9-4028-9b46-dbd354acbc4c-openshift-service-ca\") pod \"maas-api-e2e-ait-a75435c5-66795848b8-cxkm4\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:17.939770 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.939068    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-maas-api-tls\") pod \"maas-api-e2e-ait-a75435c5-66795848b8-cxkm4\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:17.939770 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.939165    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxbvq\" (UniqueName: \"kubernetes.io/projected/7526d873-80b9-4028-9b46-dbd354acbc4c-kube-api-access-bxbvq\") pod \"maas-api-e2e-ait-a75435c5-66795848b8-cxkm4\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:17.939770 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.939209    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7526d873-80b9-4028-9b46-dbd354acbc4c-openshift-service-ca\") pod \"maas-api-e2e-ait-a75435c5-66795848b8-cxkm4\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:17.939770 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:56:17.939299    4918 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-serving-cert: secret "maas-api-e2e-ait-a75435c5-serving-cert" not found
Oct 30 22:56:17.939770 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:56:17.939408    4918 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-maas-api-tls podName:7526d873-80b9-4028-9b46-dbd354acbc4c nodeName:}" failed. No retries permitted until 2026-10-30 22:56:18.439386261 +0000 UTC m=+4316.487993955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-maas-api-tls") pod "maas-api-e2e-ait-a75435c5-66795848b8-cxkm4" (UID: "7526d873-80b9-4028-9b46-dbd354acbc4c") : secret "maas-api-e2e-ait-a75435c5-serving-cert" not found
Oct 30 22:56:17.940480 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.939276    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-metrics-certs\") pod \"maas-api-e2e-ait-a75435c5-66795848b8-cxkm4\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:17.941095 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.941067    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7526d873-80b9-4028-9b46-dbd354acbc4c-openshift-service-ca\") pod \"maas-api-e2e-ait-a75435c5-66795848b8-cxkm4\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:17.943571 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.943541    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-metrics-certs\") pod \"maas-api-e2e-ait-a75435c5-66795848b8-cxkm4\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:17.982412 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:17.982380    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:18.000239 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:18.000209    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxbvq\" (UniqueName: \"kubernetes.io/projected/7526d873-80b9-4028-9b46-dbd354acbc4c-kube-api-access-bxbvq\") pod \"maas-api-e2e-ait-a75435c5-66795848b8-cxkm4\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:18.268201 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:18.268093    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:18.445651 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:18.445619    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-maas-api-tls\") pod \"maas-api-e2e-ait-a75435c5-66795848b8-cxkm4\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:18.448551 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:18.448524    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-maas-api-tls\") pod \"maas-api-e2e-ait-a75435c5-66795848b8-cxkm4\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:18.495430 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:18.495386    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:18.594141 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:18.594076    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:18.861585 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:18.861513    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-699557768d-h2h47"]
Oct 30 22:56:18.861777 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:18.861753    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47" podUID="9fec3021-78f4-4790-9d33-772cb1e15a22" containerName="maas-api" containerID="cri-o://3890086cc5a22bb28e188c2e45b367b1340ebaca9ed3aca6b96aa53aaeebb17a" gracePeriod=30
Oct 30 22:56:19.022647 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:19.022613    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"]
Oct 30 22:56:19.025757 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:56:19.025663    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7526d873_80b9_4028_9b46_dbd354acbc4c.slice/crio-85c82b9adf9126db77d756352af14503a7c365fd60d38ec43b9247d1b54eb312 WatchSource:0}: Error finding container 85c82b9adf9126db77d756352af14503a7c365fd60d38ec43b9247d1b54eb312: Status 404 returned error can't find the container with id 85c82b9adf9126db77d756352af14503a7c365fd60d38ec43b9247d1b54eb312
Oct 30 22:56:19.587237 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:19.587196    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4" event={"ID":"7526d873-80b9-4028-9b46-dbd354acbc4c","Type":"ContainerStarted","Data":"85c82b9adf9126db77d756352af14503a7c365fd60d38ec43b9247d1b54eb312"}
Oct 30 22:56:20.119459 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.119437    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 22:56:20.160131 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.160072    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9fec3021-78f4-4790-9d33-772cb1e15a22-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fec3021-78f4-4790-9d33-772cb1e15a22-openshift-service-ca\") pod \"9fec3021-78f4-4790-9d33-772cb1e15a22\" (UID: \"9fec3021-78f4-4790-9d33-772cb1e15a22\") "
Oct 30 22:56:20.160257 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.160157    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9fec3021-78f4-4790-9d33-772cb1e15a22-kube-api-access-f2m9r\" (UniqueName: \"kubernetes.io/projected/9fec3021-78f4-4790-9d33-772cb1e15a22-kube-api-access-f2m9r\") pod \"9fec3021-78f4-4790-9d33-772cb1e15a22\" (UID: \"9fec3021-78f4-4790-9d33-772cb1e15a22\") "
Oct 30 22:56:20.160257 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.160227    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9fec3021-78f4-4790-9d33-772cb1e15a22-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fec3021-78f4-4790-9d33-772cb1e15a22-metrics-certs\") pod \"9fec3021-78f4-4790-9d33-772cb1e15a22\" (UID: \"9fec3021-78f4-4790-9d33-772cb1e15a22\") "
Oct 30 22:56:20.160391 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.160263    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9fec3021-78f4-4790-9d33-772cb1e15a22-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fec3021-78f4-4790-9d33-772cb1e15a22-maas-api-tls\") pod \"9fec3021-78f4-4790-9d33-772cb1e15a22\" (UID: \"9fec3021-78f4-4790-9d33-772cb1e15a22\") "
Oct 30 22:56:20.160508 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.160484    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fec3021-78f4-4790-9d33-772cb1e15a22-openshift-service-ca" pod "9fec3021-78f4-4790-9d33-772cb1e15a22" (UID: "9fec3021-78f4-4790-9d33-772cb1e15a22"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:56:20.162455 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.162427    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fec3021-78f4-4790-9d33-772cb1e15a22-maas-api-tls" pod "9fec3021-78f4-4790-9d33-772cb1e15a22" (UID: "9fec3021-78f4-4790-9d33-772cb1e15a22"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:56:20.162455 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.162441    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fec3021-78f4-4790-9d33-772cb1e15a22-metrics-certs" pod "9fec3021-78f4-4790-9d33-772cb1e15a22" (UID: "9fec3021-78f4-4790-9d33-772cb1e15a22"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:56:20.162628 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.162513    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fec3021-78f4-4790-9d33-772cb1e15a22-kube-api-access-f2m9r" pod "9fec3021-78f4-4790-9d33-772cb1e15a22" (UID: "9fec3021-78f4-4790-9d33-772cb1e15a22"). InnerVolumeSpecName "kube-api-access-f2m9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:56:20.260965 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.260935    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2m9r\" (UniqueName: \"kubernetes.io/projected/9fec3021-78f4-4790-9d33-772cb1e15a22-kube-api-access-f2m9r\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:56:20.260965 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.260960    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9fec3021-78f4-4790-9d33-772cb1e15a22-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:56:20.260965 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.260970    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fec3021-78f4-4790-9d33-772cb1e15a22-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:56:20.261189 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.260980    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fec3021-78f4-4790-9d33-772cb1e15a22-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:56:20.593800 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.593718    4918 generic.go:356] "Generic (PLEG): container finished" podID="9fec3021-78f4-4790-9d33-772cb1e15a22" containerID="3890086cc5a22bb28e188c2e45b367b1340ebaca9ed3aca6b96aa53aaeebb17a" exitCode=0
Oct 30 22:56:20.593970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.593809    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47"
Oct 30 22:56:20.593970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.593843    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47" event={"ID":"9fec3021-78f4-4790-9d33-772cb1e15a22","Type":"ContainerDied","Data":"3890086cc5a22bb28e188c2e45b367b1340ebaca9ed3aca6b96aa53aaeebb17a"}
Oct 30 22:56:20.593970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.593906    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-699557768d-h2h47" event={"ID":"9fec3021-78f4-4790-9d33-772cb1e15a22","Type":"ContainerDied","Data":"fab2ddbbb985a0687796e590952c162f6d5c7e3345a8bee757de2bb3b9c1b933"}
Oct 30 22:56:20.593970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.593946    4918 scope.go:122] "RemoveContainer" containerID="3890086cc5a22bb28e188c2e45b367b1340ebaca9ed3aca6b96aa53aaeebb17a"
Oct 30 22:56:20.595646 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.595620    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4" event={"ID":"7526d873-80b9-4028-9b46-dbd354acbc4c","Type":"ContainerStarted","Data":"4a195300394719b68efaa602c0f14b09f74f5da0c5546f406954d5e53a52db5e"}
Oct 30 22:56:20.595884 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.595865    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:20.605374 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.605353    4918 scope.go:122] "RemoveContainer" containerID="3890086cc5a22bb28e188c2e45b367b1340ebaca9ed3aca6b96aa53aaeebb17a"
Oct 30 22:56:20.605624 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:56:20.605605    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3890086cc5a22bb28e188c2e45b367b1340ebaca9ed3aca6b96aa53aaeebb17a\": container with ID starting with 3890086cc5a22bb28e188c2e45b367b1340ebaca9ed3aca6b96aa53aaeebb17a not found: ID does not exist" containerID="3890086cc5a22bb28e188c2e45b367b1340ebaca9ed3aca6b96aa53aaeebb17a"
Oct 30 22:56:20.605718 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.605632    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3890086cc5a22bb28e188c2e45b367b1340ebaca9ed3aca6b96aa53aaeebb17a"} err="failed to get container status \"3890086cc5a22bb28e188c2e45b367b1340ebaca9ed3aca6b96aa53aaeebb17a\": rpc error: code = NotFound desc = could not find container \"3890086cc5a22bb28e188c2e45b367b1340ebaca9ed3aca6b96aa53aaeebb17a\": container with ID starting with 3890086cc5a22bb28e188c2e45b367b1340ebaca9ed3aca6b96aa53aaeebb17a not found: ID does not exist"
Oct 30 22:56:20.763365 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.763307    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4" podStartSLOduration=2.894656467 podStartE2EDuration="3.763289826s" totalImagesPullingTime="868.633359ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:56:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:56:20.762154511 +0000 UTC m=+4318.810762205" watchObservedRunningTime="2026-10-30 22:56:20.763289826 +0000 UTC m=+4318.811897520"
Oct 30 22:56:20.877704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.874067    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-699557768d-h2h47"]
Oct 30 22:56:20.877704 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:20.877600    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-699557768d-h2h47"]
Oct 30 22:56:22.084716 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:22.084659    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9fec3021-78f4-4790-9d33-772cb1e15a22" path="/var/lib/kubelet/pods/9fec3021-78f4-4790-9d33-772cb1e15a22/volumes"
Oct 30 22:56:23.385005 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:23.384973    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:26.607078 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:26.607049    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:56:28.286519 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:28.286479    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:28.583836 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:28.583750    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"
Oct 30 22:56:32.157901 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:56:32.157863    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:56:33.239567 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:33.239525    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:38.045197 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:38.045157    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:38.604953 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:38.604909    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:43.953248 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:43.953209    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:48.833970 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:48.833921    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:53.733026 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:53.732984    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:58.624030 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:58.623998    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:56:59.285674 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:59.285640    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"]
Oct 30 22:56:59.783445 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:56:59.783404    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:00.086544 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:00.086458    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:02.161912 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:57:02.161873    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:57:03.438053 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:03.438015    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:04.286348 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.286300    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q" podUID="590b31e3-2d41-429c-9e72-0c7a64c901ff" containerName="payload-processing" containerID="cri-o://420dd0f183ab17a5e9545e9a7422eb543572acd31e5965d280a303af7ac3e1f8" gracePeriod=25
Oct 30 22:57:04.544778 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.544716    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"
Oct 30 22:57:04.672940 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.672910    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/590b31e3-2d41-429c-9e72-0c7a64c901ff-kube-api-access-npj8s\" (UniqueName: \"kubernetes.io/projected/590b31e3-2d41-429c-9e72-0c7a64c901ff-kube-api-access-npj8s\") pod \"590b31e3-2d41-429c-9e72-0c7a64c901ff\" (UID: \"590b31e3-2d41-429c-9e72-0c7a64c901ff\") "
Oct 30 22:57:04.673172 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.672950    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/590b31e3-2d41-429c-9e72-0c7a64c901ff-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/590b31e3-2d41-429c-9e72-0c7a64c901ff-plugins-config-volume\") pod \"590b31e3-2d41-429c-9e72-0c7a64c901ff\" (UID: \"590b31e3-2d41-429c-9e72-0c7a64c901ff\") "
Oct 30 22:57:04.673347 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.673323    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/590b31e3-2d41-429c-9e72-0c7a64c901ff-plugins-config-volume" pod "590b31e3-2d41-429c-9e72-0c7a64c901ff" (UID: "590b31e3-2d41-429c-9e72-0c7a64c901ff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:57:04.675246 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.675223    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/590b31e3-2d41-429c-9e72-0c7a64c901ff-kube-api-access-npj8s" pod "590b31e3-2d41-429c-9e72-0c7a64c901ff" (UID: "590b31e3-2d41-429c-9e72-0c7a64c901ff"). InnerVolumeSpecName "kube-api-access-npj8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:57:04.774332 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.774295    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npj8s\" (UniqueName: \"kubernetes.io/projected/590b31e3-2d41-429c-9e72-0c7a64c901ff-kube-api-access-npj8s\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:57:04.774332 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.774334    4918 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/590b31e3-2d41-429c-9e72-0c7a64c901ff-plugins-config-volume\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:57:04.803838 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.803747    4918 generic.go:356] "Generic (PLEG): container finished" podID="590b31e3-2d41-429c-9e72-0c7a64c901ff" containerID="420dd0f183ab17a5e9545e9a7422eb543572acd31e5965d280a303af7ac3e1f8" exitCode=0
Oct 30 22:57:04.803838 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.803805    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"
Oct 30 22:57:04.804042 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.803861    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q" event={"ID":"590b31e3-2d41-429c-9e72-0c7a64c901ff","Type":"ContainerDied","Data":"420dd0f183ab17a5e9545e9a7422eb543572acd31e5965d280a303af7ac3e1f8"}
Oct 30 22:57:04.804042 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.803927    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q" event={"ID":"590b31e3-2d41-429c-9e72-0c7a64c901ff","Type":"ContainerDied","Data":"9382845634b46de998729ccee6ad13333972b0d35594eb10f0c9b365a82c2375"}
Oct 30 22:57:04.804042 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.803949    4918 scope.go:122] "RemoveContainer" containerID="420dd0f183ab17a5e9545e9a7422eb543572acd31e5965d280a303af7ac3e1f8"
Oct 30 22:57:04.814199 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.814175    4918 scope.go:122] "RemoveContainer" containerID="420dd0f183ab17a5e9545e9a7422eb543572acd31e5965d280a303af7ac3e1f8"
Oct 30 22:57:04.814725 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:57:04.814694    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"420dd0f183ab17a5e9545e9a7422eb543572acd31e5965d280a303af7ac3e1f8\": container with ID starting with 420dd0f183ab17a5e9545e9a7422eb543572acd31e5965d280a303af7ac3e1f8 not found: ID does not exist" containerID="420dd0f183ab17a5e9545e9a7422eb543572acd31e5965d280a303af7ac3e1f8"
Oct 30 22:57:04.814825 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.814736    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"420dd0f183ab17a5e9545e9a7422eb543572acd31e5965d280a303af7ac3e1f8"} err="failed to get container status \"420dd0f183ab17a5e9545e9a7422eb543572acd31e5965d280a303af7ac3e1f8\": rpc error: code = NotFound desc = could not find container \"420dd0f183ab17a5e9545e9a7422eb543572acd31e5965d280a303af7ac3e1f8\": container with ID starting with 420dd0f183ab17a5e9545e9a7422eb543572acd31e5965d280a303af7ac3e1f8 not found: ID does not exist"
Oct 30 22:57:04.837181 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:57:04.837158    4918 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod590b31e3_2d41_429c_9e72_0c7a64c901ff.slice\": RecentStats: unable to find data in memory cache]"
Oct 30 22:57:04.966846 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.966809    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"]
Oct 30 22:57:04.970898 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:04.970870    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a75435c5-7d7889497-scc6q"]
Oct 30 22:57:06.071766 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:06.071728    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="590b31e3-2d41-429c-9e72-0c7a64c901ff" path="/var/lib/kubelet/pods/590b31e3-2d41-429c-9e72-0c7a64c901ff/volumes"
Oct 30 22:57:07.465343 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.465308    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"]
Oct 30 22:57:07.465862 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.465580    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4" podUID="7526d873-80b9-4028-9b46-dbd354acbc4c" containerName="maas-api" containerID="cri-o://4a195300394719b68efaa602c0f14b09f74f5da0c5546f406954d5e53a52db5e" gracePeriod=30
Oct 30 22:57:07.670413 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.670373    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:07.731458 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.731388    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:57:07.824585 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.824547    4918 generic.go:356] "Generic (PLEG): container finished" podID="7526d873-80b9-4028-9b46-dbd354acbc4c" containerID="4a195300394719b68efaa602c0f14b09f74f5da0c5546f406954d5e53a52db5e" exitCode=0
Oct 30 22:57:07.824797 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.824600    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"
Oct 30 22:57:07.824797 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.824603    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4" event={"ID":"7526d873-80b9-4028-9b46-dbd354acbc4c","Type":"ContainerDied","Data":"4a195300394719b68efaa602c0f14b09f74f5da0c5546f406954d5e53a52db5e"}
Oct 30 22:57:07.824797 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.824655    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4" event={"ID":"7526d873-80b9-4028-9b46-dbd354acbc4c","Type":"ContainerDied","Data":"85c82b9adf9126db77d756352af14503a7c365fd60d38ec43b9247d1b54eb312"}
Oct 30 22:57:07.824797 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.824699    4918 scope.go:122] "RemoveContainer" containerID="4a195300394719b68efaa602c0f14b09f74f5da0c5546f406954d5e53a52db5e"
Oct 30 22:57:07.833589 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.833570    4918 scope.go:122] "RemoveContainer" containerID="4a195300394719b68efaa602c0f14b09f74f5da0c5546f406954d5e53a52db5e"
Oct 30 22:57:07.833863 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:57:07.833842    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a195300394719b68efaa602c0f14b09f74f5da0c5546f406954d5e53a52db5e\": container with ID starting with 4a195300394719b68efaa602c0f14b09f74f5da0c5546f406954d5e53a52db5e not found: ID does not exist" containerID="4a195300394719b68efaa602c0f14b09f74f5da0c5546f406954d5e53a52db5e"
Oct 30 22:57:07.833956 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.833872    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a195300394719b68efaa602c0f14b09f74f5da0c5546f406954d5e53a52db5e"} err="failed to get container status \"4a195300394719b68efaa602c0f14b09f74f5da0c5546f406954d5e53a52db5e\": rpc error: code = NotFound desc = could not find container \"4a195300394719b68efaa602c0f14b09f74f5da0c5546f406954d5e53a52db5e\": container with ID starting with 4a195300394719b68efaa602c0f14b09f74f5da0c5546f406954d5e53a52db5e not found: ID does not exist"
Oct 30 22:57:07.904412 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.904382    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-metrics-certs\") pod \"7526d873-80b9-4028-9b46-dbd354acbc4c\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") "
Oct 30 22:57:07.904623 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.904426    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-maas-api-tls\") pod \"7526d873-80b9-4028-9b46-dbd354acbc4c\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") "
Oct 30 22:57:07.904623 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.904526    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7526d873-80b9-4028-9b46-dbd354acbc4c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7526d873-80b9-4028-9b46-dbd354acbc4c-openshift-service-ca\") pod \"7526d873-80b9-4028-9b46-dbd354acbc4c\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") "
Oct 30 22:57:07.904623 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.904580    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7526d873-80b9-4028-9b46-dbd354acbc4c-kube-api-access-bxbvq\" (UniqueName: \"kubernetes.io/projected/7526d873-80b9-4028-9b46-dbd354acbc4c-kube-api-access-bxbvq\") pod \"7526d873-80b9-4028-9b46-dbd354acbc4c\" (UID: \"7526d873-80b9-4028-9b46-dbd354acbc4c\") "
Oct 30 22:57:07.904946 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.904914    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7526d873-80b9-4028-9b46-dbd354acbc4c-openshift-service-ca" pod "7526d873-80b9-4028-9b46-dbd354acbc4c" (UID: "7526d873-80b9-4028-9b46-dbd354acbc4c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:57:07.906892 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.906864    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-maas-api-tls" pod "7526d873-80b9-4028-9b46-dbd354acbc4c" (UID: "7526d873-80b9-4028-9b46-dbd354acbc4c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:57:07.906986 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.906904    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-metrics-certs" pod "7526d873-80b9-4028-9b46-dbd354acbc4c" (UID: "7526d873-80b9-4028-9b46-dbd354acbc4c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:57:07.906986 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:07.906910    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7526d873-80b9-4028-9b46-dbd354acbc4c-kube-api-access-bxbvq" pod "7526d873-80b9-4028-9b46-dbd354acbc4c" (UID: "7526d873-80b9-4028-9b46-dbd354acbc4c"). InnerVolumeSpecName "kube-api-access-bxbvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:57:08.006321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:08.006239    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:57:08.006321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:08.006270    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7526d873-80b9-4028-9b46-dbd354acbc4c-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:57:08.006321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:08.006280    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7526d873-80b9-4028-9b46-dbd354acbc4c-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:57:08.006321 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:08.006289    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxbvq\" (UniqueName: \"kubernetes.io/projected/7526d873-80b9-4028-9b46-dbd354acbc4c-kube-api-access-bxbvq\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:57:08.237916 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:08.237882    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"]
Oct 30 22:57:08.286938 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:08.286851    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a75435c5-66795848b8-cxkm4"]
Oct 30 22:57:08.870825 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:08.870793    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:09.220252 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:09.220213    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:09.562990 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:09.562888    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:10.071059 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:10.071021    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7526d873-80b9-4028-9b46-dbd354acbc4c" path="/var/lib/kubelet/pods/7526d873-80b9-4028-9b46-dbd354acbc4c/volumes"
Oct 30 22:57:15.144239 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:15.144205    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:16.349667 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.349623    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:16.749409 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.749373    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"]
Oct 30 22:57:16.749890 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.749871    4918 cpu_manager.go:414] "containerMap: removing container" podUID="7526d873-80b9-4028-9b46-dbd354acbc4c" containerName="maas-api"
Oct 30 22:57:16.750015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.749892    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7526d873-80b9-4028-9b46-dbd354acbc4c" containerName="maas-api"
Oct 30 22:57:16.750015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.749919    4918 cpu_manager.go:414] "containerMap: removing container" podUID="590b31e3-2d41-429c-9e72-0c7a64c901ff" containerName="payload-processing"
Oct 30 22:57:16.750015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.749926    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="590b31e3-2d41-429c-9e72-0c7a64c901ff" containerName="payload-processing"
Oct 30 22:57:16.750015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.749954    4918 cpu_manager.go:414] "containerMap: removing container" podUID="9fec3021-78f4-4790-9d33-772cb1e15a22" containerName="maas-api"
Oct 30 22:57:16.750015 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.749962    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9fec3021-78f4-4790-9d33-772cb1e15a22" containerName="maas-api"
Oct 30 22:57:16.750283 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.750052    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="9fec3021-78f4-4790-9d33-772cb1e15a22" containerName="maas-api"
Oct 30 22:57:16.750283 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.750071    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="7526d873-80b9-4028-9b46-dbd354acbc4c" containerName="maas-api"
Oct 30 22:57:16.750283 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.750082    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="590b31e3-2d41-429c-9e72-0c7a64c901ff" containerName="payload-processing"
Oct 30 22:57:16.755757 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.755732    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.793477 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.793437    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc4p2\" (UniqueName: \"kubernetes.io/projected/2acab649-cc4f-43f3-bffe-c371907a0d3c-kube-api-access-qc4p2\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.793877 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.793848    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2acab649-cc4f-43f3-bffe-c371907a0d3c-istiod-ca-cert\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.794072 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.794056    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-token\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.794265 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.794250    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-data\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.794420 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.794397    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-podinfo\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.794558 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.794523    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-workload-socket\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.794934 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.794902    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-envoy\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.795132 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.794997    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-workload-certs\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.795132 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.795028    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-credential-socket\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.808485 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.808451    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-authcfg-http-8f0848-openshift-default-dockercfg-xk6js\""
Oct 30 22:57:16.862418 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.862367    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"]
Oct 30 22:57:16.900848 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.900798    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-envoy\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.901221 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.901195    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-workload-certs\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.901337 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.901241    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-credential-socket\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.901337 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.901292    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc4p2\" (UniqueName: \"kubernetes.io/projected/2acab649-cc4f-43f3-bffe-c371907a0d3c-kube-api-access-qc4p2\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.901337 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.901329    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2acab649-cc4f-43f3-bffe-c371907a0d3c-istiod-ca-cert\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.901505 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.901399    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-token\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.901505 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.901428    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-data\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.901653 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.901630    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-podinfo\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.901747 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.901731    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-workload-socket\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.902170 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.902137    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2acab649-cc4f-43f3-bffe-c371907a0d3c-istiod-ca-cert\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.902489 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.902466    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-credential-socket\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.924720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.919795    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-data\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.924720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.921000    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-envoy\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.924720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.921163    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-workload-socket\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.924720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.921265    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-workload-certs\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.927720 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.925438    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-podinfo\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.954370 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.954328    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:16.964673 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.964650    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-token\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:16.964806 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:16.964735    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc4p2\" (UniqueName: \"kubernetes.io/projected/2acab649-cc4f-43f3-bffe-c371907a0d3c-kube-api-access-qc4p2\") pod \"e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") " pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:17.070258 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:17.070196    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:17.268924 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:17.268890    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:17.508542 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:17.508509    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"]
Oct 30 22:57:17.511462 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:57:17.511431    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2acab649_cc4f_43f3_bffe_c371907a0d3c.slice/crio-cd91ab5130ef4515c21e6acbf27fa9d011cecd2d96f3c9c06768634631b1112f WatchSource:0}: Error finding container cd91ab5130ef4515c21e6acbf27fa9d011cecd2d96f3c9c06768634631b1112f: Status 404 returned error can't find the container with id cd91ab5130ef4515c21e6acbf27fa9d011cecd2d96f3c9c06768634631b1112f
Oct 30 22:57:17.513535 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:17.513503    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:57:17.513604 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:17.513583    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:57:17.513640 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:17.513613    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:57:17.873828 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:17.873730    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb" event={"ID":"2acab649-cc4f-43f3-bffe-c371907a0d3c","Type":"ContainerStarted","Data":"ef6de46f40905af2b527e102d01928f835a3a5da525180779db55894d04018ba"}
Oct 30 22:57:17.873828 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:17.873794    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb" event={"ID":"2acab649-cc4f-43f3-bffe-c371907a0d3c","Type":"ContainerStarted","Data":"cd91ab5130ef4515c21e6acbf27fa9d011cecd2d96f3c9c06768634631b1112f"}
Oct 30 22:57:17.995851 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:17.995803    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb" podStartSLOduration=1.99578871 podStartE2EDuration="1.99578871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:57:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:57:17.994164611 +0000 UTC m=+4376.042772308" watchObservedRunningTime="2026-10-30 22:57:17.99578871 +0000 UTC m=+4376.044396405"
Oct 30 22:57:18.073089 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:18.073046    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:18.076061 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:18.076036    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:18.879650 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:18.879610    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:18.880672 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:18.880650    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:20.838245 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:20.838209    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:21.110076 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:21.109972    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:24.163310 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:24.162976    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:24.492911 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:24.492819    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:26.964473 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:26.964443    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"]
Oct 30 22:57:26.969121 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:26.969100    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:57:27.021004 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.020982    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-authcfg-http-8f0848-serving-cert\""
Oct 30 22:57:27.072391 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.072365    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"]
Oct 30 22:57:27.109550 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.109521    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf\" (UID: \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:57:27.109696 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.109562    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-metrics-certs\") pod \"maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf\" (UID: \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:57:27.109762 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.109730    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf\" (UID: \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:57:27.109855 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.109838    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s8mq\" (UniqueName: \"kubernetes.io/projected/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-kube-api-access-8s8mq\") pod \"maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf\" (UID: \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:57:27.211063 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.211030    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf\" (UID: \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:57:27.211211 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.211067    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-metrics-certs\") pod \"maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf\" (UID: \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:57:27.211211 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.211108    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf\" (UID: \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:57:27.211211 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.211137    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s8mq\" (UniqueName: \"kubernetes.io/projected/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-kube-api-access-8s8mq\") pod \"maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf\" (UID: \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:57:27.211856 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.211801    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf\" (UID: \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:57:27.213555 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.213533    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf\" (UID: \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:57:27.213647 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.213588    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-metrics-certs\") pod \"maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf\" (UID: \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:57:27.272517 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.272462    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s8mq\" (UniqueName: \"kubernetes.io/projected/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-kube-api-access-8s8mq\") pod \"maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf\" (UID: \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:57:27.274183 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.274158    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:27.281855 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.281835    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:57:27.526311 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.526223    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:27.655270 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.655238    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"]
Oct 30 22:57:27.658978 ip-10-0-142-154 kubenswrapper[4918]: W1030 22:57:27.658952    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb607a9a2_f9a6_4fa9_81e3_9e1b031a83d9.slice/crio-30e805b0447f24d86386decf3a0d6a01c762d61f498181f115b65f7f1d55fcc1 WatchSource:0}: Error finding container 30e805b0447f24d86386decf3a0d6a01c762d61f498181f115b65f7f1d55fcc1: Status 404 returned error can't find the container with id 30e805b0447f24d86386decf3a0d6a01c762d61f498181f115b65f7f1d55fcc1
Oct 30 22:57:27.927068 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:27.927039    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf" event={"ID":"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9","Type":"ContainerStarted","Data":"30e805b0447f24d86386decf3a0d6a01c762d61f498181f115b65f7f1d55fcc1"}
Oct 30 22:57:28.932529 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:28.932486    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf" event={"ID":"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9","Type":"ContainerStarted","Data":"c29fb630dd76f4ce4aa8c26bc3a1e60d21436c4ad0e4891deb6bdffc9454516a"}
Oct 30 22:57:28.932930 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:28.932634    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:57:29.050468 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:29.050417    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf" podStartSLOduration=2.138061434 podStartE2EDuration="3.050397938s" totalImagesPullingTime="912.336504ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:57:29.049268773 +0000 UTC m=+4387.097876480" watchObservedRunningTime="2026-10-30 22:57:29.050397938 +0000 UTC m=+4387.099005633"
Oct 30 22:57:32.157591 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:57:32.157556    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:57:32.333312 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:32.333271    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:34.943223 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:34.943197    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:57:37.239385 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:37.239348    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:38.460610 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:38.460571    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:42.043850 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:42.043809    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:45.009610 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:45.009567    4918 generic.go:356] "Generic (PLEG): container finished" podID="2acab649-cc4f-43f3-bffe-c371907a0d3c" containerID="ef6de46f40905af2b527e102d01928f835a3a5da525180779db55894d04018ba" exitCode=0
Oct 30 22:57:45.010210 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:45.009640    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb" event={"ID":"2acab649-cc4f-43f3-bffe-c371907a0d3c","Type":"ContainerDied","Data":"ef6de46f40905af2b527e102d01928f835a3a5da525180779db55894d04018ba"}
Oct 30 22:57:45.010210 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:45.010114    4918 scope.go:122] "RemoveContainer" containerID="ef6de46f40905af2b527e102d01928f835a3a5da525180779db55894d04018ba"
Oct 30 22:57:45.011450 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:45.011421    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:57:45.011531 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:45.011499    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:57:45.011572 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:45.011532    4918 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 22:57:45.634781 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:45.634742    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:46.022461 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:46.022426    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb" event={"ID":"2acab649-cc4f-43f3-bffe-c371907a0d3c","Type":"ContainerStarted","Data":"77b3b31fc7fef35c638a9bdb01e06269e8b16230cd36f7edfd106859ad11aafc"}
Oct 30 22:57:46.070538 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:46.070509    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:46.071805 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:46.071778    4918 patch_prober.go:29] interesting pod/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.150:15021/healthz/ready\": dial tcp 10.132.0.150:15021: connect: connection refused" start-of-body=
Oct 30 22:57:46.071930 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:46.071835    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb" podUID="2acab649-cc4f-43f3-bffe-c371907a0d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.150:15021/healthz/ready\": dial tcp 10.132.0.150:15021: connect: connection refused"
Oct 30 22:57:47.071314 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:47.071280    4918 patch_prober.go:29] interesting pod/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.150:15021/healthz/ready\": dial tcp 10.132.0.150:15021: connect: connection refused" start-of-body=
Oct 30 22:57:47.071745 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:47.071334    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb" podUID="2acab649-cc4f-43f3-bffe-c371907a0d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.150:15021/healthz/ready\": dial tcp 10.132.0.150:15021: connect: connection refused"
Oct 30 22:57:47.237926 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:47.237878    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:48.070558 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:48.070529    4918 patch_prober.go:29] interesting pod/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.150:15021/healthz/ready\": dial tcp 10.132.0.150:15021: connect: connection refused" start-of-body=
Oct 30 22:57:48.070753 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:48.070581    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb" podUID="2acab649-cc4f-43f3-bffe-c371907a0d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.150:15021/healthz/ready\": dial tcp 10.132.0.150:15021: connect: connection refused"
Oct 30 22:57:48.880100 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:48.880064    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:49.070941 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:49.070901    4918 patch_prober.go:29] interesting pod/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.150:15021/healthz/ready\": dial tcp 10.132.0.150:15021: connect: connection refused" start-of-body=
Oct 30 22:57:49.071142 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:49.070976    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb" podUID="2acab649-cc4f-43f3-bffe-c371907a0d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.150:15021/healthz/ready\": dial tcp 10.132.0.150:15021: connect: connection refused"
Oct 30 22:57:50.071367 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:50.071332    4918 patch_prober.go:29] interesting pod/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.150:15021/healthz/ready\": dial tcp 10.132.0.150:15021: connect: connection refused" start-of-body=
Oct 30 22:57:50.071795 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:50.071384    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb" podUID="2acab649-cc4f-43f3-bffe-c371907a0d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.150:15021/healthz/ready\": dial tcp 10.132.0.150:15021: connect: connection refused"
Oct 30 22:57:51.071567 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:51.071534    4918 patch_prober.go:29] interesting pod/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.150:15021/healthz/ready\": dial tcp 10.132.0.150:15021: connect: connection refused" start-of-body=
Oct 30 22:57:51.071975 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:51.071580    4918 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb" podUID="2acab649-cc4f-43f3-bffe-c371907a0d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.150:15021/healthz/ready\": dial tcp 10.132.0.150:15021: connect: connection refused"
Oct 30 22:57:52.094617 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:52.094587    4918 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:52.095612 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:52.095596    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:57:52.110598 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:52.110569    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:57:57.038187 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:57:57.038147    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:01.844180 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:58:01.844134    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:02.157475 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:58:02.157434    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:58:05.142526 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:58:05.142491    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:05.394750 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:58:05.394641    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:06.730295 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:58:06.730256    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:11.531722 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:58:11.531670    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:16.433573 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:58:16.433532    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:21.437785 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:58:21.437735    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:26.321506 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:58:26.321464    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:31.112634 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:58:31.112542    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:32.157046 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:58:32.157005    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:58:36.009009 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:58:36.008967    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:38.805575 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:58:38.805538    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:40.811973 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:58:40.811931    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:45.775774 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:58:45.775733    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:50.550196 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:58:50.550164    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:58:55.412944 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:58:55.412909    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:00.323883 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:00.323823    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:02.158796 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:59:02.158752    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:59:05.234245 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:05.234215    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:10.312326 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:10.312285    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:15.215737 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:15.215668    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:16.551222 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:16.551185    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:16.790223 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:16.790185    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:20.012434 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:20.012386    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:22.579332 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:22.579303    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:59:22.607471 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:22.607443    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-8hc58_18b98618-898b-4a48-bb05-51e61ca7fe0a/console-operator/2.log"
Oct 30 22:59:29.142172 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.142137    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"]
Oct 30 22:59:29.142562 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.142359    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf" podUID="b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9" containerName="maas-api" containerID="cri-o://c29fb630dd76f4ce4aa8c26bc3a1e60d21436c4ad0e4891deb6bdffc9454516a" gracePeriod=30
Oct 30 22:59:29.343391 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.343323    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:29.423953 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.423931    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:59:29.468359 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.468332    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-kube-api-access-8s8mq\" (UniqueName: \"kubernetes.io/projected/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-kube-api-access-8s8mq\") pod \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\" (UID: \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\") "
Oct 30 22:59:29.468502 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.468393    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-openshift-service-ca\") pod \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\" (UID: \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\") "
Oct 30 22:59:29.468502 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.468420    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-metrics-certs\") pod \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\" (UID: \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\") "
Oct 30 22:59:29.468502 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.468478    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-maas-api-tls\") pod \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\" (UID: \"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9\") "
Oct 30 22:59:29.468786 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.468765    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-openshift-service-ca" pod "b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9" (UID: "b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:59:29.468887 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.468876    4918 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-openshift-service-ca\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:29.470709 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.470659    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-kube-api-access-8s8mq" pod "b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9" (UID: "b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9"). InnerVolumeSpecName "kube-api-access-8s8mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:59:29.470818 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.470717    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-maas-api-tls" pod "b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9" (UID: "b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:59:29.470818 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.470738    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-metrics-certs" pod "b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9" (UID: "b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:59:29.531657 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.531600    4918 generic.go:356] "Generic (PLEG): container finished" podID="b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9" containerID="c29fb630dd76f4ce4aa8c26bc3a1e60d21436c4ad0e4891deb6bdffc9454516a" exitCode=0
Oct 30 22:59:29.531657 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.531649    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf" event={"ID":"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9","Type":"ContainerDied","Data":"c29fb630dd76f4ce4aa8c26bc3a1e60d21436c4ad0e4891deb6bdffc9454516a"}
Oct 30 22:59:29.531657 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.531658    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"
Oct 30 22:59:29.532013 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.531713    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf" event={"ID":"b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9","Type":"ContainerDied","Data":"30e805b0447f24d86386decf3a0d6a01c762d61f498181f115b65f7f1d55fcc1"}
Oct 30 22:59:29.532013 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.531745    4918 scope.go:122] "RemoveContainer" containerID="c29fb630dd76f4ce4aa8c26bc3a1e60d21436c4ad0e4891deb6bdffc9454516a"
Oct 30 22:59:29.554449 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.554423    4918 scope.go:122] "RemoveContainer" containerID="c29fb630dd76f4ce4aa8c26bc3a1e60d21436c4ad0e4891deb6bdffc9454516a"
Oct 30 22:59:29.554980 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:59:29.554947    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c29fb630dd76f4ce4aa8c26bc3a1e60d21436c4ad0e4891deb6bdffc9454516a\": container with ID starting with c29fb630dd76f4ce4aa8c26bc3a1e60d21436c4ad0e4891deb6bdffc9454516a not found: ID does not exist" containerID="c29fb630dd76f4ce4aa8c26bc3a1e60d21436c4ad0e4891deb6bdffc9454516a"
Oct 30 22:59:29.555087 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.554995    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c29fb630dd76f4ce4aa8c26bc3a1e60d21436c4ad0e4891deb6bdffc9454516a"} err="failed to get container status \"c29fb630dd76f4ce4aa8c26bc3a1e60d21436c4ad0e4891deb6bdffc9454516a\": rpc error: code = NotFound desc = could not find container \"c29fb630dd76f4ce4aa8c26bc3a1e60d21436c4ad0e4891deb6bdffc9454516a\": container with ID starting with c29fb630dd76f4ce4aa8c26bc3a1e60d21436c4ad0e4891deb6bdffc9454516a not found: ID does not exist"
Oct 30 22:59:29.569967 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.569941    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8s8mq\" (UniqueName: \"kubernetes.io/projected/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-kube-api-access-8s8mq\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:29.570072 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.569973    4918 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-metrics-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:29.570072 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.569991    4918 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9-maas-api-tls\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:29.703534 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.703451    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"]
Oct 30 22:59:29.708998 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:29.708972    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-8f0848-5466cbdc94-8jwmf"]
Oct 30 22:59:30.091650 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:30.091569    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9" path="/var/lib/kubelet/pods/b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9/volumes"
Oct 30 22:59:30.855592 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:30.855552    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:31.139557 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:31.139520    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:31.917232 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:31.917181    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:32.157504 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:59:32.157470    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 22:59:38.292804 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:38.292766    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:38.534688 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:38.534643    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"]
Oct 30 22:59:38.534996 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:38.534970    4918 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb" podUID="2acab649-cc4f-43f3-bffe-c371907a0d3c" containerName="istio-proxy" containerID="cri-o://77b3b31fc7fef35c638a9bdb01e06269e8b16230cd36f7edfd106859ad11aafc" gracePeriod=30
Oct 30 22:59:38.607870 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:38.607771    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:38.901981 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:38.901934    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:39.169920 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:39.169814    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 22:59:43.793772 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.793749    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:59:43.917899 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.917871    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-workload-socket\") pod \"2acab649-cc4f-43f3-bffe-c371907a0d3c\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") "
Oct 30 22:59:43.918072 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.917907    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-credential-socket\") pod \"2acab649-cc4f-43f3-bffe-c371907a0d3c\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") "
Oct 30 22:59:43.918072 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.917958    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-token\" (UniqueName: \"kubernetes.io/projected/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-token\") pod \"2acab649-cc4f-43f3-bffe-c371907a0d3c\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") "
Oct 30 22:59:43.918072 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.917984    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2acab649-cc4f-43f3-bffe-c371907a0d3c-kube-api-access-qc4p2\" (UniqueName: \"kubernetes.io/projected/2acab649-cc4f-43f3-bffe-c371907a0d3c-kube-api-access-qc4p2\") pod \"2acab649-cc4f-43f3-bffe-c371907a0d3c\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") "
Oct 30 22:59:43.918072 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.918035    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-podinfo\") pod \"2acab649-cc4f-43f3-bffe-c371907a0d3c\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") "
Oct 30 22:59:43.918306 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.918081    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2acab649-cc4f-43f3-bffe-c371907a0d3c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2acab649-cc4f-43f3-bffe-c371907a0d3c-istiod-ca-cert\") pod \"2acab649-cc4f-43f3-bffe-c371907a0d3c\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") "
Oct 30 22:59:43.918306 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.918099    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-envoy\") pod \"2acab649-cc4f-43f3-bffe-c371907a0d3c\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") "
Oct 30 22:59:43.918306 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.918145    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-data\") pod \"2acab649-cc4f-43f3-bffe-c371907a0d3c\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") "
Oct 30 22:59:43.918306 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.918176    4918 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-workload-certs\") pod \"2acab649-cc4f-43f3-bffe-c371907a0d3c\" (UID: \"2acab649-cc4f-43f3-bffe-c371907a0d3c\") "
Oct 30 22:59:43.918306 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.918178    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-workload-socket" pod "2acab649-cc4f-43f3-bffe-c371907a0d3c" (UID: "2acab649-cc4f-43f3-bffe-c371907a0d3c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:59:43.918306 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.918283    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-credential-socket" pod "2acab649-cc4f-43f3-bffe-c371907a0d3c" (UID: "2acab649-cc4f-43f3-bffe-c371907a0d3c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:59:43.918629 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.918442    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-data" pod "2acab649-cc4f-43f3-bffe-c371907a0d3c" (UID: "2acab649-cc4f-43f3-bffe-c371907a0d3c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:59:43.918629 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.918486    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-workload-certs" pod "2acab649-cc4f-43f3-bffe-c371907a0d3c" (UID: "2acab649-cc4f-43f3-bffe-c371907a0d3c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:59:43.918629 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.918519    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2acab649-cc4f-43f3-bffe-c371907a0d3c-istiod-ca-cert" pod "2acab649-cc4f-43f3-bffe-c371907a0d3c" (UID: "2acab649-cc4f-43f3-bffe-c371907a0d3c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:59:43.918629 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.918610    4918 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2acab649-cc4f-43f3-bffe-c371907a0d3c-istiod-ca-cert\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:43.918629 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.918630    4918 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-data\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:43.919093 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.918643    4918 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-workload-certs\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:43.919093 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.918658    4918 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-workload-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:43.919093 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.918671    4918 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-credential-socket\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:43.920473 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.920437    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-envoy" pod "2acab649-cc4f-43f3-bffe-c371907a0d3c" (UID: "2acab649-cc4f-43f3-bffe-c371907a0d3c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:59:43.920588 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.920520    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2acab649-cc4f-43f3-bffe-c371907a0d3c-kube-api-access-qc4p2" pod "2acab649-cc4f-43f3-bffe-c371907a0d3c" (UID: "2acab649-cc4f-43f3-bffe-c371907a0d3c"). InnerVolumeSpecName "kube-api-access-qc4p2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:59:43.920588 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.920538    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-token" pod "2acab649-cc4f-43f3-bffe-c371907a0d3c" (UID: "2acab649-cc4f-43f3-bffe-c371907a0d3c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:59:43.920588 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:43.920562    4918 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-podinfo" pod "2acab649-cc4f-43f3-bffe-c371907a0d3c" (UID: "2acab649-cc4f-43f3-bffe-c371907a0d3c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:59:44.019408 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:44.019376    4918 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-token\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:44.019408 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:44.019401    4918 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc4p2\" (UniqueName: \"kubernetes.io/projected/2acab649-cc4f-43f3-bffe-c371907a0d3c-kube-api-access-qc4p2\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:44.019408 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:44.019412    4918 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-podinfo\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:44.019661 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:44.019421    4918 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2acab649-cc4f-43f3-bffe-c371907a0d3c-istio-envoy\") on node \"ip-10-0-142-154.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:59:44.601037 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:44.600999    4918 generic.go:356] "Generic (PLEG): container finished" podID="2acab649-cc4f-43f3-bffe-c371907a0d3c" containerID="77b3b31fc7fef35c638a9bdb01e06269e8b16230cd36f7edfd106859ad11aafc" exitCode=0
Oct 30 22:59:44.601229 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:44.601056    4918 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"
Oct 30 22:59:44.601229 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:44.601076    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb" event={"ID":"2acab649-cc4f-43f3-bffe-c371907a0d3c","Type":"ContainerDied","Data":"77b3b31fc7fef35c638a9bdb01e06269e8b16230cd36f7edfd106859ad11aafc"}
Oct 30 22:59:44.601229 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:44.601141    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb" event={"ID":"2acab649-cc4f-43f3-bffe-c371907a0d3c","Type":"ContainerDied","Data":"cd91ab5130ef4515c21e6acbf27fa9d011cecd2d96f3c9c06768634631b1112f"}
Oct 30 22:59:44.601229 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:44.601155    4918 scope.go:122] "RemoveContainer" containerID="77b3b31fc7fef35c638a9bdb01e06269e8b16230cd36f7edfd106859ad11aafc"
Oct 30 22:59:44.610538 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:44.610516    4918 scope.go:122] "RemoveContainer" containerID="ef6de46f40905af2b527e102d01928f835a3a5da525180779db55894d04018ba"
Oct 30 22:59:44.618879 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:44.618830    4918 scope.go:122] "RemoveContainer" containerID="77b3b31fc7fef35c638a9bdb01e06269e8b16230cd36f7edfd106859ad11aafc"
Oct 30 22:59:44.619116 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:59:44.619093    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77b3b31fc7fef35c638a9bdb01e06269e8b16230cd36f7edfd106859ad11aafc\": container with ID starting with 77b3b31fc7fef35c638a9bdb01e06269e8b16230cd36f7edfd106859ad11aafc not found: ID does not exist" containerID="77b3b31fc7fef35c638a9bdb01e06269e8b16230cd36f7edfd106859ad11aafc"
Oct 30 22:59:44.619168 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:44.619125    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77b3b31fc7fef35c638a9bdb01e06269e8b16230cd36f7edfd106859ad11aafc"} err="failed to get container status \"77b3b31fc7fef35c638a9bdb01e06269e8b16230cd36f7edfd106859ad11aafc\": rpc error: code = NotFound desc = could not find container \"77b3b31fc7fef35c638a9bdb01e06269e8b16230cd36f7edfd106859ad11aafc\": container with ID starting with 77b3b31fc7fef35c638a9bdb01e06269e8b16230cd36f7edfd106859ad11aafc not found: ID does not exist"
Oct 30 22:59:44.619168 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:44.619150    4918 scope.go:122] "RemoveContainer" containerID="ef6de46f40905af2b527e102d01928f835a3a5da525180779db55894d04018ba"
Oct 30 22:59:44.619408 ip-10-0-142-154 kubenswrapper[4918]: E1030 22:59:44.619389    4918 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef6de46f40905af2b527e102d01928f835a3a5da525180779db55894d04018ba\": container with ID starting with ef6de46f40905af2b527e102d01928f835a3a5da525180779db55894d04018ba not found: ID does not exist" containerID="ef6de46f40905af2b527e102d01928f835a3a5da525180779db55894d04018ba"
Oct 30 22:59:44.619452 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:44.619417    4918 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef6de46f40905af2b527e102d01928f835a3a5da525180779db55894d04018ba"} err="failed to get container status \"ef6de46f40905af2b527e102d01928f835a3a5da525180779db55894d04018ba\": rpc error: code = NotFound desc = could not find container \"ef6de46f40905af2b527e102d01928f835a3a5da525180779db55894d04018ba\": container with ID starting with ef6de46f40905af2b527e102d01928f835a3a5da525180779db55894d04018ba not found: ID does not exist"
Oct 30 22:59:44.765558 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:44.765531    4918 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"]
Oct 30 22:59:44.815523 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:44.815496    4918 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-authcfg-http-8f0848-openshift-default-f8c8d6fc-zfmwb"]
Oct 30 22:59:46.078013 ip-10-0-142-154 kubenswrapper[4918]: I1030 22:59:46.077945    4918 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2acab649-cc4f-43f3-bffe-c371907a0d3c" path="/var/lib/kubelet/pods/2acab649-cc4f-43f3-bffe-c371907a0d3c/volumes"
Oct 30 23:00:02.157852 ip-10-0-142-154 kubenswrapper[4918]: E1030 23:00:02.157771    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 23:00:06.945551 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:00:06.945509    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:17.129750 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:00:17.129715    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:17.372483 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:00:17.372435    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:25.556708 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:00:25.552773    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-5sbz9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.138:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:00:25.556708 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:00:25.552847    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-5sbz9" podUID="821a7805-3799-4db3-81fb-4b2f9e63bd8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.138:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:00:26.045892 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:00:26.045842    4918 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6cc458d887-ksktz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.139:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 23:00:26.046118 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:00:26.045909    4918 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6cc458d887-ksktz" podUID="50077ca0-3a9d-468c-ac63-cee24e5cabf2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.139:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 23:00:32.157112 ip-10-0-142-154 kubenswrapper[4918]: E1030 23:00:32.157072    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 23:00:39.560670 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:00:39.560637    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:48.530785 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:00:48.530754    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67477bcb55-qcgwz_564fcd76-e252-410f-b88c-db8e1370d2f0/authorino/0.log"
Oct 30 23:00:57.951985 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:00:57.951948    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:58.189450 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:00:58.189415    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 23:00:59.366897 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:00:59.366867    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-bgt9j_f1310003-6f92-423b-9484-63ec209e2167/manager/0.log"
Oct 30 23:01:01.864406 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:01.864377    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-64576576bd-fz2pj_94436381-7870-42af-894e-d4a6d14db855/maas-api/0.log"
Oct 30 23:01:02.157575 ip-10-0-142-154 kubenswrapper[4918]: E1030 23:01:02.157540    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 23:01:03.088613 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:03.088579    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-2k2zm_395bfd29-a743-48e0-9a19-137fefd272e0/postgres/0.log"
Oct 30 23:01:04.604376 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:04.604342    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67477bcb55-qcgwz_564fcd76-e252-410f-b88c-db8e1370d2f0/authorino/0.log"
Oct 30 23:01:07.454366 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:07.454327    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-7z498_4db1d392-2834-4515-84fe-db46cc2c091a/discovery/0.log"
Oct 30 23:01:07.804007 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:07.803917    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54874bdfcc-2zm4n_06c4dd03-7739-4496-90da-00a2abb622d5/kube-auth-proxy/0.log"
Oct 30 23:01:08.259054 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:08.259026    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-5sbz9_821a7805-3799-4db3-81fb-4b2f9e63bd8d/istio-proxy/0.log"
Oct 30 23:01:09.015822 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:09.015787    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-8vv2c_132065c1-06b5-45d6-883c-464cec396f68/istio-proxy/0.log"
Oct 30 23:01:10.043394 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:10.043354    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-ksktz_50077ca0-3a9d-468c-ac63-cee24e5cabf2/istio-proxy/0.log"
Oct 30 23:01:11.418173 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:11.418141    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d865d79dc-z4f64_a4e14574-aa2d-4fc4-ba26-a07f4a669296/router/0.log"
Oct 30 23:01:12.297001 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:12.296970    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb_6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c/main/0.log"
Oct 30 23:01:12.562565 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:12.562480    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-ksqwd_1150673c-da76-4039-a140-830fcd2b5673/main/0.log"
Oct 30 23:01:13.091594 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:13.091565    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-dlqgz_f2f7fac5-efa4-4b44-a61c-a707942ed520/main/0.log"
Oct 30 23:01:13.837813 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:13.837779    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd_028c3206-7879-46be-a78b-5e5b1ad9086f/main/0.log"
Oct 30 23:01:15.027944 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:15.027911    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67477bcb55-qcgwz_564fcd76-e252-410f-b88c-db8e1370d2f0/authorino/0.log"
Oct 30 23:01:24.619854 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:24.619824    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-bgt9j_f1310003-6f92-423b-9484-63ec209e2167/manager/0.log"
Oct 30 23:01:26.589207 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:26.589170    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-64576576bd-fz2pj_94436381-7870-42af-894e-d4a6d14db855/maas-api/0.log"
Oct 30 23:01:27.765423 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:27.765384    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-2k2zm_395bfd29-a743-48e0-9a19-137fefd272e0/postgres/0.log"
Oct 30 23:01:28.949241 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:28.949209    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67477bcb55-qcgwz_564fcd76-e252-410f-b88c-db8e1370d2f0/authorino/0.log"
Oct 30 23:01:31.568414 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:31.568339    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-7z498_4db1d392-2834-4515-84fe-db46cc2c091a/discovery/0.log"
Oct 30 23:01:31.911297 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:31.911260    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54874bdfcc-2zm4n_06c4dd03-7739-4496-90da-00a2abb622d5/kube-auth-proxy/0.log"
Oct 30 23:01:32.156399 ip-10-0-142-154 kubenswrapper[4918]: E1030 23:01:32.156359    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 23:01:32.362254 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:32.362175    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-5sbz9_821a7805-3799-4db3-81fb-4b2f9e63bd8d/istio-proxy/0.log"
Oct 30 23:01:33.140780 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:33.140749    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-8vv2c_132065c1-06b5-45d6-883c-464cec396f68/istio-proxy/0.log"
Oct 30 23:01:34.191956 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:34.191927    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6cc458d887-ksktz_50077ca0-3a9d-468c-ac63-cee24e5cabf2/istio-proxy/0.log"
Oct 30 23:01:35.628507 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:35.628479    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d865d79dc-z4f64_a4e14574-aa2d-4fc4-ba26-a07f4a669296/router/0.log"
Oct 30 23:01:36.269361 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:36.269318    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-c6ndb_6c12ccc3-d1d2-4dbe-a5c6-87023edabc3c/main/0.log"
Oct 30 23:01:36.531729 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:36.531620    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-ksqwd_1150673c-da76-4039-a140-830fcd2b5673/main/0.log"
Oct 30 23:01:37.034493 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:37.034468    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-dlqgz_f2f7fac5-efa4-4b44-a61c-a707942ed520/main/0.log"
Oct 30 23:01:37.746597 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:37.746562    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-d8zpd_028c3206-7879-46be-a78b-5e5b1ad9086f/main/0.log"
Oct 30 23:01:39.871057 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:01:39.871024    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:02.157457 ip-10-0-142-154 kubenswrapper[4918]: E1030 23:02:02.157419    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 23:02:19.608349 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:02:19.608312    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:24.161371 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:02:24.161333    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:24.499981 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:02:24.499872    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:32.156958 ip-10-0-142-154 kubenswrapper[4918]: E1030 23:02:32.156909    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 23:02:40.208529 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:02:40.208487    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:47.558654 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:02:47.558618    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:47.824014 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:02:47.823931    4918 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log" limit=1024
Oct 30 23:02:56.613268 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:02:56.613231    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8c64w_9b06a5cb-5c28-4146-bbea-bfbe2297136c/global-pull-secret-syncer/0.log"
Oct 30 23:02:58.459415 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:02:58.459382    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-chqp7_7e81cfe7-52d2-474c-8261-66ce6cf58945/connection-checker/0.log"
Oct 30 23:02:58.882431 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:02:58.882347    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-sdtr4_e2357ae3-0e6b-427c-84f5-fda3350920c4/connection-checker/0.log"
Oct 30 23:02:59.308042 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:02:59.308007    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-t9r98_aab14d71-ddf4-41c6-80a8-70b258aee1d4/connection-checker/0.log"
Oct 30 23:02:59.779666 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:02:59.779632    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kfvjg_0df7f3e5-6d57-46f7-a23b-fd130d949fe2/konnectivity-agent/0.log"
Oct 30 23:03:01.997604 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:01.997523    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-154.us-west-1.compute.internal_7338dfe0a44a7307924a221163b5ea2d/haproxy/0.log"
Oct 30 23:03:02.157013 ip-10-0-142-154 kubenswrapper[4918]: E1030 23:03:02.156976    4918 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-48xwh" containerName="extractor"
Oct 30 23:03:05.788978 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:05.788937    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67477bcb55-qcgwz_564fcd76-e252-410f-b88c-db8e1370d2f0/authorino/0.log"
Oct 30 23:03:06.664927 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.664890    4918 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"]
Oct 30 23:03:06.665289 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.665277    4918 cpu_manager.go:414] "containerMap: removing container" podUID="b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9" containerName="maas-api"
Oct 30 23:03:06.665343 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.665291    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9" containerName="maas-api"
Oct 30 23:03:06.665343 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.665325    4918 cpu_manager.go:414] "containerMap: removing container" podUID="2acab649-cc4f-43f3-bffe-c371907a0d3c" containerName="istio-proxy"
Oct 30 23:03:06.665343 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.665331    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2acab649-cc4f-43f3-bffe-c371907a0d3c" containerName="istio-proxy"
Oct 30 23:03:06.665343 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.665338    4918 cpu_manager.go:414] "containerMap: removing container" podUID="2acab649-cc4f-43f3-bffe-c371907a0d3c" containerName="istio-proxy"
Oct 30 23:03:06.665343 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.665343    4918 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2acab649-cc4f-43f3-bffe-c371907a0d3c" containerName="istio-proxy"
Oct 30 23:03:06.665503 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.665398    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="2acab649-cc4f-43f3-bffe-c371907a0d3c" containerName="istio-proxy"
Oct 30 23:03:06.665503 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.665407    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="2acab649-cc4f-43f3-bffe-c371907a0d3c" containerName="istio-proxy"
Oct 30 23:03:06.665503 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.665415    4918 memory_manager.go:365] "RemoveStaleState removing state" podUID="b607a9a2-f9a6-4fa9-81e3-9e1b031a83d9" containerName="maas-api"
Oct 30 23:03:06.668519 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.668501    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:06.766479 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.766447    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6-proc\") pod \"perf-node-gather-daemonset-wptzd\" (UID: \"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:06.766661 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.766500    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vctj\" (UniqueName: \"kubernetes.io/projected/d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6-kube-api-access-5vctj\") pod \"perf-node-gather-daemonset-wptzd\" (UID: \"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:06.766661 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.766621    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6-sys\") pod \"perf-node-gather-daemonset-wptzd\" (UID: \"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:06.766788 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.766661    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6-podres\") pod \"perf-node-gather-daemonset-wptzd\" (UID: \"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:06.766788 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.766718    4918 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6-lib-modules\") pod \"perf-node-gather-daemonset-wptzd\" (UID: \"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:06.770302 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.770280    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wz784\"/\"openshift-service-ca.crt\""
Oct 30 23:03:06.770402 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.770308    4918 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wz784\"/\"kube-root-ca.crt\""
Oct 30 23:03:06.770402 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.770308    4918 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wz784\"/\"default-dockercfg-hz9zx\""
Oct 30 23:03:06.772218 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.772201    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"]
Oct 30 23:03:06.867253 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.867211    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6-sys\") pod \"perf-node-gather-daemonset-wptzd\" (UID: \"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:06.867253 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.867261    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6-podres\") pod \"perf-node-gather-daemonset-wptzd\" (UID: \"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:06.867768 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.867294    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6-lib-modules\") pod \"perf-node-gather-daemonset-wptzd\" (UID: \"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:06.867768 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.867327    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6-proc\") pod \"perf-node-gather-daemonset-wptzd\" (UID: \"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:06.867768 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.867340    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6-sys\") pod \"perf-node-gather-daemonset-wptzd\" (UID: \"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:06.867768 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.867361    4918 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vctj\" (UniqueName: \"kubernetes.io/projected/d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6-kube-api-access-5vctj\") pod \"perf-node-gather-daemonset-wptzd\" (UID: \"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:06.867768 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.867408    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6-podres\") pod \"perf-node-gather-daemonset-wptzd\" (UID: \"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:06.867768 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.867417    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6-proc\") pod \"perf-node-gather-daemonset-wptzd\" (UID: \"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:06.867768 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.867443    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6-lib-modules\") pod \"perf-node-gather-daemonset-wptzd\" (UID: \"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:06.928179 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.928110    4918 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vctj\" (UniqueName: \"kubernetes.io/projected/d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6-kube-api-access-5vctj\") pod \"perf-node-gather-daemonset-wptzd\" (UID: \"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6\") " pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:06.981000 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:06.980971    4918 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:07.360600 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:07.360518    4918 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"]
Oct 30 23:03:07.363736 ip-10-0-142-154 kubenswrapper[4918]: W1030 23:03:07.363701    4918 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd2b58b94_6c7a_4afc_bdd4_d391d7e44ba6.slice/crio-d027069e395b67b8ec4b737c9e8e2ac5428975e5f4a84b3d158776e2686884a1 WatchSource:0}: Error finding container d027069e395b67b8ec4b737c9e8e2ac5428975e5f4a84b3d158776e2686884a1: Status 404 returned error can't find the container with id d027069e395b67b8ec4b737c9e8e2ac5428975e5f4a84b3d158776e2686884a1
Oct 30 23:03:07.597660 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:07.597626    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd" event={"ID":"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6","Type":"ContainerStarted","Data":"1d7135ac2afa86057c170876e2af423341c1f81600ab7c237b955dbe92009a3a"}
Oct 30 23:03:07.597841 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:07.597705    4918 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd" event={"ID":"d2b58b94-6c7a-4afc-bdd4-d391d7e44ba6","Type":"ContainerStarted","Data":"d027069e395b67b8ec4b737c9e8e2ac5428975e5f4a84b3d158776e2686884a1"}
Oct 30 23:03:07.597841 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:07.597752    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:07.713639 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:07.713586    4918 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd" podStartSLOduration=1.7135711850000002 podStartE2EDuration="1.713571185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 23:03:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 23:03:07.71197769 +0000 UTC m=+4725.760585385" watchObservedRunningTime="2026-10-30 23:03:07.713571185 +0000 UTC m=+4725.762178925"
Oct 30 23:03:13.612015 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:13.611984    4918 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wz784/perf-node-gather-daemonset-wptzd"
Oct 30 23:03:13.920087 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:13.920057    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-54ntg_b9112244-9e99-4f1d-b2a5-576d56dc0718/cluster-monitoring-operator/0.log"
Oct 30 23:03:16.522020 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:16.521982    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5x747_cf9cafd6-7ee5-44f0-84e6-a0e82c108b58/node-exporter/0.log"
Oct 30 23:03:16.938376 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:16.938350    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5x747_cf9cafd6-7ee5-44f0-84e6-a0e82c108b58/kube-rbac-proxy/0.log"
Oct 30 23:03:17.357639 ip-10-0-142-154 kubenswrapper[4918]: I1030 23:03:17.357571    4918 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5x747_cf9cafd6-7ee5-44f0-84e6-a0e82c108b58/init-textfile/0.log"