Sep 09 14:08:52.071115 ip-10-0-140-6 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 09 14:08:52.071127 ip-10-0-140-6 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 09 14:08:52.071137 ip-10-0-140-6 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 09 14:08:52.071355 ip-10-0-140-6 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 09 14:09:02.313933 ip-10-0-140-6 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 09 14:09:02.313954 ip-10-0-140-6 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 62217a8058fd43f1aac4098429e18e04 --
Sep 09 14:10:35.168443 ip-10-0-140-6 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 14:10:35.585718 ip-10-0-140-6 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 14:10:35.585718 ip-10-0-140-6 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 14:10:35.585718 ip-10-0-140-6 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 14:10:35.585718 ip-10-0-140-6 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 14:10:35.585718 ip-10-0-140-6 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 14:10:35.588232 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.588123    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 14:10:35.593769 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593755    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 14:10:35.593769 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593769    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593773    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593777    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593781    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593784    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593787    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593792    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593796    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593799    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593803    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593807    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593811    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593814    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593817    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593820    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593823    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593826    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593830    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 14:10:35.593832 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593833    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593842    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593845    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593848    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593851    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593854    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593857    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593859    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593862    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593865    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593867    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593870    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593872    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593875    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593877    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593880    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593883    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593885    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593888    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593890    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 14:10:35.594327 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593893    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593895    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593899    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593902    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593904    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593907    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593909    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593912    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593915    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593917    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593920    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593923    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593925    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593928    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593933    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593936    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593939    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593941    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593944    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593947    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 14:10:35.595141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593949    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593952    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593954    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593957    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593961    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593965    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593967    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593970    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593974    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593976    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593979    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593982    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593985    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593988    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593990    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593993    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593996    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.593998    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594001    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594004    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 14:10:35.595744 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594006    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594008    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594012    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594015    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594017    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594020    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594023    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594026    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594029    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594033    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594035    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594038    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594041    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594044    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594047    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594049    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594052    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594055    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594057    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 14:10:35.596257 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.594060    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596458    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596469    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596473    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596476    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596479    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596482    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596486    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596488    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596491    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596494    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596497    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596500    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596503    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596506    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596510    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596515    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596518    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596521    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 14:10:35.596710 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596524    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596526    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596529    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596532    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596535    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596538    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596540    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596543    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596545    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596561    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596565    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596567    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596570    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596573    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596576    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596579    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596582    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596585    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596588    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596590    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 14:10:35.597221 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596594    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596596    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596599    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596602    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596605    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596607    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596611    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596613    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596616    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596618    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596621    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596624    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596626    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596629    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596632    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596635    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596637    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596640    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596643    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596646    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 14:10:35.597702 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596649    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596651    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596655    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596660    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596663    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596666    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596670    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596674    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596677    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596680    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596684    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596687    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596690    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596693    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596696    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596699    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596702    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596704    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596707    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596710    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 14:10:35.598191 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596713    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596716    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596719    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596722    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596725    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596729    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596732    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596735    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596738    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596740    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596743    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596746    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596749    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596756    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596759    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596762    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596764    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596767    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596770    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 14:10:35.598684 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596775    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.596779    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597146    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597151    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597154    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597157    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597160    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597163    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597165    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597183    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597186    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597189    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597192    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597194    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597197    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597200    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597203    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597206    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597209    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597212    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 14:10:35.599141 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597215    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597218    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597220    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597223    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597226    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597229    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597232    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597234    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597237    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597240    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597243    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597245    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597249    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597252    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597255    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597258    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597260    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597263    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597266    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 14:10:35.599645 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597269    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597272    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597275    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597277    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597280    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597282    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597285    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597288    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597290    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597293    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597296    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597298    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597302    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597304    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597307    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597309    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597312    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597314    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597317    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597320    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 14:10:35.600112 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597322    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597325    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597327    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597330    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597332    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597336    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597338    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597341    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597345    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597349    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597353    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597356    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597359    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597362    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597365    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597367    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597370    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597374    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597378    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 14:10:35.600619 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597381    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597383    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597386    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597389    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597392    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597395    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597403    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597406    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597409    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597411    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597415    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597418    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597420    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597423    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597426    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597429    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597433    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597436    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597439    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597442    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 14:10:35.601073 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597445    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597448    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.597451    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597524    2562 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597574    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597581    2562 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597586    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597590    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597594    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597598    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597602    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597605    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597609    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597613    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597616    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597620    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597623    2562 flags.go:64] FLAG: --cgroup-root=""
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597626    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597629    2562 flags.go:64] FLAG: --client-ca-file=""
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597633    2562 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597636    2562 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597641    2562 flags.go:64] FLAG: --cluster-domain=""
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597644    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597647    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 14:10:35.601558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597650    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597653    2562 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597657    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597660    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597663    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597667    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597670    2562 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597673    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597676    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597679    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597682    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597686    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597689    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597692    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597694    2562 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597697    2562 flags.go:64] FLAG: --enable-server="true"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597700    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597704    2562 flags.go:64] FLAG: --event-burst="100"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597708    2562 flags.go:64] FLAG: --event-qps="50"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597711    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597714    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597717    2562 flags.go:64] FLAG: --eviction-hard=""
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597721    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597723    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597726    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 14:10:35.602158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597730    2562 flags.go:64] FLAG: --eviction-soft=""
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597733    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597735    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597739    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597742    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597745    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597748    2562 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597751    2562 flags.go:64] FLAG: --feature-gates=""
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597755    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597758    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597761    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597765    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597768    2562 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597771    2562 flags.go:64] FLAG: --help="false"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597774    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-140-6.ec2.internal"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597778    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597781    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597784    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597787    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597790    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597793    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597796    2562 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597799    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 14:10:35.602773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597802    2562 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597805    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597809    2562 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597812    2562 flags.go:64] FLAG: --kube-reserved=""
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597815    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597818    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597821    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597823    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597826    2562 flags.go:64] FLAG: --lock-file=""
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597829    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597832    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597835    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597841    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597845    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597848    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597851    2562 flags.go:64] FLAG: --logging-format="text"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597854    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597857    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597860    2562 flags.go:64] FLAG: --manifest-url=""
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597863    2562 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597869    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597872    2562 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597877    2562 flags.go:64] FLAG: --max-pods="110"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597880    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597883    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 14:10:35.603382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597886    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597889    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597892    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597895    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597898    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597905    2562 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597909    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597912    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597915    2562 flags.go:64] FLAG: --pod-cidr=""
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597918    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597923    2562 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597926    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597930    2562 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597932    2562 flags.go:64] FLAG: --port="10250"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597936    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597939    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a9648c0367718f27"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597942    2562 flags.go:64] FLAG: --qos-reserved=""
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597946    2562 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597948    2562 flags.go:64] FLAG: --register-node="true"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597953    2562 flags.go:64] FLAG: --register-with-taints=""
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597957    2562 flags.go:64] FLAG: --registry-burst="10"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597961    2562 flags.go:64] FLAG: --registry-qps="5"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597964    2562 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597967    2562 flags.go:64] FLAG: --reserved-memory=""
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597971    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 14:10:35.603984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597974    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597977    2562 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597980    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597984    2562 flags.go:64] FLAG: --runonce="false"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597988    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597991    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597994    2562 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.597998    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598001    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598004    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598007    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598010    2562 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598013    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598016    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598019    2562 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598022    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598025    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598028    2562 flags.go:64] FLAG: --system-cgroups=""
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598031    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598036    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598039    2562 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598042    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598047    2562 flags.go:64] FLAG: --tls-min-version=""
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598050    2562 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598053    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 14:10:35.604604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598056    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598060    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598063    2562 flags.go:64] FLAG: --v="2"
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598067    2562 flags.go:64] FLAG: --version="false"
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598071    2562 flags.go:64] FLAG: --vmodule=""
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598075    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.598079    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598215    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598220    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598223    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598228    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598230    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598233    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598236    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598239    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598243    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598246    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598249    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598252    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598256    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598260    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 14:10:35.605225 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598262    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598266    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598270    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598273    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598276    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598279    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598281    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598284    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598287    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598289    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598292    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598295    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598299    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598301    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598304    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598307    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598311    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598315    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598317    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 14:10:35.606158 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598320    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598323    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598327    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598330    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598333    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598336    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598338    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598341    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598344    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598347    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598349    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598352    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598354    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598357    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598360    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598362    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598365    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598367    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598370    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598373    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 14:10:35.606977 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598375    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598378    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598381    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598383    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598386    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598390    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598392    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598395    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598398    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598400    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598404    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598406    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598409    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598411    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598415    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598418    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598421    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598423    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598426    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 14:10:35.607836 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598429    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598431    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598434    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598437    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598439    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598442    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598444    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598447    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598450    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598453    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598455    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598458    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598461    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598463    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598466    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598468    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598471    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598474    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598478    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 14:10:35.608748 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598480    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 14:10:35.609418 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598483    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 14:10:35.609418 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598486    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 14:10:35.609418 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598488    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 14:10:35.609418 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598491    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 14:10:35.609418 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598494    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 14:10:35.609418 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598497    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 14:10:35.609418 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.598500    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 14:10:35.609418 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.599188    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 14:10:35.609418 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.607540    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 14:10:35.609418 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.607560    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 14:10:35.609418 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.607586    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 14:10:35.609418 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.607594    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 14:10:35.609418 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607683    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 14:10:35.609418 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607691    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 14:10:35.609418 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607696    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607701    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607706    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607710    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607714    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607718    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607723    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607728    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607732    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607737    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607741    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607745    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607750    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607754    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607758    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607763    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607767    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607771    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607776    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607780    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 14:10:35.609790 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607784    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607788    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607792    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607797    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607801    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607805    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607809    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607815    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607820    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607826    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607832    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607836    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607840    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607844    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607849    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607853    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607858    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607863    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607868    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607872    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 14:10:35.610571 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607876    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607881    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607885    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607890    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607894    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607899    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607903    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607907    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607911    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607916    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607920    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607924    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607928    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607932    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607937    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607941    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607946    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607950    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607954    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607959    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 14:10:35.611465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607965    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607972    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607978    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607982    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607987    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607991    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.607996    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608000    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608004    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608008    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608013    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608017    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608021    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608025    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608029    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608033    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608037    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608042    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608046    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608050    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 14:10:35.611957 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608054    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 14:10:35.612603 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608059    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 14:10:35.612603 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608063    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 14:10:35.612603 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608067    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 14:10:35.612603 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608071    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 14:10:35.612603 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608075    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 14:10:35.612603 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608080    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 14:10:35.612603 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608084    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 14:10:35.612603 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608091    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 14:10:35.612603 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608096    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 14:10:35.612603 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608100    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 14:10:35.612603 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608105    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 14:10:35.612603 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608110    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 14:10:35.612603 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608115    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 14:10:35.612603 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608119    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 14:10:35.612603 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608124    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 14:10:35.612603 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608127    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 14:10:35.612995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.608136    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 14:10:35.612995 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608417    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 14:10:35.612995 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608430    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 14:10:35.612995 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608435    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 14:10:35.612995 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608439    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 14:10:35.612995 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608444    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 14:10:35.612995 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608449    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 14:10:35.612995 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608454    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 14:10:35.612995 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608458    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 14:10:35.612995 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608463    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 14:10:35.612995 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608468    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 14:10:35.612995 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608472    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 14:10:35.612995 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608476    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 14:10:35.612995 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608481    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608486    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608490    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608494    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608498    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608503    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608507    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608511    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608516    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608520    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608525    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608529    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608534    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608538    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608543    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608547    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608556    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608560    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608565    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608569    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 14:10:35.613548 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608573    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608579    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608586    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608590    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608595    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608599    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608604    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608609    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608613    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608617    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608622    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608626    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608630    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608635    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608639    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608643    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608647    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608651    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608655    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 14:10:35.614028 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608659    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608663    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608668    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608672    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608676    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608681    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608685    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608690    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608694    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608698    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608710    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608715    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608719    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608723    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608727    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608731    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608735    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608739    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608743    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608747    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 14:10:35.614597 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608751    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608754    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608758    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608762    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608765    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608770    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608774    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608778    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608782    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608789    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608795    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608799    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608803    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608808    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608812    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608816    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608820    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608824    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608829    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 14:10:35.615072 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608833    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 14:10:35.615569 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608837    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 14:10:35.615569 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608843    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 14:10:35.615569 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608850    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 14:10:35.615569 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608862    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 14:10:35.615569 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608866    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 14:10:35.615569 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608871    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 14:10:35.615569 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608875    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 14:10:35.615569 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:35.608879    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 14:10:35.615569 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.608887    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 14:10:35.615569 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.609032    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 14:10:35.615569 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.612194    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 14:10:35.615569 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.613387    2562 server.go:1019] "Starting client certificate rotation"
Sep 09 14:10:35.615569 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.613518    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 14:10:35.615569 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.613577    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 14:10:35.616493 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.616476    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 14:10:35.622901 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.622884    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 14:10:35.634091 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.634070    2562 log.go:25] "Validated CRI v1 runtime API"
Sep 09 14:10:35.637397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.637383    2562 log.go:25] "Validated CRI v1 image API"
Sep 09 14:10:35.638274 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.638259    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 14:10:35.640779 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.640760    2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9fe9aa6a-689f-4a65-b42c-170d52d32485:/dev/nvme0n1p3 fb160a88-cbb7-4b35-a0dd-8797cc87e144:/dev/nvme0n1p4]
Sep 09 14:10:35.640847 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.640779    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 14:10:35.644976 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.644959    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 14:10:35.645835 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.645729    2562 manager.go:216] Machine: {Timestamp:2026-09-09 14:10:35.644329575 +0000 UTC m=+0.370869669 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095610 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bb2b3b1b6262cb5eed36ebb2fecb7 SystemUUID:ec2bb2b3-b1b6-262c-b5ee-d36ebb2fecb7 BootID:62217a80-58fd-43f1-aac4-098429e18e04 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:79:0e:63:e1:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:79:0e:63:e1:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:0c:58:53:70:e7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 14:10:35.645835 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.645830    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 14:10:35.645944 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.645909    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 14:10:35.649414 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.649393    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 14:10:35.649540 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.649418    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-6.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 14:10:35.650977 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.650967    2562 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 14:10:35.651008 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.650980    2562 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 14:10:35.651008 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.650987    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 14:10:35.651827 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.651817    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 14:10:35.653669 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.653659    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 14:10:35.658300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.658289    2562 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 14:10:35.658415 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.658406    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 14:10:35.658452 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.658436    2562 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 14:10:35.658452 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.658445    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 14:10:35.658502 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.658455    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 14:10:35.658502 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.658464    2562 kubelet.go:398] "Adding apiserver pod source"
Sep 09 14:10:35.658502 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.658472    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 14:10:35.658808 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.658794    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 14:10:35.658843 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.658822    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 14:10:35.661140 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.661113    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 14:10:35.664049 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.664033    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 14:10:35.664114 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.664066    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 14:10:35.664250 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.664236    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 14:10:35.664290 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.664255    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 14:10:35.664290 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.664261    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 14:10:35.664290 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.664267    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 14:10:35.664290 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.664274    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 14:10:35.664290 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.664280    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 14:10:35.664872 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.664857    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 14:10:35.664872 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.664868    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 14:10:35.665024 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.664879    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 14:10:35.665024 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.664887    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 14:10:35.665024 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.664898    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 14:10:35.665024 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.664910    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 14:10:35.665024 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.664940    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 14:10:35.665024 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.664948    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 14:10:35.670670 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.670654    2562 server.go:1268] "Started kubelet"
Sep 09 14:10:35.670807 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.670763    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 14:10:35.670807 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.670751    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 14:10:35.670903 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.670839    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 14:10:35.671458 ip-10-0-140-6 systemd[1]: Started Kubernetes Kubelet.
Sep 09 14:10:35.672363 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.672347    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-6.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 14:10:35.672440 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.672370    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 14:10:35.673047 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.673027    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 14:10:35.673092 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.673029    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-6.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 14:10:35.675007 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.674989    2562 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 14:10:35.677483 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.677462    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 14:10:35.679267 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.675808    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-6.ec2.internal.18d3ac671173cc42  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-6.ec2.internal,UID:ip-10-0-140-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-6.ec2.internal,},FirstTimestamp:2026-09-09 14:10:35.670629442 +0000 UTC m=+0.397169535,LastTimestamp:2026-09-09 14:10:35.670629442 +0000 UTC m=+0.397169535,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-6.ec2.internal,}"
Sep 09 14:10:35.679650 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.679635    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 14:10:35.679718 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.679658    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 14:10:35.679780 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.679738    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-6.ec2.internal\" not found"
Sep 09 14:10:35.680500 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.680477    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 14:10:35.680500 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.680502    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 14:10:35.680654 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.680477    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 14:10:35.682088 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.682066    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 14:10:35.682216 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.682125    2562 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 14:10:35.682216 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.682213    2562 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 14:10:35.682216 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.682142    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-6.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 14:10:35.682580 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.682495    2562 factory.go:153] Registering CRI-O factory
Sep 09 14:10:35.682580 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.682528    2562 factory.go:223] Registration of the crio container factory successfully
Sep 09 14:10:35.682580 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.682574    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 14:10:35.682580 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.682580    2562 factory.go:55] Registering systemd factory
Sep 09 14:10:35.682751 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.682586    2562 factory.go:223] Registration of the systemd container factory successfully
Sep 09 14:10:35.682751 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.682602    2562 factory.go:103] Registering Raw factory
Sep 09 14:10:35.682751 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.682612    2562 manager.go:1196] Started watching for new ooms in manager
Sep 09 14:10:35.682975 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.682960    2562 manager.go:349] Starting recovery of all containers
Sep 09 14:10:35.687606 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.687584    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jxb2q"
Sep 09 14:10:35.690683 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.690664    2562 manager.go:354] Recovery completed
Sep 09 14:10:35.694473 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.694367    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 14:10:35.695137 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.695122    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jxb2q"
Sep 09 14:10:35.696373 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.696357    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 14:10:35.696449 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.696388    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 14:10:35.696449 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.696403    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasSufficientPID"
Sep 09 14:10:35.696892 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.696876    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 14:10:35.696892 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.696890    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 14:10:35.697007 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.696906    2562 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 14:10:35.697007 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.696891    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 14:10:35.699462 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.699441    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 14:10:35.699559 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.699482    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 14:10:35.699559 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.699500    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasSufficientPID"
Sep 09 14:10:35.699559 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.699469    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-6.ec2.internal.18d3ac6712fc9b44  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-6.ec2.internal,UID:ip-10-0-140-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-6.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-6.ec2.internal,},FirstTimestamp:2026-09-09 14:10:35.696372548 +0000 UTC m=+0.422912641,LastTimestamp:2026-09-09 14:10:35.696372548 +0000 UTC m=+0.422912641,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-6.ec2.internal,}"
Sep 09 14:10:35.703519 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.703502    2562 policy_none.go:49] "None policy: Start"
Sep 09 14:10:35.703606 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.703521    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 14:10:35.703606 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.703534    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 14:10:35.707432 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.707418    2562 policy_none.go:47] "Start"
Sep 09 14:10:35.734785 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.734767    2562 manager.go:337] "Starting Device Plugin manager"
Sep 09 14:10:35.734874 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.734812    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 14:10:35.734874 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.734826    2562 server.go:87] "Starting device plugin registration server"
Sep 09 14:10:35.735274 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.735257    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 14:10:35.735360 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.735272    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 14:10:35.735427 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.735358    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 14:10:35.735478 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.735427    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 14:10:35.735478 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.735435    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 14:10:35.736751 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.736536    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 14:10:35.736751 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.736583    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-6.ec2.internal\" not found"
Sep 09 14:10:35.791678 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.791652    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 14:10:35.793502 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.793059    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 14:10:35.793502 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.793132    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 14:10:35.793502 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.793159    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 14:10:35.793502 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.793277    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 14:10:35.795644 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.795626    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 14:10:35.835402 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.835381    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 14:10:35.836378 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.836305    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 14:10:35.836378 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.836338    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 14:10:35.836378 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.836352    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasSufficientPID"
Sep 09 14:10:35.836378 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.836379    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-6.ec2.internal"
Sep 09 14:10:35.845358 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.845343    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-6.ec2.internal"
Sep 09 14:10:35.845435 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.845364    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-6.ec2.internal\": node \"ip-10-0-140-6.ec2.internal\" not found"
Sep 09 14:10:35.867501 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.867484    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-6.ec2.internal\" not found"
Sep 09 14:10:35.894312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.894285    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-6.ec2.internal"]
Sep 09 14:10:35.894368 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.894350    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 14:10:35.895581 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.895567    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 14:10:35.895637 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.895590    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 14:10:35.895637 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.895600    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasSufficientPID"
Sep 09 14:10:35.897801 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.897788    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 14:10:35.897919 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.897905    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal"
Sep 09 14:10:35.897964 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.897932    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 14:10:35.898469 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.898454    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 14:10:35.898469 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.898463    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 14:10:35.898616 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.898481    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 14:10:35.898616 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.898485    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 14:10:35.898616 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.898494    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasSufficientPID"
Sep 09 14:10:35.898616 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.898499    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasSufficientPID"
Sep 09 14:10:35.900660 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.900645    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-6.ec2.internal"
Sep 09 14:10:35.900742 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.900674    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 14:10:35.901347 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.901329    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 14:10:35.901427 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.901353    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 14:10:35.901427 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.901363    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeHasSufficientPID"
Sep 09 14:10:35.925708 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.925683    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-6.ec2.internal\" not found" node="ip-10-0-140-6.ec2.internal"
Sep 09 14:10:35.929841 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.929824    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-6.ec2.internal\" not found" node="ip-10-0-140-6.ec2.internal"
Sep 09 14:10:35.968246 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:35.968226    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-6.ec2.internal\" not found"
Sep 09 14:10:35.983437 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.983416    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9978dbafece0809c5d3fcebbfbd299df-config\") pod \"kube-apiserver-proxy-ip-10-0-140-6.ec2.internal\" (UID: \"9978dbafece0809c5d3fcebbfbd299df\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-6.ec2.internal"
Sep 09 14:10:35.983487 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.983442    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c5ba6b115b3eda95142a79a44b2a692-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal\" (UID: \"2c5ba6b115b3eda95142a79a44b2a692\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal"
Sep 09 14:10:35.983487 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:35.983464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c5ba6b115b3eda95142a79a44b2a692-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal\" (UID: \"2c5ba6b115b3eda95142a79a44b2a692\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal"
Sep 09 14:10:36.068602 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:36.068565    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-6.ec2.internal\" not found"
Sep 09 14:10:36.083904 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.083885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c5ba6b115b3eda95142a79a44b2a692-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal\" (UID: \"2c5ba6b115b3eda95142a79a44b2a692\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal"
Sep 09 14:10:36.083962 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.083907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c5ba6b115b3eda95142a79a44b2a692-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal\" (UID: \"2c5ba6b115b3eda95142a79a44b2a692\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal"
Sep 09 14:10:36.083962 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.083923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9978dbafece0809c5d3fcebbfbd299df-config\") pod \"kube-apiserver-proxy-ip-10-0-140-6.ec2.internal\" (UID: \"9978dbafece0809c5d3fcebbfbd299df\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-6.ec2.internal"
Sep 09 14:10:36.083962 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.083949    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9978dbafece0809c5d3fcebbfbd299df-config\") pod \"kube-apiserver-proxy-ip-10-0-140-6.ec2.internal\" (UID: \"9978dbafece0809c5d3fcebbfbd299df\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-6.ec2.internal"
Sep 09 14:10:36.084051 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.083973    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2c5ba6b115b3eda95142a79a44b2a692-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal\" (UID: \"2c5ba6b115b3eda95142a79a44b2a692\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal"
Sep 09 14:10:36.084051 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.083982    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c5ba6b115b3eda95142a79a44b2a692-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal\" (UID: \"2c5ba6b115b3eda95142a79a44b2a692\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal"
Sep 09 14:10:36.169391 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:36.169310    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-6.ec2.internal\" not found"
Sep 09 14:10:36.227854 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.227826    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal"
Sep 09 14:10:36.232855 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.232839    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-6.ec2.internal"
Sep 09 14:10:36.269429 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:36.269380    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-6.ec2.internal\" not found"
Sep 09 14:10:36.369911 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:36.369877    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-6.ec2.internal\" not found"
Sep 09 14:10:36.470527 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:36.470456    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-6.ec2.internal\" not found"
Sep 09 14:10:36.570809 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:36.570782    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-6.ec2.internal\" not found"
Sep 09 14:10:36.570888 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.570838    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 14:10:36.614513 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.614491    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 14:10:36.614860 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.614628    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 14:10:36.614860 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.614663    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 14:10:36.671467 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:36.671443    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-6.ec2.internal\" not found"
Sep 09 14:10:36.698532 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.698502    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 14:05:35 +0000 UTC" deadline="2028-04-19 16:09:05.87460856 +0000 UTC"
Sep 09 14:10:36.698584 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.698530    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14113h58m29.176081596s"
Sep 09 14:10:36.772246 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:36.772161    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-6.ec2.internal\" not found"
Sep 09 14:10:36.873334 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:36.873306    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-6.ec2.internal\" not found"
Sep 09 14:10:36.914198 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.914173    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 14:10:36.960182 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.960141    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 14:10:36.978669 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:36.978637    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9978dbafece0809c5d3fcebbfbd299df.slice/crio-1e34ea6b230092269bc88361744f6a2b6c9ef89b472fb089106ef8815243db16 WatchSource:0}: Error finding container 1e34ea6b230092269bc88361744f6a2b6c9ef89b472fb089106ef8815243db16: Status 404 returned error can't find the container with id 1e34ea6b230092269bc88361744f6a2b6c9ef89b472fb089106ef8815243db16
Sep 09 14:10:36.980545 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.980521    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal"
Sep 09 14:10:36.980938 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:36.980916    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c5ba6b115b3eda95142a79a44b2a692.slice/crio-3a2f2a2486a0fa368d2f116587ade56db527a3a9f01cc59b9d4df99914e86cb8 WatchSource:0}: Error finding container 3a2f2a2486a0fa368d2f116587ade56db527a3a9f01cc59b9d4df99914e86cb8: Status 404 returned error can't find the container with id 3a2f2a2486a0fa368d2f116587ade56db527a3a9f01cc59b9d4df99914e86cb8
Sep 09 14:10:36.983962 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.983945    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 14:10:36.993478 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.993451    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 14:10:36.994359 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:36.994344    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-6.ec2.internal"
Sep 09 14:10:37.003513 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.003497    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 14:10:37.660363 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.660328    2562 apiserver.go:52] "Watching apiserver"
Sep 09 14:10:37.667465 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.667421    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 14:10:37.667994 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.667950    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-z5qjf","openshift-ovn-kubernetes/ovnkube-node-pgbdd","kube-system/konnectivity-agent-jjjx6","kube-system/kube-apiserver-proxy-ip-10-0-140-6.ec2.internal","openshift-cluster-node-tuning-operator/tuned-dbf8x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal","openshift-multus/multus-additional-cni-plugins-kr62x","openshift-multus/multus-h9phn","openshift-multus/network-metrics-daemon-kmvpw","openshift-network-diagnostics/network-check-target-w8qtc","kube-system/global-pull-secret-syncer-klmjq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct","openshift-dns/node-resolver-qb5mh","openshift-image-registry/node-ca-f26x4"]
Sep 09 14:10:37.670726 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.670704    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:37.670841 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:37.670819    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:10:37.673085 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.673064    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qb5mh"
Sep 09 14:10:37.676032 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.675334    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 14:10:37.676032 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.675411    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7spm4\""
Sep 09 14:10:37.676032 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.675334    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 14:10:37.676268 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.676110    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jjjx6"
Sep 09 14:10:37.678305 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.678153    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2lbkx\""
Sep 09 14:10:37.678781 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.678754    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 14:10:37.679135 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.679117    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 14:10:37.681799 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.679992    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f26x4"
Sep 09 14:10:37.681799 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.680582    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 14:10:37.681975 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.681950    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 14:10:37.682527 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.682207    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 14:10:37.683784 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.683070    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 14:10:37.683784 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.683313    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dbfvh\""
Sep 09 14:10:37.683784 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.683332    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.685651 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.685629    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 14:10:37.685953 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.685931    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 14:10:37.686222 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.686202    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5shc7\""
Sep 09 14:10:37.686445 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.686426    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.688538 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.688450    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:37.688538 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.688531    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-296hk\""
Sep 09 14:10:37.688666 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:37.688534    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:10:37.688894 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.688875    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 14:10:37.689000 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.688984    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 14:10:37.689124 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.689106    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 14:10:37.689189 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.689160    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 14:10:37.690756 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.690732    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 14:10:37.691149 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691132    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.691496 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691476    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-sysctl-conf\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.691584 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-sys\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.691584 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691534    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-host\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.691584 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-tmp\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.691750 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691619    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6755t\" (UniqueName: \"kubernetes.io/projected/ff4bddfd-4a5d-48a4-a767-3a2a114b2a73-kube-api-access-6755t\") pod \"node-resolver-qb5mh\" (UID: \"ff4bddfd-4a5d-48a4-a767-3a2a114b2a73\") " pod="openshift-dns/node-resolver-qb5mh"
Sep 09 14:10:37.691750 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691671    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c3ec5b7-c4fb-40cb-9d26-06234099fb6b-agent-certs\") pod \"konnectivity-agent-jjjx6\" (UID: \"2c3ec5b7-c4fb-40cb-9d26-06234099fb6b\") " pod="kube-system/konnectivity-agent-jjjx6"
Sep 09 14:10:37.691750 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxj78\" (UniqueName: \"kubernetes.io/projected/e92fae6c-046f-4d03-86a4-76c97d721a66-kube-api-access-kxj78\") pod \"node-ca-f26x4\" (UID: \"e92fae6c-046f-4d03-86a4-76c97d721a66\") " pod="openshift-image-registry/node-ca-f26x4"
Sep 09 14:10:37.691910 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691752    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-kubernetes\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.691910 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691770    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-systemd\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.691910 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691786    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-lib-modules\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.691910 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691831    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff4bddfd-4a5d-48a4-a767-3a2a114b2a73-tmp-dir\") pod \"node-resolver-qb5mh\" (UID: \"ff4bddfd-4a5d-48a4-a767-3a2a114b2a73\") " pod="openshift-dns/node-resolver-qb5mh"
Sep 09 14:10:37.691910 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691863    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e92fae6c-046f-4d03-86a4-76c97d721a66-host\") pod \"node-ca-f26x4\" (UID: \"e92fae6c-046f-4d03-86a4-76c97d721a66\") " pod="openshift-image-registry/node-ca-f26x4"
Sep 09 14:10:37.691910 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-sysconfig\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.691910 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691908    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-run\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.692300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff4bddfd-4a5d-48a4-a767-3a2a114b2a73-hosts-file\") pod \"node-resolver-qb5mh\" (UID: \"ff4bddfd-4a5d-48a4-a767-3a2a114b2a73\") " pod="openshift-dns/node-resolver-qb5mh"
Sep 09 14:10:37.692300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e92fae6c-046f-4d03-86a4-76c97d721a66-serviceca\") pod \"node-ca-f26x4\" (UID: \"e92fae6c-046f-4d03-86a4-76c97d721a66\") " pod="openshift-image-registry/node-ca-f26x4"
Sep 09 14:10:37.692300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.691984    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-sysctl-d\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.692300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.692025    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-var-lib-kubelet\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.692300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.692051    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-tuned\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.692300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.692069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lglh\" (UniqueName: \"kubernetes.io/projected/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-kube-api-access-5lglh\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.692300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.692086    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fksr\" (UniqueName: \"kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr\") pod \"network-check-target-w8qtc\" (UID: \"e1389f29-7368-4523-a1a8-0f7a0f62cba7\") " pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:37.692300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.692114    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c3ec5b7-c4fb-40cb-9d26-06234099fb6b-konnectivity-ca\") pod \"konnectivity-agent-jjjx6\" (UID: \"2c3ec5b7-c4fb-40cb-9d26-06234099fb6b\") " pod="kube-system/konnectivity-agent-jjjx6"
Sep 09 14:10:37.692300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.692149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-modprobe-d\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.693563 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.693543    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r59z9\""
Sep 09 14:10:37.693563 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.693555    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 14:10:37.693823 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.693806    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 14:10:37.694833 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.694069    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.696061 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.696038    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 14:10:37.696758 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.696550    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h4k89\""
Sep 09 14:10:37.696758 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.696721    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 14:10:37.696924 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.696816    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 14:10:37.696924 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.696909    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 14:10:37.697055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.697030    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 14:10:37.697166 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.697034    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 14:10:37.697294 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.697215    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z5qjf"
Sep 09 14:10:37.699253 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.699233    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 14:10:37.699353 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.699278    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z9f9m\""
Sep 09 14:10:37.699475 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.699457    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 14:10:37.699550 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.699533    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 14:10:37.699735 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.699718    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:37.699801 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:37.699773    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:10:37.702397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.702373    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.704496 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.704474    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 14:10:37.704590 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.704571    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 14:10:37.704872 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.704839    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 14:10:37.705075 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.705056    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fwm9w\""
Sep 09 14:10:37.716402 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.716381    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2jtf4"
Sep 09 14:10:37.726160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.726140    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2jtf4"
Sep 09 14:10:37.781781 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.781702    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 14:10:37.792356 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-run-netns\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.792501 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-etc-openvswitch\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.792501 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792392    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb8s6\" (UniqueName: \"kubernetes.io/projected/cf776f06-89ba-48fe-ac7e-0379007e2bbf-kube-api-access-tb8s6\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.792501 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792419    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-run-multus-certs\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.792501 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792460    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-var-lib-kubelet\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.792501 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-tuned\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.792774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lglh\" (UniqueName: \"kubernetes.io/projected/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-kube-api-access-5lglh\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.792774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-systemd-units\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.792774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-var-lib-cni-bin\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.792774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792565    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-var-lib-kubelet\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.792774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792583    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-var-lib-kubelet\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.792774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntv59\" (UniqueName: \"kubernetes.io/projected/bba35853-8627-4c40-9fb6-6b927c715b3c-kube-api-access-ntv59\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.792774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792654    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-run-openvswitch\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.792774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-run-ovn-kubernetes\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.792774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79fb5cad-d334-40d6-badc-180d6b13f9da-ovnkube-config\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.792774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-modprobe-d\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.792774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792766    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-host\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6755t\" (UniqueName: \"kubernetes.io/projected/ff4bddfd-4a5d-48a4-a767-3a2a114b2a73-kube-api-access-6755t\") pod \"node-resolver-qb5mh\" (UID: \"ff4bddfd-4a5d-48a4-a767-3a2a114b2a73\") " pod="openshift-dns/node-resolver-qb5mh"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792819    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-var-lib-openvswitch\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792845    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c3ec5b7-c4fb-40cb-9d26-06234099fb6b-agent-certs\") pod \"konnectivity-agent-jjjx6\" (UID: \"2c3ec5b7-c4fb-40cb-9d26-06234099fb6b\") " pod="kube-system/konnectivity-agent-jjjx6"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-lib-modules\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792894    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79fb5cad-d334-40d6-badc-180d6b13f9da-env-overrides\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-registration-dir\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792942    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-hostroot\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792969    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79fb5cad-d334-40d6-badc-180d6b13f9da-ovnkube-script-lib\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.792994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-sys-fs\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793026    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-multus-cni-dir\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793051    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e92fae6c-046f-4d03-86a4-76c97d721a66-serviceca\") pod \"node-ca-f26x4\" (UID: \"e92fae6c-046f-4d03-86a4-76c97d721a66\") " pod="openshift-image-registry/node-ca-f26x4"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793077    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-sysctl-d\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793107    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-log-socket\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-cni-netd\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-run-k8s-cni-cncf-io\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793181    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1c849d7-1e16-4ef7-84e0-9e4236a59980-kubelet-config\") pod \"global-pull-secret-syncer-klmjq\" (UID: \"b1c849d7-1e16-4ef7-84e0-9e4236a59980\") " pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:37.793410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793206    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret\") pod \"global-pull-secret-syncer-klmjq\" (UID: \"b1c849d7-1e16-4ef7-84e0-9e4236a59980\") " pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793257    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793294    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-device-dir\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793330    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-system-cni-dir\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bba35853-8627-4c40-9fb6-6b927c715b3c-cni-binary-copy\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793427    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxj78\" (UniqueName: \"kubernetes.io/projected/e92fae6c-046f-4d03-86a4-76c97d721a66-kube-api-access-kxj78\") pod \"node-ca-f26x4\" (UID: \"e92fae6c-046f-4d03-86a4-76c97d721a66\") " pod="openshift-image-registry/node-ca-f26x4"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-kubernetes\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0030a1f3-11e1-4418-b9ce-0733cc4b2812-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e92fae6c-046f-4d03-86a4-76c97d721a66-host\") pod \"node-ca-f26x4\" (UID: \"e92fae6c-046f-4d03-86a4-76c97d721a66\") " pod="openshift-image-registry/node-ca-f26x4"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793543    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-run\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793565    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff4bddfd-4a5d-48a4-a767-3a2a114b2a73-hosts-file\") pod \"node-resolver-qb5mh\" (UID: \"ff4bddfd-4a5d-48a4-a767-3a2a114b2a73\") " pod="openshift-dns/node-resolver-qb5mh"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793561    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793584    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfm22\" (UniqueName: \"kubernetes.io/projected/79fb5cad-d334-40d6-badc-180d6b13f9da-kube-api-access-kfm22\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793613    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-etc-kubernetes\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793630    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-cni-bin\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793646    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbnfm\" (UniqueName: \"kubernetes.io/projected/ee320b68-0a74-4767-8231-84b874c3760c-kube-api-access-mbnfm\") pod \"iptables-alerter-z5qjf\" (UID: \"ee320b68-0a74-4767-8231-84b874c3760c\") " pod="openshift-network-operator/iptables-alerter-z5qjf"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fksr\" (UniqueName: \"kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr\") pod \"network-check-target-w8qtc\" (UID: \"e1389f29-7368-4523-a1a8-0f7a0f62cba7\") " pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:37.794312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793681    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0030a1f3-11e1-4418-b9ce-0733cc4b2812-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-kubelet\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793714    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-run-ovn\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793730    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1c849d7-1e16-4ef7-84e0-9e4236a59980-dbus\") pod \"global-pull-secret-syncer-klmjq\" (UID: \"b1c849d7-1e16-4ef7-84e0-9e4236a59980\") " pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793745    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-multus-socket-dir-parent\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793762    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793778    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee320b68-0a74-4767-8231-84b874c3760c-host-slash\") pod \"iptables-alerter-z5qjf\" (UID: \"ee320b68-0a74-4767-8231-84b874c3760c\") " pod="openshift-network-operator/iptables-alerter-z5qjf"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793794    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-sysctl-conf\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vn6z\" (UniqueName: \"kubernetes.io/projected/0030a1f3-11e1-4418-b9ce-0733cc4b2812-kube-api-access-5vn6z\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-slash\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-run-netns\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793855    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e92fae6c-046f-4d03-86a4-76c97d721a66-serviceca\") pod \"node-ca-f26x4\" (UID: \"e92fae6c-046f-4d03-86a4-76c97d721a66\") " pod="openshift-image-registry/node-ca-f26x4"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793859    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs\") pod \"network-metrics-daemon-kmvpw\" (UID: \"686c69bf-f095-4d1a-b378-11e19b6f9e8d\") " pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793931    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-systemd\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff4bddfd-4a5d-48a4-a767-3a2a114b2a73-tmp-dir\") pod \"node-resolver-qb5mh\" (UID: \"ff4bddfd-4a5d-48a4-a767-3a2a114b2a73\") " pod="openshift-dns/node-resolver-qb5mh"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793986    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-modprobe-d\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.793992    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0030a1f3-11e1-4418-b9ce-0733cc4b2812-system-cni-dir\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.795179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794027    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0030a1f3-11e1-4418-b9ce-0733cc4b2812-cni-binary-copy\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-run-systemd\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794082    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79fb5cad-d334-40d6-badc-180d6b13f9da-ovn-node-metrics-cert\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794109    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794137    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bba35853-8627-4c40-9fb6-6b927c715b3c-multus-daemon-config\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-sysconfig\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794196    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0030a1f3-11e1-4418-b9ce-0733cc4b2812-cnibin\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794226    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0030a1f3-11e1-4418-b9ce-0733cc4b2812-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794278    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-socket-dir\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794306    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-cnibin\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794332    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-var-lib-cni-multus\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794359    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-multus-conf-dir\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794394    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c3ec5b7-c4fb-40cb-9d26-06234099fb6b-konnectivity-ca\") pod \"konnectivity-agent-jjjx6\" (UID: \"2c3ec5b7-c4fb-40cb-9d26-06234099fb6b\") " pod="kube-system/konnectivity-agent-jjjx6"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794423    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-sys\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-tmp\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794477    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-node-log\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794504    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee320b68-0a74-4767-8231-84b874c3760c-iptables-alerter-script\") pod \"iptables-alerter-z5qjf\" (UID: \"ee320b68-0a74-4767-8231-84b874c3760c\") " pod="openshift-network-operator/iptables-alerter-z5qjf"
Sep 09 14:10:37.796053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794534    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6shm\" (UniqueName: \"kubernetes.io/projected/686c69bf-f095-4d1a-b378-11e19b6f9e8d-kube-api-access-t6shm\") pod \"network-metrics-daemon-kmvpw\" (UID: \"686c69bf-f095-4d1a-b378-11e19b6f9e8d\") " pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:37.796995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794692    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-sysctl-d\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.796995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.794806    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-systemd\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.796995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.795107    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff4bddfd-4a5d-48a4-a767-3a2a114b2a73-tmp-dir\") pod \"node-resolver-qb5mh\" (UID: \"ff4bddfd-4a5d-48a4-a767-3a2a114b2a73\") " pod="openshift-dns/node-resolver-qb5mh"
Sep 09 14:10:37.796995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.795195    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-host\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.796995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.795317    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-sysconfig\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.796995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.795879    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c3ec5b7-c4fb-40cb-9d26-06234099fb6b-konnectivity-ca\") pod \"konnectivity-agent-jjjx6\" (UID: \"2c3ec5b7-c4fb-40cb-9d26-06234099fb6b\") " pod="kube-system/konnectivity-agent-jjjx6"
Sep 09 14:10:37.796995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.795951    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-sys\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.796995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.796591    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-lib-modules\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.796995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.796927    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-kubernetes\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.796995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.796991    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e92fae6c-046f-4d03-86a4-76c97d721a66-host\") pod \"node-ca-f26x4\" (UID: \"e92fae6c-046f-4d03-86a4-76c97d721a66\") " pod="openshift-image-registry/node-ca-f26x4"
Sep 09 14:10:37.797534 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.797043    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-run\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.797534 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.797097    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff4bddfd-4a5d-48a4-a767-3a2a114b2a73-hosts-file\") pod \"node-resolver-qb5mh\" (UID: \"ff4bddfd-4a5d-48a4-a767-3a2a114b2a73\") " pod="openshift-dns/node-resolver-qb5mh"
Sep 09 14:10:37.797534 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.797284    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-sysctl-conf\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.798845 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.798814    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c3ec5b7-c4fb-40cb-9d26-06234099fb6b-agent-certs\") pod \"konnectivity-agent-jjjx6\" (UID: \"2c3ec5b7-c4fb-40cb-9d26-06234099fb6b\") " pod="kube-system/konnectivity-agent-jjjx6"
Sep 09 14:10:37.800466 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.800422    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-etc-tuned\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.800953 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.800925    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-tmp\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.803427 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.803357    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-6.ec2.internal" event={"ID":"9978dbafece0809c5d3fcebbfbd299df","Type":"ContainerStarted","Data":"1e34ea6b230092269bc88361744f6a2b6c9ef89b472fb089106ef8815243db16"}
Sep 09 14:10:37.803557 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:37.803537    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 14:10:37.803635 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:37.803564    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 14:10:37.803635 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:37.803579    2562 projected.go:196] Error preparing data for projected volume kube-api-access-2fksr for pod openshift-network-diagnostics/network-check-target-w8qtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:37.803748 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:37.803668    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr podName:e1389f29-7368-4523-a1a8-0f7a0f62cba7 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:38.303631022 +0000 UTC m=+3.030171119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2fksr" (UniqueName: "kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr") pod "network-check-target-w8qtc" (UID: "e1389f29-7368-4523-a1a8-0f7a0f62cba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:37.805343 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.805320    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6755t\" (UniqueName: \"kubernetes.io/projected/ff4bddfd-4a5d-48a4-a767-3a2a114b2a73-kube-api-access-6755t\") pod \"node-resolver-qb5mh\" (UID: \"ff4bddfd-4a5d-48a4-a767-3a2a114b2a73\") " pod="openshift-dns/node-resolver-qb5mh"
Sep 09 14:10:37.806430 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.806406    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lglh\" (UniqueName: \"kubernetes.io/projected/e33a74a7-825e-4fb9-9116-1a399a9f9b5a-kube-api-access-5lglh\") pod \"tuned-dbf8x\" (UID: \"e33a74a7-825e-4fb9-9116-1a399a9f9b5a\") " pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:37.806516 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.806473    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal" event={"ID":"2c5ba6b115b3eda95142a79a44b2a692","Type":"ContainerStarted","Data":"3a2f2a2486a0fa368d2f116587ade56db527a3a9f01cc59b9d4df99914e86cb8"}
Sep 09 14:10:37.806915 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.806890    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxj78\" (UniqueName: \"kubernetes.io/projected/e92fae6c-046f-4d03-86a4-76c97d721a66-kube-api-access-kxj78\") pod \"node-ca-f26x4\" (UID: \"e92fae6c-046f-4d03-86a4-76c97d721a66\") " pod="openshift-image-registry/node-ca-f26x4"
Sep 09 14:10:37.895832 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.895791    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-var-lib-cni-bin\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.896035 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.895839    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-var-lib-kubelet\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.896035 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.895897    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-var-lib-kubelet\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.896035 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.895906    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-var-lib-cni-bin\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.896035 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.895933    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntv59\" (UniqueName: \"kubernetes.io/projected/bba35853-8627-4c40-9fb6-6b927c715b3c-kube-api-access-ntv59\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.896035 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.895969    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-run-openvswitch\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.896035 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.895992    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-run-ovn-kubernetes\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.896035 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896025    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79fb5cad-d334-40d6-badc-180d6b13f9da-ovnkube-config\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.896435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896052    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-var-lib-openvswitch\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.896435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896078    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79fb5cad-d334-40d6-badc-180d6b13f9da-env-overrides\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.896435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896104    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-registration-dir\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.896435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896128    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-hostroot\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.896435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79fb5cad-d334-40d6-badc-180d6b13f9da-ovnkube-script-lib\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.896435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-sys-fs\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.896435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896221    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-var-lib-openvswitch\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.896435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-multus-cni-dir\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.896435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-log-socket\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.896435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-cni-netd\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.896435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896317    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-multus-cni-dir\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.896435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896374    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-run-openvswitch\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.896435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896428    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-run-ovn-kubernetes\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896510    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-hostroot\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896556    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-log-socket\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896564    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-registration-dir\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896593    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-cni-netd\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896642    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-run-k8s-cni-cncf-io\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896652    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-sys-fs\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1c849d7-1e16-4ef7-84e0-9e4236a59980-kubelet-config\") pod \"global-pull-secret-syncer-klmjq\" (UID: \"b1c849d7-1e16-4ef7-84e0-9e4236a59980\") " pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret\") pod \"global-pull-secret-syncer-klmjq\" (UID: \"b1c849d7-1e16-4ef7-84e0-9e4236a59980\") " pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896736    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896761    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-device-dir\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896787    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-system-cni-dir\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bba35853-8627-4c40-9fb6-6b927c715b3c-cni-binary-copy\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896825    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-run-k8s-cni-cncf-io\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896825    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79fb5cad-d334-40d6-badc-180d6b13f9da-env-overrides\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896846    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0030a1f3-11e1-4418-b9ce-0733cc4b2812-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896863    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-device-dir\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.897144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896777    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b1c849d7-1e16-4ef7-84e0-9e4236a59980-kubelet-config\") pod \"global-pull-secret-syncer-klmjq\" (UID: \"b1c849d7-1e16-4ef7-84e0-9e4236a59980\") " pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896880    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-system-cni-dir\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896905    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfm22\" (UniqueName: \"kubernetes.io/projected/79fb5cad-d334-40d6-badc-180d6b13f9da-kube-api-access-kfm22\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.896992    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-etc-kubernetes\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897021    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79fb5cad-d334-40d6-badc-180d6b13f9da-ovnkube-config\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-cni-bin\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:37.897057    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbnfm\" (UniqueName: \"kubernetes.io/projected/ee320b68-0a74-4767-8231-84b874c3760c-kube-api-access-mbnfm\") pod \"iptables-alerter-z5qjf\" (UID: \"ee320b68-0a74-4767-8231-84b874c3760c\") " pod="openshift-network-operator/iptables-alerter-z5qjf"
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897110    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-cni-bin\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0030a1f3-11e1-4418-b9ce-0733cc4b2812-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:37.897138    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret podName:b1c849d7-1e16-4ef7-84e0-9e4236a59980 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:38.397116973 +0000 UTC m=+3.123657077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret") pod "global-pull-secret-syncer-klmjq" (UID: "b1c849d7-1e16-4ef7-84e0-9e4236a59980") : object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897238    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-kubelet\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897078    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-etc-kubernetes\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897289    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-run-ovn\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897310    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-kubelet\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897320    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1c849d7-1e16-4ef7-84e0-9e4236a59980-dbus\") pod \"global-pull-secret-syncer-klmjq\" (UID: \"b1c849d7-1e16-4ef7-84e0-9e4236a59980\") " pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:37.898001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897359    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-run-ovn\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897385    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b1c849d7-1e16-4ef7-84e0-9e4236a59980-dbus\") pod \"global-pull-secret-syncer-klmjq\" (UID: \"b1c849d7-1e16-4ef7-84e0-9e4236a59980\") " pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897391    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-multus-socket-dir-parent\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897428    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897441    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-multus-socket-dir-parent\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee320b68-0a74-4767-8231-84b874c3760c-host-slash\") pod \"iptables-alerter-z5qjf\" (UID: \"ee320b68-0a74-4767-8231-84b874c3760c\") " pod="openshift-network-operator/iptables-alerter-z5qjf"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897479    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee320b68-0a74-4767-8231-84b874c3760c-host-slash\") pod \"iptables-alerter-z5qjf\" (UID: \"ee320b68-0a74-4767-8231-84b874c3760c\") " pod="openshift-network-operator/iptables-alerter-z5qjf"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897483    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bba35853-8627-4c40-9fb6-6b927c715b3c-cni-binary-copy\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897486    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vn6z\" (UniqueName: \"kubernetes.io/projected/0030a1f3-11e1-4418-b9ce-0733cc4b2812-kube-api-access-5vn6z\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897512    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79fb5cad-d334-40d6-badc-180d6b13f9da-ovnkube-script-lib\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-slash\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-run-netns\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs\") pod \"network-metrics-daemon-kmvpw\" (UID: \"686c69bf-f095-4d1a-b378-11e19b6f9e8d\") " pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897591    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-slash\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897617    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0030a1f3-11e1-4418-b9ce-0733cc4b2812-system-cni-dir\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897624    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0030a1f3-11e1-4418-b9ce-0733cc4b2812-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.898907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897633    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-run-netns\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897642    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0030a1f3-11e1-4418-b9ce-0733cc4b2812-cni-binary-copy\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897664    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0030a1f3-11e1-4418-b9ce-0733cc4b2812-system-cni-dir\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897669    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-run-systemd\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897668    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0030a1f3-11e1-4418-b9ce-0733cc4b2812-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897709    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-run-systemd\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:37.897723    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897735    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79fb5cad-d334-40d6-badc-180d6b13f9da-ovn-node-metrics-cert\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897781    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bba35853-8627-4c40-9fb6-6b927c715b3c-multus-daemon-config\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897820    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-etc-selinux\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897836    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0030a1f3-11e1-4418-b9ce-0733cc4b2812-cnibin\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:37.897862    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs podName:686c69bf-f095-4d1a-b378-11e19b6f9e8d nodeName:}" failed. No retries permitted until 2026-09-09 14:10:38.397844343 +0000 UTC m=+3.124384443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs") pod "network-metrics-daemon-kmvpw" (UID: "686c69bf-f095-4d1a-b378-11e19b6f9e8d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897876    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0030a1f3-11e1-4418-b9ce-0733cc4b2812-cnibin\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897894    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0030a1f3-11e1-4418-b9ce-0733cc4b2812-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-socket-dir\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-cnibin\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.899828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.897977    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-var-lib-cni-multus\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898002    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-multus-conf-dir\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898033    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-node-log\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898061    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee320b68-0a74-4767-8231-84b874c3760c-iptables-alerter-script\") pod \"iptables-alerter-z5qjf\" (UID: \"ee320b68-0a74-4767-8231-84b874c3760c\") " pod="openshift-network-operator/iptables-alerter-z5qjf"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898081    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0030a1f3-11e1-4418-b9ce-0733cc4b2812-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6shm\" (UniqueName: \"kubernetes.io/projected/686c69bf-f095-4d1a-b378-11e19b6f9e8d-kube-api-access-t6shm\") pod \"network-metrics-daemon-kmvpw\" (UID: \"686c69bf-f095-4d1a-b378-11e19b6f9e8d\") " pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898127    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-run-netns\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898154    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-etc-openvswitch\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898155    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0030a1f3-11e1-4418-b9ce-0733cc4b2812-cni-binary-copy\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898201    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-node-log\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898232    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-host-run-netns\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898272    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-etc-openvswitch\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898276    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cf776f06-89ba-48fe-ac7e-0379007e2bbf-socket-dir\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898274    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-var-lib-cni-multus\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898307    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb8s6\" (UniqueName: \"kubernetes.io/projected/cf776f06-89ba-48fe-ac7e-0379007e2bbf-kube-api-access-tb8s6\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898320    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-cnibin\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898347    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-run-multus-certs\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.900700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898378    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-systemd-units\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.902406 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898411    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-host-run-multus-certs\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.902406 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898418    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bba35853-8627-4c40-9fb6-6b927c715b3c-multus-daemon-config\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.902406 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898439    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79fb5cad-d334-40d6-badc-180d6b13f9da-systemd-units\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.902406 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898441    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bba35853-8627-4c40-9fb6-6b927c715b3c-multus-conf-dir\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.902406 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.898791    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee320b68-0a74-4767-8231-84b874c3760c-iptables-alerter-script\") pod \"iptables-alerter-z5qjf\" (UID: \"ee320b68-0a74-4767-8231-84b874c3760c\") " pod="openshift-network-operator/iptables-alerter-z5qjf"
Sep 09 14:10:37.902406 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.901955    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79fb5cad-d334-40d6-badc-180d6b13f9da-ovn-node-metrics-cert\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.904128 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.904053    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntv59\" (UniqueName: \"kubernetes.io/projected/bba35853-8627-4c40-9fb6-6b927c715b3c-kube-api-access-ntv59\") pod \"multus-h9phn\" (UID: \"bba35853-8627-4c40-9fb6-6b927c715b3c\") " pod="openshift-multus/multus-h9phn"
Sep 09 14:10:37.909732 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.909705    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbnfm\" (UniqueName: \"kubernetes.io/projected/ee320b68-0a74-4767-8231-84b874c3760c-kube-api-access-mbnfm\") pod \"iptables-alerter-z5qjf\" (UID: \"ee320b68-0a74-4767-8231-84b874c3760c\") " pod="openshift-network-operator/iptables-alerter-z5qjf"
Sep 09 14:10:37.909932 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.909899    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfm22\" (UniqueName: \"kubernetes.io/projected/79fb5cad-d334-40d6-badc-180d6b13f9da-kube-api-access-kfm22\") pod \"ovnkube-node-pgbdd\" (UID: \"79fb5cad-d334-40d6-badc-180d6b13f9da\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:37.914299 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.914166    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb8s6\" (UniqueName: \"kubernetes.io/projected/cf776f06-89ba-48fe-ac7e-0379007e2bbf-kube-api-access-tb8s6\") pod \"aws-ebs-csi-driver-node-gfvct\" (UID: \"cf776f06-89ba-48fe-ac7e-0379007e2bbf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:37.914396 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.914370    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6shm\" (UniqueName: \"kubernetes.io/projected/686c69bf-f095-4d1a-b378-11e19b6f9e8d-kube-api-access-t6shm\") pod \"network-metrics-daemon-kmvpw\" (UID: \"686c69bf-f095-4d1a-b378-11e19b6f9e8d\") " pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:37.915786 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.915761    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vn6z\" (UniqueName: \"kubernetes.io/projected/0030a1f3-11e1-4418-b9ce-0733cc4b2812-kube-api-access-5vn6z\") pod \"multus-additional-cni-plugins-kr62x\" (UID: \"0030a1f3-11e1-4418-b9ce-0733cc4b2812\") " pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:37.987819 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.987783    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qb5mh"
Sep 09 14:10:37.996961 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:37.996933    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jjjx6"
Sep 09 14:10:38.008118 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.008013    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f26x4"
Sep 09 14:10:38.011417 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:38.011290    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3ec5b7_c4fb_40cb_9d26_06234099fb6b.slice/crio-3e87d3b7fed2f1be3f38ce0c8a7d6933bb447c763b7d00dd441259bc0d2a7b44 WatchSource:0}: Error finding container 3e87d3b7fed2f1be3f38ce0c8a7d6933bb447c763b7d00dd441259bc0d2a7b44: Status 404 returned error can't find the container with id 3e87d3b7fed2f1be3f38ce0c8a7d6933bb447c763b7d00dd441259bc0d2a7b44
Sep 09 14:10:38.015624 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.015449    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dbf8x"
Sep 09 14:10:38.022888 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.022860    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h9phn"
Sep 09 14:10:38.026521 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:38.026488    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92fae6c_046f_4d03_86a4_76c97d721a66.slice/crio-b1e0ee0b8222820d01ae9ea26911cccd44ed33cabfe520d4f127ffb88b0110e6 WatchSource:0}: Error finding container b1e0ee0b8222820d01ae9ea26911cccd44ed33cabfe520d4f127ffb88b0110e6: Status 404 returned error can't find the container with id b1e0ee0b8222820d01ae9ea26911cccd44ed33cabfe520d4f127ffb88b0110e6
Sep 09 14:10:38.031701 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:38.031680    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode33a74a7_825e_4fb9_9116_1a399a9f9b5a.slice/crio-8acf5c41aafbd84751ea6eac61246a4dc254928bedf24fdfac25f5a262b91638 WatchSource:0}: Error finding container 8acf5c41aafbd84751ea6eac61246a4dc254928bedf24fdfac25f5a262b91638: Status 404 returned error can't find the container with id 8acf5c41aafbd84751ea6eac61246a4dc254928bedf24fdfac25f5a262b91638
Sep 09 14:10:38.032913 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.032434    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kr62x"
Sep 09 14:10:38.037079 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:38.037042    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba35853_8627_4c40_9fb6_6b927c715b3c.slice/crio-b31206062a3ce689055f39bcd47e98063dc7628a1df77f67df4b8a2223661f24 WatchSource:0}: Error finding container b31206062a3ce689055f39bcd47e98063dc7628a1df77f67df4b8a2223661f24: Status 404 returned error can't find the container with id b31206062a3ce689055f39bcd47e98063dc7628a1df77f67df4b8a2223661f24
Sep 09 14:10:38.040570 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.040550    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:10:38.045266 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:38.045175    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0030a1f3_11e1_4418_b9ce_0733cc4b2812.slice/crio-77010cb9f341f822eb067247c8444bf242c1a9a3ef69d2df14dfe1b1453ec539 WatchSource:0}: Error finding container 77010cb9f341f822eb067247c8444bf242c1a9a3ef69d2df14dfe1b1453ec539: Status 404 returned error can't find the container with id 77010cb9f341f822eb067247c8444bf242c1a9a3ef69d2df14dfe1b1453ec539
Sep 09 14:10:38.048861 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.048840    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z5qjf"
Sep 09 14:10:38.052642 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:38.052619    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fb5cad_d334_40d6_badc_180d6b13f9da.slice/crio-e0229e15cce389abb42f7aa8e9d0608391c60656e48b30bcd21df15d027c641f WatchSource:0}: Error finding container e0229e15cce389abb42f7aa8e9d0608391c60656e48b30bcd21df15d027c641f: Status 404 returned error can't find the container with id e0229e15cce389abb42f7aa8e9d0608391c60656e48b30bcd21df15d027c641f
Sep 09 14:10:38.055901 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.055702    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct"
Sep 09 14:10:38.058207 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.058181    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 14:10:38.059394 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:38.059370    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee320b68_0a74_4767_8231_84b874c3760c.slice/crio-97f6da26ae894076bb3f38982a40cef6e2881f08433557a16aeace4be6c80046 WatchSource:0}: Error finding container 97f6da26ae894076bb3f38982a40cef6e2881f08433557a16aeace4be6c80046: Status 404 returned error can't find the container with id 97f6da26ae894076bb3f38982a40cef6e2881f08433557a16aeace4be6c80046
Sep 09 14:10:38.066829 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:10:38.066795    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf776f06_89ba_48fe_ac7e_0379007e2bbf.slice/crio-a27f165f9c69bbed2cc504c00c7277f683ae70754c026047caea59702c4b8fba WatchSource:0}: Error finding container a27f165f9c69bbed2cc504c00c7277f683ae70754c026047caea59702c4b8fba: Status 404 returned error can't find the container with id a27f165f9c69bbed2cc504c00c7277f683ae70754c026047caea59702c4b8fba
Sep 09 14:10:38.403231 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.403142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fksr\" (UniqueName: \"kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr\") pod \"network-check-target-w8qtc\" (UID: \"e1389f29-7368-4523-a1a8-0f7a0f62cba7\") " pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:38.403231 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.403212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs\") pod \"network-metrics-daemon-kmvpw\" (UID: \"686c69bf-f095-4d1a-b378-11e19b6f9e8d\") " pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:38.403466 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.403273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret\") pod \"global-pull-secret-syncer-klmjq\" (UID: \"b1c849d7-1e16-4ef7-84e0-9e4236a59980\") " pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:38.403466 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:38.403381    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:38.403466 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:38.403392    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:38.403466 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:38.403448    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret podName:b1c849d7-1e16-4ef7-84e0-9e4236a59980 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:39.403428711 +0000 UTC m=+4.129968810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret") pod "global-pull-secret-syncer-klmjq" (UID: "b1c849d7-1e16-4ef7-84e0-9e4236a59980") : object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:38.403466 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:38.403469    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs podName:686c69bf-f095-4d1a-b378-11e19b6f9e8d nodeName:}" failed. No retries permitted until 2026-09-09 14:10:39.403458817 +0000 UTC m=+4.129998899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs") pod "network-metrics-daemon-kmvpw" (UID: "686c69bf-f095-4d1a-b378-11e19b6f9e8d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:38.403718 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:38.403391    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 14:10:38.403718 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:38.403509    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 14:10:38.403718 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:38.403525    2562 projected.go:196] Error preparing data for projected volume kube-api-access-2fksr for pod openshift-network-diagnostics/network-check-target-w8qtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:38.403718 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:38.403575    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr podName:e1389f29-7368-4523-a1a8-0f7a0f62cba7 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:39.403561507 +0000 UTC m=+4.130101608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2fksr" (UniqueName: "kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr") pod "network-check-target-w8qtc" (UID: "e1389f29-7368-4523-a1a8-0f7a0f62cba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:38.729625 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.729501    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 14:05:37 +0000 UTC" deadline="2028-06-18 04:15:13.07811003 +0000 UTC"
Sep 09 14:10:38.729625 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.729572    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15542h4m34.34854173s"
Sep 09 14:10:38.794758 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.794316    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:38.794758 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:38.794734    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:10:38.810451 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.810411    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct" event={"ID":"cf776f06-89ba-48fe-ac7e-0379007e2bbf","Type":"ContainerStarted","Data":"a27f165f9c69bbed2cc504c00c7277f683ae70754c026047caea59702c4b8fba"}
Sep 09 14:10:38.812198 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.812105    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z5qjf" event={"ID":"ee320b68-0a74-4767-8231-84b874c3760c","Type":"ContainerStarted","Data":"97f6da26ae894076bb3f38982a40cef6e2881f08433557a16aeace4be6c80046"}
Sep 09 14:10:38.815472 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.815371    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd" event={"ID":"79fb5cad-d334-40d6-badc-180d6b13f9da","Type":"ContainerStarted","Data":"e0229e15cce389abb42f7aa8e9d0608391c60656e48b30bcd21df15d027c641f"}
Sep 09 14:10:38.818013 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.817953    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h9phn" event={"ID":"bba35853-8627-4c40-9fb6-6b927c715b3c","Type":"ContainerStarted","Data":"b31206062a3ce689055f39bcd47e98063dc7628a1df77f67df4b8a2223661f24"}
Sep 09 14:10:38.819773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.819692    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f26x4" event={"ID":"e92fae6c-046f-4d03-86a4-76c97d721a66","Type":"ContainerStarted","Data":"b1e0ee0b8222820d01ae9ea26911cccd44ed33cabfe520d4f127ffb88b0110e6"}
Sep 09 14:10:38.823174 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.823116    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr62x" event={"ID":"0030a1f3-11e1-4418-b9ce-0733cc4b2812","Type":"ContainerStarted","Data":"77010cb9f341f822eb067247c8444bf242c1a9a3ef69d2df14dfe1b1453ec539"}
Sep 09 14:10:38.824884 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.824814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dbf8x" event={"ID":"e33a74a7-825e-4fb9-9116-1a399a9f9b5a","Type":"ContainerStarted","Data":"8acf5c41aafbd84751ea6eac61246a4dc254928bedf24fdfac25f5a262b91638"}
Sep 09 14:10:38.827381 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.827332    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jjjx6" event={"ID":"2c3ec5b7-c4fb-40cb-9d26-06234099fb6b","Type":"ContainerStarted","Data":"3e87d3b7fed2f1be3f38ce0c8a7d6933bb447c763b7d00dd441259bc0d2a7b44"}
Sep 09 14:10:38.829243 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:38.829184    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qb5mh" event={"ID":"ff4bddfd-4a5d-48a4-a767-3a2a114b2a73","Type":"ContainerStarted","Data":"602196ec74d29a8ec229ff863d4fe0ecf0ee6070fbe357a02e43263f6f3f452d"}
Sep 09 14:10:39.411943 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:39.411606    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fksr\" (UniqueName: \"kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr\") pod \"network-check-target-w8qtc\" (UID: \"e1389f29-7368-4523-a1a8-0f7a0f62cba7\") " pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:39.411943 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:39.411671    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs\") pod \"network-metrics-daemon-kmvpw\" (UID: \"686c69bf-f095-4d1a-b378-11e19b6f9e8d\") " pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:39.411943 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:39.411814    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret\") pod \"global-pull-secret-syncer-klmjq\" (UID: \"b1c849d7-1e16-4ef7-84e0-9e4236a59980\") " pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:39.411943 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:39.411839    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:39.411943 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:39.411891    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:39.411943 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:39.411871    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 14:10:39.412459 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:39.411986    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 14:10:39.412459 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:39.412005    2562 projected.go:196] Error preparing data for projected volume kube-api-access-2fksr for pod openshift-network-diagnostics/network-check-target-w8qtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:39.412459 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:39.411948    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs podName:686c69bf-f095-4d1a-b378-11e19b6f9e8d nodeName:}" failed. No retries permitted until 2026-09-09 14:10:41.411927967 +0000 UTC m=+6.138468056 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs") pod "network-metrics-daemon-kmvpw" (UID: "686c69bf-f095-4d1a-b378-11e19b6f9e8d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:39.412459 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:39.412079    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret podName:b1c849d7-1e16-4ef7-84e0-9e4236a59980 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:41.412061568 +0000 UTC m=+6.138601664 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret") pod "global-pull-secret-syncer-klmjq" (UID: "b1c849d7-1e16-4ef7-84e0-9e4236a59980") : object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:39.412459 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:39.412100    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr podName:e1389f29-7368-4523-a1a8-0f7a0f62cba7 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:41.412088971 +0000 UTC m=+6.138629057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2fksr" (UniqueName: "kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr") pod "network-check-target-w8qtc" (UID: "e1389f29-7368-4523-a1a8-0f7a0f62cba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:39.730404 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:39.730307    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 14:05:37 +0000 UTC" deadline="2028-06-22 05:30:56.88106349 +0000 UTC"
Sep 09 14:10:39.730404 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:39.730353    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15639h20m17.150715469s"
Sep 09 14:10:39.776284 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:39.776236    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 14:10:39.795860 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:39.795378    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:39.795860 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:39.795520    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:10:39.795860 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:39.795541    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:39.795860 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:39.795658    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:10:40.793660 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:40.793623    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:40.794484 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:40.793760    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:10:40.843054 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:40.842976    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal" event={"ID":"2c5ba6b115b3eda95142a79a44b2a692","Type":"ContainerStarted","Data":"b1778d0fa48aafe4a2af7ea700058a112553544cea4aa9eed44fb5af713221bd"}
Sep 09 14:10:40.846678 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:40.846637    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-6.ec2.internal" event={"ID":"9978dbafece0809c5d3fcebbfbd299df","Type":"ContainerStarted","Data":"7b5bb3b3e7d80d2fc38371cfd9a3426b34355405b5895cbe5fbe7b13a3c6e694"}
Sep 09 14:10:40.877305 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:40.877235    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-6.ec2.internal" podStartSLOduration=3.877214966 podStartE2EDuration="3.877214966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:10:40.876611521 +0000 UTC m=+5.603151625" watchObservedRunningTime="2026-09-09 14:10:40.877214966 +0000 UTC m=+5.603755069"
Sep 09 14:10:41.430064 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:41.430027    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret\") pod \"global-pull-secret-syncer-klmjq\" (UID: \"b1c849d7-1e16-4ef7-84e0-9e4236a59980\") " pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:41.430304 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:41.430086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fksr\" (UniqueName: \"kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr\") pod \"network-check-target-w8qtc\" (UID: \"e1389f29-7368-4523-a1a8-0f7a0f62cba7\") " pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:41.430304 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:41.430118    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs\") pod \"network-metrics-daemon-kmvpw\" (UID: \"686c69bf-f095-4d1a-b378-11e19b6f9e8d\") " pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:41.430304 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:41.430267    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:41.430464 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:41.430327    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs podName:686c69bf-f095-4d1a-b378-11e19b6f9e8d nodeName:}" failed. No retries permitted until 2026-09-09 14:10:45.43030966 +0000 UTC m=+10.156849754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs") pod "network-metrics-daemon-kmvpw" (UID: "686c69bf-f095-4d1a-b378-11e19b6f9e8d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:41.430726 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:41.430708    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:41.430814 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:41.430763    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret podName:b1c849d7-1e16-4ef7-84e0-9e4236a59980 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:45.430748894 +0000 UTC m=+10.157288990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret") pod "global-pull-secret-syncer-klmjq" (UID: "b1c849d7-1e16-4ef7-84e0-9e4236a59980") : object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:41.430875 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:41.430841    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 14:10:41.430875 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:41.430859    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 14:10:41.430875 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:41.430871    2562 projected.go:196] Error preparing data for projected volume kube-api-access-2fksr for pod openshift-network-diagnostics/network-check-target-w8qtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:41.431005 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:41.430905    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr podName:e1389f29-7368-4523-a1a8-0f7a0f62cba7 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:45.430893702 +0000 UTC m=+10.157433796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2fksr" (UniqueName: "kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr") pod "network-check-target-w8qtc" (UID: "e1389f29-7368-4523-a1a8-0f7a0f62cba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:41.795920 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:41.795315    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:41.795920 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:41.795447    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:10:41.796732 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:41.796519    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:41.796732 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:41.796637    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:10:42.794031 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:42.793996    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:42.794246 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:42.794138    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:10:43.794292 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:43.793820    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:43.794292 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:43.793940    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:10:43.794292 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:43.793989    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:43.794292 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:43.794118    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:10:44.793600 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:44.793566    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:44.793779 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:44.793701    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:10:44.862065 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:44.862027    2562 generic.go:356] "Generic (PLEG): container finished" podID="2c5ba6b115b3eda95142a79a44b2a692" containerID="b1778d0fa48aafe4a2af7ea700058a112553544cea4aa9eed44fb5af713221bd" exitCode=0
Sep 09 14:10:44.862538 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:44.862091    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal" event={"ID":"2c5ba6b115b3eda95142a79a44b2a692","Type":"ContainerDied","Data":"b1778d0fa48aafe4a2af7ea700058a112553544cea4aa9eed44fb5af713221bd"}
Sep 09 14:10:45.465603 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:45.465547    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret\") pod \"global-pull-secret-syncer-klmjq\" (UID: \"b1c849d7-1e16-4ef7-84e0-9e4236a59980\") " pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:45.465603 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:45.465605    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fksr\" (UniqueName: \"kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr\") pod \"network-check-target-w8qtc\" (UID: \"e1389f29-7368-4523-a1a8-0f7a0f62cba7\") " pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:45.465849 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:45.465634    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs\") pod \"network-metrics-daemon-kmvpw\" (UID: \"686c69bf-f095-4d1a-b378-11e19b6f9e8d\") " pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:45.465849 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:45.465682    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:45.465849 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:45.465762    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret podName:b1c849d7-1e16-4ef7-84e0-9e4236a59980 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:53.465739644 +0000 UTC m=+18.192279727 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret") pod "global-pull-secret-syncer-klmjq" (UID: "b1c849d7-1e16-4ef7-84e0-9e4236a59980") : object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:45.465849 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:45.465773    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:45.465849 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:45.465812    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 14:10:45.465849 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:45.465826    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs podName:686c69bf-f095-4d1a-b378-11e19b6f9e8d nodeName:}" failed. No retries permitted until 2026-09-09 14:10:53.465810438 +0000 UTC m=+18.192350534 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs") pod "network-metrics-daemon-kmvpw" (UID: "686c69bf-f095-4d1a-b378-11e19b6f9e8d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:45.465849 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:45.465835    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 14:10:45.465849 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:45.465846    2562 projected.go:196] Error preparing data for projected volume kube-api-access-2fksr for pod openshift-network-diagnostics/network-check-target-w8qtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:45.466267 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:45.465893    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr podName:e1389f29-7368-4523-a1a8-0f7a0f62cba7 nodeName:}" failed. No retries permitted until 2026-09-09 14:10:53.465878586 +0000 UTC m=+18.192418683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2fksr" (UniqueName: "kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr") pod "network-check-target-w8qtc" (UID: "e1389f29-7368-4523-a1a8-0f7a0f62cba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:45.795343 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:45.794723    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:45.795343 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:45.794850    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:10:45.795343 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:45.794887    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:45.795343 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:45.794954    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:10:46.794105 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:46.794022    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:46.794645 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:46.794181    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:10:47.793572 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:47.793528    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:47.793768 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:47.793539    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:47.793768 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:47.793665    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:10:47.793768 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:47.793723    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:10:48.794163 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:48.794137    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:48.794456 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:48.794243    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:10:49.793610 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:49.793531    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:49.793610 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:49.793581    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:49.793841 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:49.793665    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:10:49.793841 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:49.793796    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:10:50.794311 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:50.794277    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:50.794756 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:50.794401    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:10:51.794039 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:51.794003    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:51.794222 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:51.794152    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:10:51.794291 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:51.794211    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:51.794354 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:51.794331    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:10:52.794065 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:52.794025    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:52.794297 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:52.794147    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:10:53.524084 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:53.524053    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret\") pod \"global-pull-secret-syncer-klmjq\" (UID: \"b1c849d7-1e16-4ef7-84e0-9e4236a59980\") " pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:53.524562 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:53.524096    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fksr\" (UniqueName: \"kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr\") pod \"network-check-target-w8qtc\" (UID: \"e1389f29-7368-4523-a1a8-0f7a0f62cba7\") " pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:53.524562 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:53.524124    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs\") pod \"network-metrics-daemon-kmvpw\" (UID: \"686c69bf-f095-4d1a-b378-11e19b6f9e8d\") " pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:53.524562 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:53.524239    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:53.524562 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:53.524261    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 14:10:53.524562 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:53.524293    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 14:10:53.524562 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:53.524308    2562 projected.go:196] Error preparing data for projected volume kube-api-access-2fksr for pod openshift-network-diagnostics/network-check-target-w8qtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:53.524562 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:53.524269    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:53.524562 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:53.524310    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret podName:b1c849d7-1e16-4ef7-84e0-9e4236a59980 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:09.524290141 +0000 UTC m=+34.250830238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret") pod "global-pull-secret-syncer-klmjq" (UID: "b1c849d7-1e16-4ef7-84e0-9e4236a59980") : object "kube-system"/"original-pull-secret" not registered
Sep 09 14:10:53.524562 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:53.524386    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs podName:686c69bf-f095-4d1a-b378-11e19b6f9e8d nodeName:}" failed. No retries permitted until 2026-09-09 14:11:09.524369988 +0000 UTC m=+34.250910090 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs") pod "network-metrics-daemon-kmvpw" (UID: "686c69bf-f095-4d1a-b378-11e19b6f9e8d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:10:53.524562 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:53.524404    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr podName:e1389f29-7368-4523-a1a8-0f7a0f62cba7 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:09.524394922 +0000 UTC m=+34.250935003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2fksr" (UniqueName: "kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr") pod "network-check-target-w8qtc" (UID: "e1389f29-7368-4523-a1a8-0f7a0f62cba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:10:53.794108 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:53.793700    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:53.794108 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:53.793845    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:10:53.794108 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:53.793887    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:53.794108 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:53.794010    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:10:54.793707 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:54.793680    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:54.794114 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:54.793801    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:10:55.794617 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:55.794589    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:55.794990 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:55.794676    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:10:55.794990 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:55.794721    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:55.794990 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:55.794824    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:10:56.794386 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.794073    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:56.794502 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:56.794473    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:10:56.885999 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.885973    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal" event={"ID":"2c5ba6b115b3eda95142a79a44b2a692","Type":"ContainerStarted","Data":"551a07abde128eb95f888ab6f7b55cce82bccb214c8cfb46cda91e5b8ed290c6"}
Sep 09 14:10:56.887380 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.887359    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct" event={"ID":"cf776f06-89ba-48fe-ac7e-0379007e2bbf","Type":"ContainerStarted","Data":"b0357a459578fdce77beb7d95e650caba5f56afcaf6472aa3da53d5db7ed3a81"}
Sep 09 14:10:56.890131 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.890112    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd" event={"ID":"79fb5cad-d334-40d6-badc-180d6b13f9da","Type":"ContainerStarted","Data":"2bdca2efccf418da622db57274a8dd3b4b3c1c1044b94034dbb99dea1b1be328"}
Sep 09 14:10:56.890232 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.890164    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd" event={"ID":"79fb5cad-d334-40d6-badc-180d6b13f9da","Type":"ContainerStarted","Data":"a69d105b7c7841f91ebae5e347a1972b1fd39eb87af10a65502a13d5426da4c0"}
Sep 09 14:10:56.890232 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.890223    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd" event={"ID":"79fb5cad-d334-40d6-badc-180d6b13f9da","Type":"ContainerStarted","Data":"661260dd90148f8b3adbfb1c1d3546ce93d3ca390a8b76a6041e44786cc954b3"}
Sep 09 14:10:56.890311 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.890265    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd" event={"ID":"79fb5cad-d334-40d6-badc-180d6b13f9da","Type":"ContainerStarted","Data":"91c80e67c4ac8b5570b571114f9cd7c243d16189e550ebff8c4e3f055e946783"}
Sep 09 14:10:56.890311 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.890301    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd" event={"ID":"79fb5cad-d334-40d6-badc-180d6b13f9da","Type":"ContainerStarted","Data":"01af361e617e2774287d7b7aec26816d5d0c37ce62a2f9cb3e8d2b524e44d6b4"}
Sep 09 14:10:56.890381 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.890329    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd" event={"ID":"79fb5cad-d334-40d6-badc-180d6b13f9da","Type":"ContainerStarted","Data":"141839aa04b3e68785a929989d6ac4f81c1a04872a2b876169e23dfa1716c3e5"}
Sep 09 14:10:56.891509 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.891492    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h9phn" event={"ID":"bba35853-8627-4c40-9fb6-6b927c715b3c","Type":"ContainerStarted","Data":"77d9d3bacee0e5a7541269ce0c8e5e7f4293543b15bc74b74c013061322ccb1f"}
Sep 09 14:10:56.892897 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.892877    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f26x4" event={"ID":"e92fae6c-046f-4d03-86a4-76c97d721a66","Type":"ContainerStarted","Data":"69bc82a40495d8b7607bd7f51a9d203bb4c960d63fbeb48de614dff6e1147d69"}
Sep 09 14:10:56.894397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.894377    2562 generic.go:356] "Generic (PLEG): container finished" podID="0030a1f3-11e1-4418-b9ce-0733cc4b2812" containerID="04ece6a0f08283c322420c2fce39acc095e8b402409bce77a7d26e3143cfecdf" exitCode=0
Sep 09 14:10:56.894479 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.894435    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr62x" event={"ID":"0030a1f3-11e1-4418-b9ce-0733cc4b2812","Type":"ContainerDied","Data":"04ece6a0f08283c322420c2fce39acc095e8b402409bce77a7d26e3143cfecdf"}
Sep 09 14:10:56.895932 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.895904    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dbf8x" event={"ID":"e33a74a7-825e-4fb9-9116-1a399a9f9b5a","Type":"ContainerStarted","Data":"6b3d79a957b8b87e1bde7b1db7627fd5ff2e653943cb42cdb9d05f8a1feaa295"}
Sep 09 14:10:56.897472 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.897446    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jjjx6" event={"ID":"2c3ec5b7-c4fb-40cb-9d26-06234099fb6b","Type":"ContainerStarted","Data":"9f9c78b2aab1847aa2f014ff0120bf0eff1c7118b7ceb7d80e491d1a30c256a7"}
Sep 09 14:10:56.898931 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.898912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qb5mh" event={"ID":"ff4bddfd-4a5d-48a4-a767-3a2a114b2a73","Type":"ContainerStarted","Data":"e0b95c5250d40fa28f0d4c54ebac1a65d901e2be0253a726d838e285a268e471"}
Sep 09 14:10:56.903725 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.903688    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-6.ec2.internal" podStartSLOduration=19.903676182 podStartE2EDuration="19.903676182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:10:56.903324696 +0000 UTC m=+21.629864798" watchObservedRunningTime="2026-09-09 14:10:56.903676182 +0000 UTC m=+21.630216283"
Sep 09 14:10:56.917379 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.917340    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qb5mh" podStartSLOduration=2.720190395 podStartE2EDuration="20.917328224s" totalImagesPullingTime="18.197137829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:10:56.917199788 +0000 UTC m=+21.643739887" watchObservedRunningTime="2026-09-09 14:10:56.917328224 +0000 UTC m=+21.643868325"
Sep 09 14:10:56.943048 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.943004    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jjjx6" podStartSLOduration=10.120939255 podStartE2EDuration="20.942987279s" totalImagesPullingTime="10.822048024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:10:56.930569247 +0000 UTC m=+21.657109349" watchObservedRunningTime="2026-09-09 14:10:56.942987279 +0000 UTC m=+21.669527388"
Sep 09 14:10:56.943803 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.943768    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f26x4" podStartSLOduration=2.768257299 podStartE2EDuration="20.943730934s" totalImagesPullingTime="18.175473635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:10:56.943196607 +0000 UTC m=+21.669736708" watchObservedRunningTime="2026-09-09 14:10:56.943730934 +0000 UTC m=+21.670271038"
Sep 09 14:10:56.958503 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.958468    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dbf8x" podStartSLOduration=2.784955133 podStartE2EDuration="20.958455424s" totalImagesPullingTime="18.173500291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:10:56.958164941 +0000 UTC m=+21.684705044" watchObservedRunningTime="2026-09-09 14:10:56.958455424 +0000 UTC m=+21.684995526"
Sep 09 14:10:56.979869 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:56.979840    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h9phn" podStartSLOduration=2.66811823 podStartE2EDuration="20.979829174s" totalImagesPullingTime="18.311710944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:10:56.979784678 +0000 UTC m=+21.706324780" watchObservedRunningTime="2026-09-09 14:10:56.979829174 +0000 UTC m=+21.706369276"
Sep 09 14:10:57.584231 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:57.584199    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jjjx6"
Sep 09 14:10:57.584729 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:57.584713    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jjjx6"
Sep 09 14:10:57.793556 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:57.793532    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:57.793699 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:57.793541    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:57.793699 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:57.793672    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:10:57.793812 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:57.793709    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:10:57.835005 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:57.834972    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 14:10:57.903296 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:57.903262    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct" event={"ID":"cf776f06-89ba-48fe-ac7e-0379007e2bbf","Type":"ContainerStarted","Data":"abebbcf5c3077212835fbae1d3e4e0cb814078dfce5b4e7d3cc525e397075419"}
Sep 09 14:10:57.905008 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:57.904985    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z5qjf" event={"ID":"ee320b68-0a74-4767-8231-84b874c3760c","Type":"ContainerStarted","Data":"051c23a920464d2f82d80d108effe126861db5bc75ac29abef5de57683934b64"}
Sep 09 14:10:57.906059 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:57.905973    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jjjx6"
Sep 09 14:10:57.906589 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:57.906563    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jjjx6"
Sep 09 14:10:57.923831 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:57.923786    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z5qjf" podStartSLOduration=3.778840463 podStartE2EDuration="21.923772207s" totalImagesPullingTime="18.144931744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:10:57.92331142 +0000 UTC m=+22.649851527" watchObservedRunningTime="2026-09-09 14:10:57.923772207 +0000 UTC m=+22.650312310"
Sep 09 14:10:58.748758 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:58.748667    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T14:10:57.834989828Z","UUID":"58a5ed21-ea56-4016-9bdc-d4813d8351db","Handler":null,"Name":"","Endpoint":""}
Sep 09 14:10:58.750302 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:58.750280    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 14:10:58.750509 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:58.750314    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 14:10:58.793678 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:58.793616    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:10:58.793835 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:58.793733    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:10:59.795022 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:59.794801    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:10:59.795496 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:59.794856    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:10:59.795496 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:59.795116    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:10:59.795496 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:10:59.795220    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:10:59.911882 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:59.911838    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct" event={"ID":"cf776f06-89ba-48fe-ac7e-0379007e2bbf","Type":"ContainerStarted","Data":"405b127c04898ad7768467bccea633691aaa68954e5ebf65320b56934472a23e"}
Sep 09 14:10:59.915477 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:59.915453    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd" event={"ID":"79fb5cad-d334-40d6-badc-180d6b13f9da","Type":"ContainerStarted","Data":"213a1ee8ce8d9b56057e802f59b62ace1f7c66992d5f5d120fa765cf9c23cf3b"}
Sep 09 14:10:59.927840 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:10:59.927802    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gfvct" podStartSLOduration=3.112176985 podStartE2EDuration="23.927789299s" totalImagesPullingTime="20.815612314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:10:59.927259331 +0000 UTC m=+24.653799433" watchObservedRunningTime="2026-09-09 14:10:59.927789299 +0000 UTC m=+24.654329438"
Sep 09 14:11:00.794376 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:00.794350    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:11:00.794567 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:00.794459    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:11:01.794530 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:01.794331    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:11:01.794938 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:01.794400    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:11:01.794938 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:01.794629    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:11:01.794938 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:01.794727    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:11:01.923203 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:01.923108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd" event={"ID":"79fb5cad-d334-40d6-badc-180d6b13f9da","Type":"ContainerStarted","Data":"6c0ea241a51e11c8bfb77b2963f26c95f14df65502ee87d0f3f287ca4d811faf"}
Sep 09 14:11:01.923449 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:01.923429    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:11:01.923613 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:01.923593    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:11:01.923692 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:01.923657    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:11:01.925069 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:01.925042    2562 generic.go:356] "Generic (PLEG): container finished" podID="0030a1f3-11e1-4418-b9ce-0733cc4b2812" containerID="c84956f58c8e4b33ffe13a74e3b9329e9d9d37c313cb0fc81905a433684a4493" exitCode=0
Sep 09 14:11:01.925195 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:01.925068    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr62x" event={"ID":"0030a1f3-11e1-4418-b9ce-0733cc4b2812","Type":"ContainerDied","Data":"c84956f58c8e4b33ffe13a74e3b9329e9d9d37c313cb0fc81905a433684a4493"}
Sep 09 14:11:01.938574 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:01.938553    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:11:01.938684 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:01.938645    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:11:01.950698 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:01.950664    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd" podStartSLOduration=7.761602855 podStartE2EDuration="25.950651503s" totalImagesPullingTime="18.189048648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:01.950552845 +0000 UTC m=+26.677092946" watchObservedRunningTime="2026-09-09 14:11:01.950651503 +0000 UTC m=+26.677191604"
Sep 09 14:11:02.793992 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:02.793960    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:11:02.794132 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:02.794077    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:11:02.929349 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:02.929316    2562 generic.go:356] "Generic (PLEG): container finished" podID="0030a1f3-11e1-4418-b9ce-0733cc4b2812" containerID="c29e3a85e87551b149a7ac5a2a2fdb475d2835c58fb17f03157e34cea4257bbe" exitCode=0
Sep 09 14:11:02.929837 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:02.929354    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr62x" event={"ID":"0030a1f3-11e1-4418-b9ce-0733cc4b2812","Type":"ContainerDied","Data":"c29e3a85e87551b149a7ac5a2a2fdb475d2835c58fb17f03157e34cea4257bbe"}
Sep 09 14:11:03.311955 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:03.311928    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-klmjq"]
Sep 09 14:11:03.312105 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:03.312046    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:11:03.312195 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:03.312137    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:11:03.314941 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:03.314912    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kmvpw"]
Sep 09 14:11:03.315034 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:03.315011    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:11:03.315112 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:03.315093    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:11:03.317445 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:03.317424    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w8qtc"]
Sep 09 14:11:03.317552 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:03.317503    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:11:03.317616 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:03.317568    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:11:04.793762 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:04.793723    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:11:04.794355 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:04.793723    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:11:04.794355 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:04.793834    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:11:04.794355 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:04.793723    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:11:04.794355 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:04.793891    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:11:04.794355 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:04.793943    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:11:04.936026 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:04.935995    2562 generic.go:356] "Generic (PLEG): container finished" podID="0030a1f3-11e1-4418-b9ce-0733cc4b2812" containerID="5f04ae36c93c24f02497aa84d4eeaed3fe31f871a6ab5f32005cad7a87ddc456" exitCode=0
Sep 09 14:11:04.936156 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:04.936036    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr62x" event={"ID":"0030a1f3-11e1-4418-b9ce-0733cc4b2812","Type":"ContainerDied","Data":"5f04ae36c93c24f02497aa84d4eeaed3fe31f871a6ab5f32005cad7a87ddc456"}
Sep 09 14:11:06.793634 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:06.793418    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:11:06.794094 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:06.793462    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:11:06.794094 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:06.793747    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:11:06.794094 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:06.793835    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:11:06.794094 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:06.793510    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:11:06.794094 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:06.793929    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:11:08.794087 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:08.794055    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:11:08.794496 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:08.794055    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:11:08.794496 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:08.794219    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klmjq" podUID="b1c849d7-1e16-4ef7-84e0-9e4236a59980"
Sep 09 14:11:08.794496 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:08.794055    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:11:08.794496 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:08.794277    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w8qtc" podUID="e1389f29-7368-4523-a1a8-0f7a0f62cba7"
Sep 09 14:11:08.794496 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:08.794336    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kmvpw" podUID="686c69bf-f095-4d1a-b378-11e19b6f9e8d"
Sep 09 14:11:09.110592 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.110513    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-6.ec2.internal" event="NodeReady"
Sep 09 14:11:09.110742 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.110662    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 14:11:09.143520 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.143491    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65df65b68f-5q84h"]
Sep 09 14:11:09.174432 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.174406    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4w2mf"]
Sep 09 14:11:09.174615 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.174517    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.176593 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.176531    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 14:11:09.176713 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.176616    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 14:11:09.176713 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.176653    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 14:11:09.176713 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.176643    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v89ml\""
Sep 09 14:11:09.183070 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.183020    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 14:11:09.188502 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.188476    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g6g92"]
Sep 09 14:11:09.189025 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.188999    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:09.191051 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.191023    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 14:11:09.191145 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.191030    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 14:11:09.191145 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.191136    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tfl8h\""
Sep 09 14:11:09.209375 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.209352    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65df65b68f-5q84h"]
Sep 09 14:11:09.209490 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.209389    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4w2mf"]
Sep 09 14:11:09.209490 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.209410    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g6g92"]
Sep 09 14:11:09.209601 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.209494    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g6g92"
Sep 09 14:11:09.211481 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.211462    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 14:11:09.211633 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.211581    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hbr5s\""
Sep 09 14:11:09.211747 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.211728    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 14:11:09.211832 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.211738    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 14:11:09.300323 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.300284    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:09.338083 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.338023    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-464kt\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-kube-api-access-464kt\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.338083 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.338092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgxg4\" (UniqueName: \"kubernetes.io/projected/f692545a-25d0-42aa-acaa-57d3c20c4ac9-kube-api-access-vgxg4\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:09.338329 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.338120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64sgm\" (UniqueName: \"kubernetes.io/projected/e92f8856-f50c-4c13-b7d0-d9c4c5038953-kube-api-access-64sgm\") pod \"ingress-canary-g6g92\" (UID: \"e92f8856-f50c-4c13-b7d0-d9c4c5038953\") " pod="openshift-ingress-canary/ingress-canary-g6g92"
Sep 09 14:11:09.338329 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.338161    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-image-registry-private-configuration\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.338329 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.338265    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-trusted-ca\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.338329 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.338321    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f692545a-25d0-42aa-acaa-57d3c20c4ac9-tmp-dir\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:09.338529 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.338396    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-bound-sa-token\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.338529 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.338427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-certificates\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.338529 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.338451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-installation-pull-secrets\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.338529 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.338479    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-ca-trust-extracted\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.338529 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.338503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e92f8856-f50c-4c13-b7d0-d9c4c5038953-cert\") pod \"ingress-canary-g6g92\" (UID: \"e92f8856-f50c-4c13-b7d0-d9c4c5038953\") " pod="openshift-ingress-canary/ingress-canary-g6g92"
Sep 09 14:11:09.338736 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.338571    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.338736 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.338595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f692545a-25d0-42aa-acaa-57d3c20c4ac9-config-volume\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:09.338736 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.338623    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:09.387911 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.387821    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:09.439774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.439733    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.439774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.439773    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f692545a-25d0-42aa-acaa-57d3c20c4ac9-config-volume\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:09.440010 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.439801    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:09.440010 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.439833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-464kt\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-kube-api-access-464kt\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.440010 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.439857    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgxg4\" (UniqueName: \"kubernetes.io/projected/f692545a-25d0-42aa-acaa-57d3c20c4ac9-kube-api-access-vgxg4\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:09.440010 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.439883    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 14:11:09.440010 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.439891    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64sgm\" (UniqueName: \"kubernetes.io/projected/e92f8856-f50c-4c13-b7d0-d9c4c5038953-kube-api-access-64sgm\") pod \"ingress-canary-g6g92\" (UID: \"e92f8856-f50c-4c13-b7d0-d9c4c5038953\") " pod="openshift-ingress-canary/ingress-canary-g6g92"
Sep 09 14:11:09.440010 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.439903    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65df65b68f-5q84h: secret "image-registry-tls" not found
Sep 09 14:11:09.440010 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.439950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-image-registry-private-configuration\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.440010 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.439974    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls podName:67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:09.939959514 +0000 UTC m=+34.666499599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls") pod "image-registry-65df65b68f-5q84h" (UID: "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40") : secret "image-registry-tls" not found
Sep 09 14:11:09.440466 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.440018    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-trusted-ca\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.440466 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.440109    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f692545a-25d0-42aa-acaa-57d3c20c4ac9-tmp-dir\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:09.440466 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.440157    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-bound-sa-token\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.440466 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.440200    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-certificates\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.440466 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.440229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-installation-pull-secrets\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.440466 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.440259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-ca-trust-extracted\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.440466 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.440283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e92f8856-f50c-4c13-b7d0-d9c4c5038953-cert\") pod \"ingress-canary-g6g92\" (UID: \"e92f8856-f50c-4c13-b7d0-d9c4c5038953\") " pod="openshift-ingress-canary/ingress-canary-g6g92"
Sep 09 14:11:09.440466 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.440404    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 14:11:09.440466 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.440464    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls podName:f692545a-25d0-42aa-acaa-57d3c20c4ac9 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:09.940449094 +0000 UTC m=+34.666989193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls") pod "dns-default-4w2mf" (UID: "f692545a-25d0-42aa-acaa-57d3c20c4ac9") : secret "dns-default-metrics-tls" not found
Sep 09 14:11:09.440922 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.440496    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f692545a-25d0-42aa-acaa-57d3c20c4ac9-config-volume\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:09.440922 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.440672    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-ca-trust-extracted\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.440922 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.440885    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f692545a-25d0-42aa-acaa-57d3c20c4ac9-tmp-dir\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:09.441066 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.440923    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-certificates\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.441339 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.441308    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-trusted-ca\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.445032 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.444992    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-image-registry-private-configuration\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.445125 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.445029    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-installation-pull-secrets\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.445125 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.445041    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e92f8856-f50c-4c13-b7d0-d9c4c5038953-cert\") pod \"ingress-canary-g6g92\" (UID: \"e92f8856-f50c-4c13-b7d0-d9c4c5038953\") " pod="openshift-ingress-canary/ingress-canary-g6g92"
Sep 09 14:11:09.451578 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.451552    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgxg4\" (UniqueName: \"kubernetes.io/projected/f692545a-25d0-42aa-acaa-57d3c20c4ac9-kube-api-access-vgxg4\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:09.452122 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.452098    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-464kt\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-kube-api-access-464kt\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.452306 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.452284    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64sgm\" (UniqueName: \"kubernetes.io/projected/e92f8856-f50c-4c13-b7d0-d9c4c5038953-kube-api-access-64sgm\") pod \"ingress-canary-g6g92\" (UID: \"e92f8856-f50c-4c13-b7d0-d9c4c5038953\") " pod="openshift-ingress-canary/ingress-canary-g6g92"
Sep 09 14:11:09.452600 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.452575    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-bound-sa-token\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.519955 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.519923    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g6g92"
Sep 09 14:11:09.540838 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.540803    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret\") pod \"global-pull-secret-syncer-klmjq\" (UID: \"b1c849d7-1e16-4ef7-84e0-9e4236a59980\") " pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:11:09.541005 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.540860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fksr\" (UniqueName: \"kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr\") pod \"network-check-target-w8qtc\" (UID: \"e1389f29-7368-4523-a1a8-0f7a0f62cba7\") " pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:11:09.541005 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.540899    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs\") pod \"network-metrics-daemon-kmvpw\" (UID: \"686c69bf-f095-4d1a-b378-11e19b6f9e8d\") " pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:11:09.541005 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.540955    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 14:11:09.541005 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.540996    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 14:11:09.541005 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.541008    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:11:09.541405 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.541017    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 14:11:09.541405 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.541026    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret podName:b1c849d7-1e16-4ef7-84e0-9e4236a59980 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:41.541005055 +0000 UTC m=+66.267545189 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret") pod "global-pull-secret-syncer-klmjq" (UID: "b1c849d7-1e16-4ef7-84e0-9e4236a59980") : object "kube-system"/"original-pull-secret" not registered
Sep 09 14:11:09.541405 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.541028    2562 projected.go:196] Error preparing data for projected volume kube-api-access-2fksr for pod openshift-network-diagnostics/network-check-target-w8qtc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:11:09.541405 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.541072    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs podName:686c69bf-f095-4d1a-b378-11e19b6f9e8d nodeName:}" failed. No retries permitted until 2026-09-09 14:11:41.541055899 +0000 UTC m=+66.267596001 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs") pod "network-metrics-daemon-kmvpw" (UID: "686c69bf-f095-4d1a-b378-11e19b6f9e8d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 14:11:09.541405 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.541093    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr podName:e1389f29-7368-4523-a1a8-0f7a0f62cba7 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:41.541082442 +0000 UTC m=+66.267622533 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2fksr" (UniqueName: "kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr") pod "network-check-target-w8qtc" (UID: "e1389f29-7368-4523-a1a8-0f7a0f62cba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 14:11:09.944363 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.944325    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:09.944900 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:09.944373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:09.944900 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.944498    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 14:11:09.944900 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.944520    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65df65b68f-5q84h: secret "image-registry-tls" not found
Sep 09 14:11:09.944900 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.944539    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 14:11:09.944900 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.944581    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls podName:67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:10.94456276 +0000 UTC m=+35.671102840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls") pod "image-registry-65df65b68f-5q84h" (UID: "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40") : secret "image-registry-tls" not found
Sep 09 14:11:09.944900 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:09.944597    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls podName:f692545a-25d0-42aa-acaa-57d3c20c4ac9 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:10.944589864 +0000 UTC m=+35.671129945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls") pod "dns-default-4w2mf" (UID: "f692545a-25d0-42aa-acaa-57d3c20c4ac9") : secret "dns-default-metrics-tls" not found
Sep 09 14:11:10.388254 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:10.387995    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g6g92"]
Sep 09 14:11:10.391705 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:10.391685    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92f8856_f50c_4c13_b7d0_d9c4c5038953.slice/crio-97f9dd1d4c66b2d760acfbac7c5392dba77a7936855569b4dc18c531a3befce9 WatchSource:0}: Error finding container 97f9dd1d4c66b2d760acfbac7c5392dba77a7936855569b4dc18c531a3befce9: Status 404 returned error can't find the container with id 97f9dd1d4c66b2d760acfbac7c5392dba77a7936855569b4dc18c531a3befce9
Sep 09 14:11:10.794255 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:10.794215    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:11:10.794255 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:10.794262    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:11:10.794480 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:10.794238    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:11:10.796793 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:10.796770    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-72t49\""
Sep 09 14:11:10.796926 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:10.796817    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 14:11:10.796926 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:10.796817    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 14:11:10.797356 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:10.797337    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 14:11:10.797467 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:10.797342    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 14:11:10.797467 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:10.797378    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f5zw2\""
Sep 09 14:11:10.953120 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:10.953036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:10.953120 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:10.953072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:10.953721 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:10.953198    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 14:11:10.953721 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:10.953217    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65df65b68f-5q84h: secret "image-registry-tls" not found
Sep 09 14:11:10.953721 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:10.953199    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 14:11:10.953721 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:10.953263    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls podName:67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:12.953247486 +0000 UTC m=+37.679787566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls") pod "image-registry-65df65b68f-5q84h" (UID: "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40") : secret "image-registry-tls" not found
Sep 09 14:11:10.953721 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:10.953281    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls podName:f692545a-25d0-42aa-acaa-57d3c20c4ac9 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:12.95327197 +0000 UTC m=+37.679812060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls") pod "dns-default-4w2mf" (UID: "f692545a-25d0-42aa-acaa-57d3c20c4ac9") : secret "dns-default-metrics-tls" not found
Sep 09 14:11:10.953721 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:10.953440    2562 generic.go:356] "Generic (PLEG): container finished" podID="0030a1f3-11e1-4418-b9ce-0733cc4b2812" containerID="988f3d6d4a4e7939a6ccf8a81174399635b75bed338aba3a15e07902f045bdb5" exitCode=0
Sep 09 14:11:10.953721 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:10.953479    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr62x" event={"ID":"0030a1f3-11e1-4418-b9ce-0733cc4b2812","Type":"ContainerDied","Data":"988f3d6d4a4e7939a6ccf8a81174399635b75bed338aba3a15e07902f045bdb5"}
Sep 09 14:11:10.954809 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:10.954785    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g6g92" event={"ID":"e92f8856-f50c-4c13-b7d0-d9c4c5038953","Type":"ContainerStarted","Data":"97f9dd1d4c66b2d760acfbac7c5392dba77a7936855569b4dc18c531a3befce9"}
Sep 09 14:11:10.981241 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:10.981216    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:11.039691 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:11.039651    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:11.141395 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:11.141365    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:11.961348 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:11.961319    2562 generic.go:356] "Generic (PLEG): container finished" podID="0030a1f3-11e1-4418-b9ce-0733cc4b2812" containerID="dea3dcb481b5f10ad9bed6c9627ca8fc00f457e6fbf725c404b2bb64c3105c45" exitCode=0
Sep 09 14:11:11.961846 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:11.961368    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr62x" event={"ID":"0030a1f3-11e1-4418-b9ce-0733cc4b2812","Type":"ContainerDied","Data":"dea3dcb481b5f10ad9bed6c9627ca8fc00f457e6fbf725c404b2bb64c3105c45"}
Sep 09 14:11:12.966563 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:12.966530    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:12.967236 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:12.966576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:12.967236 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:12.966663    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 14:11:12.967236 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:12.966681    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65df65b68f-5q84h: secret "image-registry-tls" not found
Sep 09 14:11:12.967236 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:12.966727    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 14:11:12.967236 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:12.966737    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls podName:67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:16.966718037 +0000 UTC m=+41.693258137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls") pod "image-registry-65df65b68f-5q84h" (UID: "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40") : secret "image-registry-tls" not found
Sep 09 14:11:12.967236 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:12.966782    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls podName:f692545a-25d0-42aa-acaa-57d3c20c4ac9 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:16.966766444 +0000 UTC m=+41.693306545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls") pod "dns-default-4w2mf" (UID: "f692545a-25d0-42aa-acaa-57d3c20c4ac9") : secret "dns-default-metrics-tls" not found
Sep 09 14:11:12.969090 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:12.969063    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kr62x" event={"ID":"0030a1f3-11e1-4418-b9ce-0733cc4b2812","Type":"ContainerStarted","Data":"8ac0ccc7b9c709c1c38b3ba1584b7e0643d52952294dc6aba83cd69a85ee24d7"}
Sep 09 14:11:12.974328 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:12.974301    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:12.990964 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:12.990912    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kr62x" podStartSLOduration=6.765922215 podStartE2EDuration="36.99089474s" totalImagesPullingTime="30.224972525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:12.990126988 +0000 UTC m=+37.716667089" watchObservedRunningTime="2026-09-09 14:11:12.99089474 +0000 UTC m=+37.717434842"
Sep 09 14:11:13.072714 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:13.072680    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:13.172287 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:13.172209    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:13.272184 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:13.272135    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:13.972513 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:13.972469    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g6g92" event={"ID":"e92f8856-f50c-4c13-b7d0-d9c4c5038953","Type":"ContainerStarted","Data":"2b92d80409eb814703c6c78e08d96c5e2a2fb06addfef97cd6d04aa2c4edeee2"}
Sep 09 14:11:13.988649 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:13.988588    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g6g92" podStartSLOduration=2.04856601 podStartE2EDuration="4.98856921s" totalImagesPullingTime="2.9400032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:13.988077475 +0000 UTC m=+38.714617577" watchObservedRunningTime="2026-09-09 14:11:13.98856921 +0000 UTC m=+38.715109313"
Sep 09 14:11:14.483740 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:14.483706    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:14.604361 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:14.604325    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:14.960594 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:14.960561    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-w6lnf"]
Sep 09 14:11:14.990851 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:14.990810    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-wbt89"]
Sep 09 14:11:14.991355 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:14.990809    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-w6lnf"
Sep 09 14:11:14.994732 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:14.994706    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 09 14:11:14.995614 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:14.995584    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 09 14:11:14.995952 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:14.995936    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vv5sq\""
Sep 09 14:11:15.010675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.010650    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-w6lnf"]
Sep 09 14:11:15.010763 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.010684    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-wbt89"]
Sep 09 14:11:15.010812 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.010756    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:15.014149 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.014127    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 09 14:11:15.014285 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.014196    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 09 14:11:15.014352 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.014135    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 09 14:11:15.015013 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.014993    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 09 14:11:15.015105 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.014997    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kx5x8\""
Sep 09 14:11:15.018561 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.018543    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 09 14:11:15.065883 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.065850    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk"]
Sep 09 14:11:15.081009 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.080973    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gllc\" (UniqueName: \"kubernetes.io/projected/a0c3cd09-c929-4fe8-8508-0099cbb7e1db-kube-api-access-9gllc\") pod \"volume-data-source-validator-695c895bd6-w6lnf\" (UID: \"a0c3cd09-c929-4fe8-8508-0099cbb7e1db\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-w6lnf"
Sep 09 14:11:15.086796 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.086760    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq"]
Sep 09 14:11:15.086954 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.086894    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk"
Sep 09 14:11:15.089468 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.089436    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 09 14:11:15.089468 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.089456    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 09 14:11:15.089641 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.089493    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 09 14:11:15.089641 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.089433    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 09 14:11:15.089641 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.089523    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pj58n\""
Sep 09 14:11:15.110721 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.110700    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-rdvmw"]
Sep 09 14:11:15.110851 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.110838    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq"
Sep 09 14:11:15.113037 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.113017    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4cgc4\""
Sep 09 14:11:15.113319 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.113286    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 09 14:11:15.113319 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.113299    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 09 14:11:15.113319 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.113318    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 09 14:11:15.113554 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.113379    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 09 14:11:15.134825 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.134804    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.134825 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.134813    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-cd68d9db8-hbl96"]
Sep 09 14:11:15.137129 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.137110    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 09 14:11:15.137426 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.137257    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 14:11:15.137426 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.137331    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 09 14:11:15.137426 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.137333    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vmgtd\""
Sep 09 14:11:15.137426 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.137367    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 14:11:15.146244 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.146222    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 09 14:11:15.152863 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.152845    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk"]
Sep 09 14:11:15.152931 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.152872    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq"]
Sep 09 14:11:15.152931 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.152887    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-rdvmw"]
Sep 09 14:11:15.152931 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.152902    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-cd68d9db8-hbl96"]
Sep 09 14:11:15.153028 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.152959    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:15.155052 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.155026    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 09 14:11:15.155139 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.155036    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 09 14:11:15.155213 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.155192    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r8f54\""
Sep 09 14:11:15.155534 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.155509    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 14:11:15.155634 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.155576    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 14:11:15.155634 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.155583    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 09 14:11:15.155634 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.155604    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 09 14:11:15.166643 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.166621    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-t94zs"]
Sep 09 14:11:15.181940 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.181916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gllc\" (UniqueName: \"kubernetes.io/projected/a0c3cd09-c929-4fe8-8508-0099cbb7e1db-kube-api-access-9gllc\") pod \"volume-data-source-validator-695c895bd6-w6lnf\" (UID: \"a0c3cd09-c929-4fe8-8508-0099cbb7e1db\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-w6lnf"
Sep 09 14:11:15.182038 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.181944    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ee3ce3e-01df-4ee9-a69c-0a3c709a8117-trusted-ca\") pod \"console-operator-85b454874b-wbt89\" (UID: \"6ee3ce3e-01df-4ee9-a69c-0a3c709a8117\") " pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:15.182038 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.181964    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ee3ce3e-01df-4ee9-a69c-0a3c709a8117-config\") pod \"console-operator-85b454874b-wbt89\" (UID: \"6ee3ce3e-01df-4ee9-a69c-0a3c709a8117\") " pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:15.182038 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.181988    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/da8024d0-341a-4382-ac02-17fcdd053eaa-serving-cert\") pod \"service-ca-operator-859f94c4b-v57kq\" (UID: \"da8024d0-341a-4382-ac02-17fcdd053eaa\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq"
Sep 09 14:11:15.182259 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.182131    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ee3ce3e-01df-4ee9-a69c-0a3c709a8117-serving-cert\") pod \"console-operator-85b454874b-wbt89\" (UID: \"6ee3ce3e-01df-4ee9-a69c-0a3c709a8117\") " pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:15.182259 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.182165    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69326219-c4b6-4bfa-b215-8b1eaeb1cac4-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jj6kk\" (UID: \"69326219-c4b6-4bfa-b215-8b1eaeb1cac4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk"
Sep 09 14:11:15.182259 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.182218    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmxn7\" (UniqueName: \"kubernetes.io/projected/da8024d0-341a-4382-ac02-17fcdd053eaa-kube-api-access-qmxn7\") pod \"service-ca-operator-859f94c4b-v57kq\" (UID: \"da8024d0-341a-4382-ac02-17fcdd053eaa\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq"
Sep 09 14:11:15.182259 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.182249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf27r\" (UniqueName: \"kubernetes.io/projected/6ee3ce3e-01df-4ee9-a69c-0a3c709a8117-kube-api-access-nf27r\") pod \"console-operator-85b454874b-wbt89\" (UID: \"6ee3ce3e-01df-4ee9-a69c-0a3c709a8117\") " pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:15.182386 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.182276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69326219-c4b6-4bfa-b215-8b1eaeb1cac4-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jj6kk\" (UID: \"69326219-c4b6-4bfa-b215-8b1eaeb1cac4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk"
Sep 09 14:11:15.182386 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.182318    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsnqg\" (UniqueName: \"kubernetes.io/projected/69326219-c4b6-4bfa-b215-8b1eaeb1cac4-kube-api-access-fsnqg\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jj6kk\" (UID: \"69326219-c4b6-4bfa-b215-8b1eaeb1cac4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk"
Sep 09 14:11:15.182386 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.182342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/da8024d0-341a-4382-ac02-17fcdd053eaa-config\") pod \"service-ca-operator-859f94c4b-v57kq\" (UID: \"da8024d0-341a-4382-ac02-17fcdd053eaa\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq"
Sep 09 14:11:15.187001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.186979    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"]
Sep 09 14:11:15.187114 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.187098    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-t94zs"
Sep 09 14:11:15.189243 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.189223    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-jcsd4\""
Sep 09 14:11:15.192310 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.192287    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gllc\" (UniqueName: \"kubernetes.io/projected/a0c3cd09-c929-4fe8-8508-0099cbb7e1db-kube-api-access-9gllc\") pod \"volume-data-source-validator-695c895bd6-w6lnf\" (UID: \"a0c3cd09-c929-4fe8-8508-0099cbb7e1db\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-w6lnf"
Sep 09 14:11:15.205974 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.205952    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"]
Sep 09 14:11:15.206083 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.206072    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"
Sep 09 14:11:15.206849 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.206822    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:15.208386 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.208340    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 09 14:11:15.208386 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.208365    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 09 14:11:15.208386 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.208373    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dqxzr\""
Sep 09 14:11:15.208574 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.208393    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 09 14:11:15.234112 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.234087    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-t94zs"]
Sep 09 14:11:15.234112 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.234116    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"]
Sep 09 14:11:15.234263 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.234198    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:15.234263 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.234222    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"]
Sep 09 14:11:15.236484 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.236466    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 09 14:11:15.236895 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.236878    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nqc58\""
Sep 09 14:11:15.236988 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.236917    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 14:11:15.237047 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.237016    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 09 14:11:15.237047 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.237009    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 14:11:15.282678 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.282649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmxn7\" (UniqueName: \"kubernetes.io/projected/da8024d0-341a-4382-ac02-17fcdd053eaa-kube-api-access-qmxn7\") pod \"service-ca-operator-859f94c4b-v57kq\" (UID: \"da8024d0-341a-4382-ac02-17fcdd053eaa\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq"
Sep 09 14:11:15.282678 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.282685    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf27r\" (UniqueName: \"kubernetes.io/projected/6ee3ce3e-01df-4ee9-a69c-0a3c709a8117-kube-api-access-nf27r\") pod \"console-operator-85b454874b-wbt89\" (UID: \"6ee3ce3e-01df-4ee9-a69c-0a3c709a8117\") " pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:15.282881 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.282704    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/169c00d2-dfda-468c-8753-f18fdcf2d4e6-snapshots\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.282881 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.282727    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4jq9\" (UniqueName: \"kubernetes.io/projected/e82b314b-f0af-4e00-abf5-1991687d1ea0-kube-api-access-w4jq9\") pod \"cluster-samples-operator-7cdcfcf76c-rzpnp\" (UID: \"e82b314b-f0af-4e00-abf5-1991687d1ea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"
Sep 09 14:11:15.282881 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.282758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsnqg\" (UniqueName: \"kubernetes.io/projected/69326219-c4b6-4bfa-b215-8b1eaeb1cac4-kube-api-access-fsnqg\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jj6kk\" (UID: \"69326219-c4b6-4bfa-b215-8b1eaeb1cac4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk"
Sep 09 14:11:15.282881 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.282850    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/169c00d2-dfda-468c-8753-f18fdcf2d4e6-serving-cert\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.283007 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.282901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/169c00d2-dfda-468c-8753-f18fdcf2d4e6-tmp\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.283007 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.282924    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-stats-auth\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:15.283007 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.282943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/169c00d2-dfda-468c-8753-f18fdcf2d4e6-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.283093 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283006    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-default-certificate\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:15.283093 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rzpnp\" (UID: \"e82b314b-f0af-4e00-abf5-1991687d1ea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"
Sep 09 14:11:15.283093 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283082    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69326219-c4b6-4bfa-b215-8b1eaeb1cac4-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jj6kk\" (UID: \"69326219-c4b6-4bfa-b215-8b1eaeb1cac4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk"
Sep 09 14:11:15.283192 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283141    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:15.283228 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283190    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp8vl\" (UniqueName: \"kubernetes.io/projected/755fce16-cc81-4661-8e58-2fee5c71966f-kube-api-access-kp8vl\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:15.283228 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69326219-c4b6-4bfa-b215-8b1eaeb1cac4-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jj6kk\" (UID: \"69326219-c4b6-4bfa-b215-8b1eaeb1cac4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk"
Sep 09 14:11:15.283290 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/da8024d0-341a-4382-ac02-17fcdd053eaa-config\") pod \"service-ca-operator-859f94c4b-v57kq\" (UID: \"da8024d0-341a-4382-ac02-17fcdd053eaa\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq"
Sep 09 14:11:15.283290 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283275    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkxqr\" (UniqueName: \"kubernetes.io/projected/dd66efc5-c2bb-45f8-9c23-4dc7ea10f148-kube-api-access-xkxqr\") pod \"network-check-source-685456655f-t94zs\" (UID: \"dd66efc5-c2bb-45f8-9c23-4dc7ea10f148\") " pod="openshift-network-diagnostics/network-check-source-685456655f-t94zs"
Sep 09 14:11:15.283361 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283299    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:15.283361 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ee3ce3e-01df-4ee9-a69c-0a3c709a8117-trusted-ca\") pod \"console-operator-85b454874b-wbt89\" (UID: \"6ee3ce3e-01df-4ee9-a69c-0a3c709a8117\") " pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:15.283470 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283363    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ee3ce3e-01df-4ee9-a69c-0a3c709a8117-config\") pod \"console-operator-85b454874b-wbt89\" (UID: \"6ee3ce3e-01df-4ee9-a69c-0a3c709a8117\") " pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:15.283470 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283387    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/da8024d0-341a-4382-ac02-17fcdd053eaa-serving-cert\") pod \"service-ca-operator-859f94c4b-v57kq\" (UID: \"da8024d0-341a-4382-ac02-17fcdd053eaa\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq"
Sep 09 14:11:15.283470 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283420    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/169c00d2-dfda-468c-8753-f18fdcf2d4e6-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.283603 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ee3ce3e-01df-4ee9-a69c-0a3c709a8117-serving-cert\") pod \"console-operator-85b454874b-wbt89\" (UID: \"6ee3ce3e-01df-4ee9-a69c-0a3c709a8117\") " pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:15.283659 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhmhk\" (UniqueName: \"kubernetes.io/projected/169c00d2-dfda-468c-8753-f18fdcf2d4e6-kube-api-access-vhmhk\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.283943 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283898    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69326219-c4b6-4bfa-b215-8b1eaeb1cac4-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jj6kk\" (UID: \"69326219-c4b6-4bfa-b215-8b1eaeb1cac4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk"
Sep 09 14:11:15.284061 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.283942    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/da8024d0-341a-4382-ac02-17fcdd053eaa-config\") pod \"service-ca-operator-859f94c4b-v57kq\" (UID: \"da8024d0-341a-4382-ac02-17fcdd053eaa\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq"
Sep 09 14:11:15.284113 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.284098    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ee3ce3e-01df-4ee9-a69c-0a3c709a8117-config\") pod \"console-operator-85b454874b-wbt89\" (UID: \"6ee3ce3e-01df-4ee9-a69c-0a3c709a8117\") " pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:15.284342 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.284325    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ee3ce3e-01df-4ee9-a69c-0a3c709a8117-trusted-ca\") pod \"console-operator-85b454874b-wbt89\" (UID: \"6ee3ce3e-01df-4ee9-a69c-0a3c709a8117\") " pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:15.285898 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.285877    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69326219-c4b6-4bfa-b215-8b1eaeb1cac4-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jj6kk\" (UID: \"69326219-c4b6-4bfa-b215-8b1eaeb1cac4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk"
Sep 09 14:11:15.286001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.285880    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/da8024d0-341a-4382-ac02-17fcdd053eaa-serving-cert\") pod \"service-ca-operator-859f94c4b-v57kq\" (UID: \"da8024d0-341a-4382-ac02-17fcdd053eaa\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq"
Sep 09 14:11:15.286001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.285925    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ee3ce3e-01df-4ee9-a69c-0a3c709a8117-serving-cert\") pod \"console-operator-85b454874b-wbt89\" (UID: \"6ee3ce3e-01df-4ee9-a69c-0a3c709a8117\") " pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:15.295597 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.295568    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmxn7\" (UniqueName: \"kubernetes.io/projected/da8024d0-341a-4382-ac02-17fcdd053eaa-kube-api-access-qmxn7\") pod \"service-ca-operator-859f94c4b-v57kq\" (UID: \"da8024d0-341a-4382-ac02-17fcdd053eaa\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq"
Sep 09 14:11:15.296126 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.296085    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:15.296229 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.296081    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf27r\" (UniqueName: \"kubernetes.io/projected/6ee3ce3e-01df-4ee9-a69c-0a3c709a8117-kube-api-access-nf27r\") pod \"console-operator-85b454874b-wbt89\" (UID: \"6ee3ce3e-01df-4ee9-a69c-0a3c709a8117\") " pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:15.296285 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.296244    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsnqg\" (UniqueName: \"kubernetes.io/projected/69326219-c4b6-4bfa-b215-8b1eaeb1cac4-kube-api-access-fsnqg\") pod \"kube-storage-version-migrator-operator-8d7dd4675-jj6kk\" (UID: \"69326219-c4b6-4bfa-b215-8b1eaeb1cac4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk"
Sep 09 14:11:15.300993 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.300977    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-w6lnf"
Sep 09 14:11:15.319874 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.319857    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:15.370719 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.370214    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:15.384002 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.383968    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/169c00d2-dfda-468c-8753-f18fdcf2d4e6-snapshots\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.384160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.384009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4jq9\" (UniqueName: \"kubernetes.io/projected/e82b314b-f0af-4e00-abf5-1991687d1ea0-kube-api-access-w4jq9\") pod \"cluster-samples-operator-7cdcfcf76c-rzpnp\" (UID: \"e82b314b-f0af-4e00-abf5-1991687d1ea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"
Sep 09 14:11:15.384160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.384053    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/169c00d2-dfda-468c-8753-f18fdcf2d4e6-serving-cert\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.384160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.384084    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/169c00d2-dfda-468c-8753-f18fdcf2d4e6-tmp\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.384160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.384111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-stats-auth\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:15.384160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.384133    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/169c00d2-dfda-468c-8753-f18fdcf2d4e6-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.384441 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.384184    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-default-certificate\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:15.384441 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.384213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rzpnp\" (UID: \"e82b314b-f0af-4e00-abf5-1991687d1ea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"
Sep 09 14:11:15.384441 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.384260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-dlzvp\" (UID: \"78d7aa56-30f6-44a0-9fb2-c37ecc381b62\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:15.384441 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.384292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4h2m\" (UniqueName: \"kubernetes.io/projected/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-kube-api-access-q4h2m\") pod \"cluster-monitoring-operator-6cdcc96965-dlzvp\" (UID: \"78d7aa56-30f6-44a0-9fb2-c37ecc381b62\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:15.384441 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.384324    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:15.384441 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.384356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp8vl\" (UniqueName: \"kubernetes.io/projected/755fce16-cc81-4661-8e58-2fee5c71966f-kube-api-access-kp8vl\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:15.384441 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.384398    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkxqr\" (UniqueName: \"kubernetes.io/projected/dd66efc5-c2bb-45f8-9c23-4dc7ea10f148-kube-api-access-xkxqr\") pod \"network-check-source-685456655f-t94zs\" (UID: \"dd66efc5-c2bb-45f8-9c23-4dc7ea10f148\") " pod="openshift-network-diagnostics/network-check-source-685456655f-t94zs"
Sep 09 14:11:15.384441 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.384425    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:15.384780 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.384459    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-dlzvp\" (UID: \"78d7aa56-30f6-44a0-9fb2-c37ecc381b62\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:15.384780 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.384499    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/169c00d2-dfda-468c-8753-f18fdcf2d4e6-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.384780 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.384555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhmhk\" (UniqueName: \"kubernetes.io/projected/169c00d2-dfda-468c-8753-f18fdcf2d4e6-kube-api-access-vhmhk\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.386080 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:15.385545    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 14:11:15.386080 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:15.385629    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs podName:755fce16-cc81-4661-8e58-2fee5c71966f nodeName:}" failed. No retries permitted until 2026-09-09 14:11:15.885607121 +0000 UTC m=+40.612147218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs") pod "router-default-cd68d9db8-hbl96" (UID: "755fce16-cc81-4661-8e58-2fee5c71966f") : secret "router-metrics-certs-default" not found
Sep 09 14:11:15.386080 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.385677    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/169c00d2-dfda-468c-8753-f18fdcf2d4e6-snapshots\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.386080 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.385690    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/169c00d2-dfda-468c-8753-f18fdcf2d4e6-tmp\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.386080 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:15.385856    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle podName:755fce16-cc81-4661-8e58-2fee5c71966f nodeName:}" failed. No retries permitted until 2026-09-09 14:11:15.885801866 +0000 UTC m=+40.612341965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle") pod "router-default-cd68d9db8-hbl96" (UID: "755fce16-cc81-4661-8e58-2fee5c71966f") : configmap references non-existent config key: service-ca.crt
Sep 09 14:11:15.386080 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:15.385856    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 14:11:15.386080 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:15.385935    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls podName:e82b314b-f0af-4e00-abf5-1991687d1ea0 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:15.885922743 +0000 UTC m=+40.612462850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-rzpnp" (UID: "e82b314b-f0af-4e00-abf5-1991687d1ea0") : secret "samples-operator-tls" not found
Sep 09 14:11:15.386547 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.386203    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/169c00d2-dfda-468c-8753-f18fdcf2d4e6-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.386547 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.386450    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/169c00d2-dfda-468c-8753-f18fdcf2d4e6-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.388797 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.388771    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-stats-auth\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:15.388916 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.388779    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/169c00d2-dfda-468c-8753-f18fdcf2d4e6-serving-cert\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.389369 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.389323    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-default-certificate\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:15.395452 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.395423    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk"
Sep 09 14:11:15.399991 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.399943    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp8vl\" (UniqueName: \"kubernetes.io/projected/755fce16-cc81-4661-8e58-2fee5c71966f-kube-api-access-kp8vl\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:15.400750 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.400724    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4jq9\" (UniqueName: \"kubernetes.io/projected/e82b314b-f0af-4e00-abf5-1991687d1ea0-kube-api-access-w4jq9\") pod \"cluster-samples-operator-7cdcfcf76c-rzpnp\" (UID: \"e82b314b-f0af-4e00-abf5-1991687d1ea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"
Sep 09 14:11:15.411996 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.411965    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhmhk\" (UniqueName: \"kubernetes.io/projected/169c00d2-dfda-468c-8753-f18fdcf2d4e6-kube-api-access-vhmhk\") pod \"insights-operator-76bcd6ccf5-rdvmw\" (UID: \"169c00d2-dfda-468c-8753-f18fdcf2d4e6\") " pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.412098 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.412065    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkxqr\" (UniqueName: \"kubernetes.io/projected/dd66efc5-c2bb-45f8-9c23-4dc7ea10f148-kube-api-access-xkxqr\") pod \"network-check-source-685456655f-t94zs\" (UID: \"dd66efc5-c2bb-45f8-9c23-4dc7ea10f148\") " pod="openshift-network-diagnostics/network-check-source-685456655f-t94zs"
Sep 09 14:11:15.419738 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.419716    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq"
Sep 09 14:11:15.438429 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.438398    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:15.444248 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.444219    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw"
Sep 09 14:11:15.485081 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.485048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-dlzvp\" (UID: \"78d7aa56-30f6-44a0-9fb2-c37ecc381b62\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:15.485304 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.485276    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-dlzvp\" (UID: \"78d7aa56-30f6-44a0-9fb2-c37ecc381b62\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:15.485396 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.485327    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4h2m\" (UniqueName: \"kubernetes.io/projected/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-kube-api-access-q4h2m\") pod \"cluster-monitoring-operator-6cdcc96965-dlzvp\" (UID: \"78d7aa56-30f6-44a0-9fb2-c37ecc381b62\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:15.485508 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:15.485460    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 14:11:15.485580 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:15.485542    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls podName:78d7aa56-30f6-44a0-9fb2-c37ecc381b62 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:15.985520975 +0000 UTC m=+40.712061079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-dlzvp" (UID: "78d7aa56-30f6-44a0-9fb2-c37ecc381b62") : secret "cluster-monitoring-operator-tls" not found
Sep 09 14:11:15.485876 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.485855    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-dlzvp\" (UID: \"78d7aa56-30f6-44a0-9fb2-c37ecc381b62\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:15.494867 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.494779    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4h2m\" (UniqueName: \"kubernetes.io/projected/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-kube-api-access-q4h2m\") pod \"cluster-monitoring-operator-6cdcc96965-dlzvp\" (UID: \"78d7aa56-30f6-44a0-9fb2-c37ecc381b62\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:15.500754 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.500593    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-t94zs"
Sep 09 14:11:15.590649 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.590567    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-w6lnf"]
Sep 09 14:11:15.595404 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:15.595366    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c3cd09_c929_4fe8_8508_0099cbb7e1db.slice/crio-e298d475351d288b896e1b0cd4d67c0a2c12fb3acc4cf41c9bf950c3deeaf05b WatchSource:0}: Error finding container e298d475351d288b896e1b0cd4d67c0a2c12fb3acc4cf41c9bf950c3deeaf05b: Status 404 returned error can't find the container with id e298d475351d288b896e1b0cd4d67c0a2c12fb3acc4cf41c9bf950c3deeaf05b
Sep 09 14:11:15.612194 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.612158    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-wbt89"]
Sep 09 14:11:15.614687 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:15.614665    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee3ce3e_01df_4ee9_a69c_0a3c709a8117.slice/crio-408fa013f619359c4db0dc7882ec63a53ae76c6b3b5a189f273fa8c738d7492b WatchSource:0}: Error finding container 408fa013f619359c4db0dc7882ec63a53ae76c6b3b5a189f273fa8c738d7492b: Status 404 returned error can't find the container with id 408fa013f619359c4db0dc7882ec63a53ae76c6b3b5a189f273fa8c738d7492b
Sep 09 14:11:15.701676 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.701648    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk"]
Sep 09 14:11:15.704630 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:15.704603    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69326219_c4b6_4bfa_b215_8b1eaeb1cac4.slice/crio-a4ffd937327afd74769da52b4dd09d108fc13df469a8e167d5b67ff9d91bc69b WatchSource:0}: Error finding container a4ffd937327afd74769da52b4dd09d108fc13df469a8e167d5b67ff9d91bc69b: Status 404 returned error can't find the container with id a4ffd937327afd74769da52b4dd09d108fc13df469a8e167d5b67ff9d91bc69b
Sep 09 14:11:15.721400 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.721345    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq"]
Sep 09 14:11:15.723935 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:15.723909    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8024d0_341a_4382_ac02_17fcdd053eaa.slice/crio-fd7d362bdb5545d692339e4cc80005312c77a418c19b5aacc10917acfe11c3af WatchSource:0}: Error finding container fd7d362bdb5545d692339e4cc80005312c77a418c19b5aacc10917acfe11c3af: Status 404 returned error can't find the container with id fd7d362bdb5545d692339e4cc80005312c77a418c19b5aacc10917acfe11c3af
Sep 09 14:11:15.747755 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.747717    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-rdvmw"]
Sep 09 14:11:15.750067 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:15.750047    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod169c00d2_dfda_468c_8753_f18fdcf2d4e6.slice/crio-a190b22666b49f361fb91725d3853c5e0f6bf30cb88103cf33b88eebcbc4ce89 WatchSource:0}: Error finding container a190b22666b49f361fb91725d3853c5e0f6bf30cb88103cf33b88eebcbc4ce89: Status 404 returned error can't find the container with id a190b22666b49f361fb91725d3853c5e0f6bf30cb88103cf33b88eebcbc4ce89
Sep 09 14:11:15.778838 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.778812    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-t94zs"]
Sep 09 14:11:15.783683 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:15.783646    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd66efc5_c2bb_45f8_9c23_4dc7ea10f148.slice/crio-b1e24c0c5766feb33eaf4e0b18327ecd3df7076aebb6240346ae0b54ad6bcc21 WatchSource:0}: Error finding container b1e24c0c5766feb33eaf4e0b18327ecd3df7076aebb6240346ae0b54ad6bcc21: Status 404 returned error can't find the container with id b1e24c0c5766feb33eaf4e0b18327ecd3df7076aebb6240346ae0b54ad6bcc21
Sep 09 14:11:15.888348 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.888305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:15.888531 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.888362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:15.888531 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.888473    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rzpnp\" (UID: \"e82b314b-f0af-4e00-abf5-1991687d1ea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"
Sep 09 14:11:15.888531 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:15.888506    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle podName:755fce16-cc81-4661-8e58-2fee5c71966f nodeName:}" failed. No retries permitted until 2026-09-09 14:11:16.888483046 +0000 UTC m=+41.615023153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle") pod "router-default-cd68d9db8-hbl96" (UID: "755fce16-cc81-4661-8e58-2fee5c71966f") : configmap references non-existent config key: service-ca.crt
Sep 09 14:11:15.888531 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:15.888528    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 14:11:15.888720 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:15.888558    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 14:11:15.888720 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:15.888569    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs podName:755fce16-cc81-4661-8e58-2fee5c71966f nodeName:}" failed. No retries permitted until 2026-09-09 14:11:16.888558753 +0000 UTC m=+41.615098853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs") pod "router-default-cd68d9db8-hbl96" (UID: "755fce16-cc81-4661-8e58-2fee5c71966f") : secret "router-metrics-certs-default" not found
Sep 09 14:11:15.888720 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:15.888615    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls podName:e82b314b-f0af-4e00-abf5-1991687d1ea0 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:16.888594075 +0000 UTC m=+41.615134186 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-rzpnp" (UID: "e82b314b-f0af-4e00-abf5-1991687d1ea0") : secret "samples-operator-tls" not found
Sep 09 14:11:15.978559 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.978466    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-t94zs" event={"ID":"dd66efc5-c2bb-45f8-9c23-4dc7ea10f148","Type":"ContainerStarted","Data":"b1e24c0c5766feb33eaf4e0b18327ecd3df7076aebb6240346ae0b54ad6bcc21"}
Sep 09 14:11:15.979535 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.979498    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq" event={"ID":"da8024d0-341a-4382-ac02-17fcdd053eaa","Type":"ContainerStarted","Data":"fd7d362bdb5545d692339e4cc80005312c77a418c19b5aacc10917acfe11c3af"}
Sep 09 14:11:15.980527 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.980503    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk" event={"ID":"69326219-c4b6-4bfa-b215-8b1eaeb1cac4","Type":"ContainerStarted","Data":"a4ffd937327afd74769da52b4dd09d108fc13df469a8e167d5b67ff9d91bc69b"}
Sep 09 14:11:15.981593 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.981567    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-wbt89" event={"ID":"6ee3ce3e-01df-4ee9-a69c-0a3c709a8117","Type":"ContainerStarted","Data":"408fa013f619359c4db0dc7882ec63a53ae76c6b3b5a189f273fa8c738d7492b"}
Sep 09 14:11:15.982640 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.982616    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw" event={"ID":"169c00d2-dfda-468c-8753-f18fdcf2d4e6","Type":"ContainerStarted","Data":"a190b22666b49f361fb91725d3853c5e0f6bf30cb88103cf33b88eebcbc4ce89"}
Sep 09 14:11:15.983598 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.983580    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-w6lnf" event={"ID":"a0c3cd09-c929-4fe8-8508-0099cbb7e1db","Type":"ContainerStarted","Data":"e298d475351d288b896e1b0cd4d67c0a2c12fb3acc4cf41c9bf950c3deeaf05b"}
Sep 09 14:11:15.988940 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:15.988916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-dlzvp\" (UID: \"78d7aa56-30f6-44a0-9fb2-c37ecc381b62\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:15.989071 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:15.989057    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 14:11:15.989125 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:15.989116    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls podName:78d7aa56-30f6-44a0-9fb2-c37ecc381b62 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:16.989099102 +0000 UTC m=+41.715639197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-dlzvp" (UID: "78d7aa56-30f6-44a0-9fb2-c37ecc381b62") : secret "cluster-monitoring-operator-tls" not found
Sep 09 14:11:16.897935 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:16.897865    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rzpnp\" (UID: \"e82b314b-f0af-4e00-abf5-1991687d1ea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"
Sep 09 14:11:16.898440 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:16.897945    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:16.898440 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:16.897988    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:16.898440 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:16.898151    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 14:11:16.898440 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:16.898226    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs podName:755fce16-cc81-4661-8e58-2fee5c71966f nodeName:}" failed. No retries permitted until 2026-09-09 14:11:18.898207245 +0000 UTC m=+43.624747341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs") pod "router-default-cd68d9db8-hbl96" (UID: "755fce16-cc81-4661-8e58-2fee5c71966f") : secret "router-metrics-certs-default" not found
Sep 09 14:11:16.898686 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:16.898624    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 14:11:16.898686 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:16.898674    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls podName:e82b314b-f0af-4e00-abf5-1991687d1ea0 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:18.89865973 +0000 UTC m=+43.625199827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-rzpnp" (UID: "e82b314b-f0af-4e00-abf5-1991687d1ea0") : secret "samples-operator-tls" not found
Sep 09 14:11:16.898906 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:16.898705    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle podName:755fce16-cc81-4661-8e58-2fee5c71966f nodeName:}" failed. No retries permitted until 2026-09-09 14:11:18.898693166 +0000 UTC m=+43.625233249 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle") pod "router-default-cd68d9db8-hbl96" (UID: "755fce16-cc81-4661-8e58-2fee5c71966f") : configmap references non-existent config key: service-ca.crt
Sep 09 14:11:16.998569 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:16.998524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:16.998569 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:16.998557    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:16.998819 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:16.998599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-dlzvp\" (UID: \"78d7aa56-30f6-44a0-9fb2-c37ecc381b62\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:16.998819 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:16.998715    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 14:11:16.998819 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:16.998770    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls podName:78d7aa56-30f6-44a0-9fb2-c37ecc381b62 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:18.998752244 +0000 UTC m=+43.725292329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-dlzvp" (UID: "78d7aa56-30f6-44a0-9fb2-c37ecc381b62") : secret "cluster-monitoring-operator-tls" not found
Sep 09 14:11:16.999239 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:16.999107    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 14:11:16.999239 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:16.999137    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65df65b68f-5q84h: secret "image-registry-tls" not found
Sep 09 14:11:16.999239 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:16.999160    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 14:11:16.999239 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:16.999225    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls podName:f692545a-25d0-42aa-acaa-57d3c20c4ac9 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:24.999209656 +0000 UTC m=+49.725749741 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls") pod "dns-default-4w2mf" (UID: "f692545a-25d0-42aa-acaa-57d3c20c4ac9") : secret "dns-default-metrics-tls" not found
Sep 09 14:11:16.999500 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:16.999249    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls podName:67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:24.999239421 +0000 UTC m=+49.725779503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls") pod "image-registry-65df65b68f-5q84h" (UID: "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40") : secret "image-registry-tls" not found
Sep 09 14:11:17.532012 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:17.531971    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:18.916443 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:18.916408    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:18.916907 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:18.916531    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 14:11:18.916907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:18.916547    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rzpnp\" (UID: \"e82b314b-f0af-4e00-abf5-1991687d1ea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"
Sep 09 14:11:18.916907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:18.916602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:18.916907 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:18.916690    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs podName:755fce16-cc81-4661-8e58-2fee5c71966f nodeName:}" failed. No retries permitted until 2026-09-09 14:11:22.916660222 +0000 UTC m=+47.643200317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs") pod "router-default-cd68d9db8-hbl96" (UID: "755fce16-cc81-4661-8e58-2fee5c71966f") : secret "router-metrics-certs-default" not found
Sep 09 14:11:18.916907 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:18.916709    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 14:11:18.916907 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:18.916737    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle podName:755fce16-cc81-4661-8e58-2fee5c71966f nodeName:}" failed. No retries permitted until 2026-09-09 14:11:22.916723085 +0000 UTC m=+47.643263165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle") pod "router-default-cd68d9db8-hbl96" (UID: "755fce16-cc81-4661-8e58-2fee5c71966f") : configmap references non-existent config key: service-ca.crt
Sep 09 14:11:18.916907 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:18.916775    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls podName:e82b314b-f0af-4e00-abf5-1991687d1ea0 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:22.916758151 +0000 UTC m=+47.643298251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-rzpnp" (UID: "e82b314b-f0af-4e00-abf5-1991687d1ea0") : secret "samples-operator-tls" not found
Sep 09 14:11:19.017290 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:19.017255    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-dlzvp\" (UID: \"78d7aa56-30f6-44a0-9fb2-c37ecc381b62\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:19.017487 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:19.017393    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 14:11:19.017487 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:19.017477    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls podName:78d7aa56-30f6-44a0-9fb2-c37ecc381b62 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:23.017457922 +0000 UTC m=+47.743998016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-dlzvp" (UID: "78d7aa56-30f6-44a0-9fb2-c37ecc381b62") : secret "cluster-monitoring-operator-tls" not found
Sep 09 14:11:22.956060 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:22.956008    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rzpnp\" (UID: \"e82b314b-f0af-4e00-abf5-1991687d1ea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"
Sep 09 14:11:22.956568 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:22.956089    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:22.956568 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:22.956130    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:22.956568 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:22.956278    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 14:11:22.956568 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:22.956341    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs podName:755fce16-cc81-4661-8e58-2fee5c71966f nodeName:}" failed. No retries permitted until 2026-09-09 14:11:30.956322207 +0000 UTC m=+55.682862290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs") pod "router-default-cd68d9db8-hbl96" (UID: "755fce16-cc81-4661-8e58-2fee5c71966f") : secret "router-metrics-certs-default" not found
Sep 09 14:11:22.956778 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:22.956737    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 14:11:22.956778 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:22.956777    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls podName:e82b314b-f0af-4e00-abf5-1991687d1ea0 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:30.956764266 +0000 UTC m=+55.683304348 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-rzpnp" (UID: "e82b314b-f0af-4e00-abf5-1991687d1ea0") : secret "samples-operator-tls" not found
Sep 09 14:11:22.956884 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:22.956840    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle podName:755fce16-cc81-4661-8e58-2fee5c71966f nodeName:}" failed. No retries permitted until 2026-09-09 14:11:30.956830168 +0000 UTC m=+55.683370253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle") pod "router-default-cd68d9db8-hbl96" (UID: "755fce16-cc81-4661-8e58-2fee5c71966f") : configmap references non-existent config key: service-ca.crt
Sep 09 14:11:23.008090 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.008025    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-t94zs" event={"ID":"dd66efc5-c2bb-45f8-9c23-4dc7ea10f148","Type":"ContainerStarted","Data":"2039a40b2bc078f6c47e5d4d3a32b5524564e432b855af4e40a955392e0f84b3"}
Sep 09 14:11:23.010220 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.010193    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq" event={"ID":"da8024d0-341a-4382-ac02-17fcdd053eaa","Type":"ContainerStarted","Data":"355e2e130da1ae85a0c741f468cd7c853589b6d06491a45d77d466b8a8558ad5"}
Sep 09 14:11:23.011854 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.011826    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk" event={"ID":"69326219-c4b6-4bfa-b215-8b1eaeb1cac4","Type":"ContainerStarted","Data":"0326aa327d21c40748c39287e50f07b3e24e5315084630bbdc2497066314bf5c"}
Sep 09 14:11:23.013671 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.013645    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/0.log"
Sep 09 14:11:23.013793 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.013677    2562 generic.go:356] "Generic (PLEG): container finished" podID="6ee3ce3e-01df-4ee9-a69c-0a3c709a8117" containerID="d09d073e99547228a1fa613702935cf081113d5be74341511a32cd4070951182" exitCode=255
Sep 09 14:11:23.013793 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.013765    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-wbt89" event={"ID":"6ee3ce3e-01df-4ee9-a69c-0a3c709a8117","Type":"ContainerDied","Data":"d09d073e99547228a1fa613702935cf081113d5be74341511a32cd4070951182"}
Sep 09 14:11:23.013940 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.013921    2562 scope.go:117] "RemoveContainer" containerID="d09d073e99547228a1fa613702935cf081113d5be74341511a32cd4070951182"
Sep 09 14:11:23.017228 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.017203    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw" event={"ID":"169c00d2-dfda-468c-8753-f18fdcf2d4e6","Type":"ContainerStarted","Data":"3388d2b6f84f239be879b1921059c3844e07d3d5a21b4ae5da32c16ecde43baf"}
Sep 09 14:11:23.019055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.019012    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-w6lnf" event={"ID":"a0c3cd09-c929-4fe8-8508-0099cbb7e1db","Type":"ContainerStarted","Data":"05962555132bccca1f83320716d588a1ed5f4c01632019f2ed6ac73ec2deccd2"}
Sep 09 14:11:23.022745 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.022704    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-t94zs" podStartSLOduration=1.405976937 podStartE2EDuration="8.022691006s" totalImagesPullingTime="6.616714069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:23.021875567 +0000 UTC m=+47.748415670" watchObservedRunningTime="2026-09-09 14:11:23.022691006 +0000 UTC m=+47.749231105"
Sep 09 14:11:23.036420 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.036378    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-w6lnf" podStartSLOduration=2.620152164 podStartE2EDuration="9.036361946s" totalImagesPullingTime="6.416209782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:23.035511402 +0000 UTC m=+47.762051505" watchObservedRunningTime="2026-09-09 14:11:23.036361946 +0000 UTC m=+47.762902055"
Sep 09 14:11:23.058033 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.058002    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-dlzvp\" (UID: \"78d7aa56-30f6-44a0-9fb2-c37ecc381b62\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:23.058239 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:23.058222    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 14:11:23.058316 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:23.058301    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls podName:78d7aa56-30f6-44a0-9fb2-c37ecc381b62 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:31.058282952 +0000 UTC m=+55.784823037 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-dlzvp" (UID: "78d7aa56-30f6-44a0-9fb2-c37ecc381b62") : secret "cluster-monitoring-operator-tls" not found
Sep 09 14:11:23.089148 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.089085    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw" podStartSLOduration=1.80484253 podStartE2EDuration="8.089066699s" totalImagesPullingTime="6.284224169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:23.088429242 +0000 UTC m=+47.814969347" watchObservedRunningTime="2026-09-09 14:11:23.089066699 +0000 UTC m=+47.815606801"
Sep 09 14:11:23.089862 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.089817    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk" podStartSLOduration=1.760399183 podStartE2EDuration="8.089805523s" totalImagesPullingTime="6.32940634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:23.069234202 +0000 UTC m=+47.795774306" watchObservedRunningTime="2026-09-09 14:11:23.089805523 +0000 UTC m=+47.816345627"
Sep 09 14:11:23.102709 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.102665    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq" podStartSLOduration=1.7865990859999998 podStartE2EDuration="8.102647696s" totalImagesPullingTime="6.31604861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:23.101998665 +0000 UTC m=+47.828538768" watchObservedRunningTime="2026-09-09 14:11:23.102647696 +0000 UTC m=+47.829187795"
Sep 09 14:11:23.130528 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.130497    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:23.205136 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.205107    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b2rhm"]
Sep 09 14:11:23.208208 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.208125    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:23.225158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.225137    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b2rhm"
Sep 09 14:11:23.227574 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.225034    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b2rhm"]
Sep 09 14:11:23.228087 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.227921    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-gwtbr\""
Sep 09 14:11:23.229258 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.228015    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 09 14:11:23.229258 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.229091    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 09 14:11:23.276406 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.276380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:23.362388 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.362361    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttt54\" (UniqueName: \"kubernetes.io/projected/2e6b02e2-28ae-4caa-a679-0a6b0884a2db-kube-api-access-ttt54\") pod \"migrator-fdbb8fdff-b2rhm\" (UID: \"2e6b02e2-28ae-4caa-a679-0a6b0884a2db\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b2rhm"
Sep 09 14:11:23.385432 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.385407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:23.463190 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.463111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttt54\" (UniqueName: \"kubernetes.io/projected/2e6b02e2-28ae-4caa-a679-0a6b0884a2db-kube-api-access-ttt54\") pod \"migrator-fdbb8fdff-b2rhm\" (UID: \"2e6b02e2-28ae-4caa-a679-0a6b0884a2db\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b2rhm"
Sep 09 14:11:23.470726 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.470701    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttt54\" (UniqueName: \"kubernetes.io/projected/2e6b02e2-28ae-4caa-a679-0a6b0884a2db-kube-api-access-ttt54\") pod \"migrator-fdbb8fdff-b2rhm\" (UID: \"2e6b02e2-28ae-4caa-a679-0a6b0884a2db\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b2rhm"
Sep 09 14:11:23.581952 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.581921    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b2rhm"
Sep 09 14:11:23.713465 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.713387    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:23.814048 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.814003    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:23.878154 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.878126    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b2rhm"]
Sep 09 14:11:23.881002 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:23.880976    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6b02e2_28ae_4caa_a679_0a6b0884a2db.slice/crio-29d33cbad4e1831dee1b2bfbaa053e0567a3ef6057dd52d00479e93426a7590b WatchSource:0}: Error finding container 29d33cbad4e1831dee1b2bfbaa053e0567a3ef6057dd52d00479e93426a7590b: Status 404 returned error can't find the container with id 29d33cbad4e1831dee1b2bfbaa053e0567a3ef6057dd52d00479e93426a7590b
Sep 09 14:11:23.881569 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:23.881524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:24.024294 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.024194    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b2rhm" event={"ID":"2e6b02e2-28ae-4caa-a679-0a6b0884a2db","Type":"ContainerStarted","Data":"29d33cbad4e1831dee1b2bfbaa053e0567a3ef6057dd52d00479e93426a7590b"}
Sep 09 14:11:24.025815 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.025788    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:11:24.026227 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.026212    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/0.log"
Sep 09 14:11:24.026280 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.026245    2562 generic.go:356] "Generic (PLEG): container finished" podID="6ee3ce3e-01df-4ee9-a69c-0a3c709a8117" containerID="7fe6d21c186614174e33b7a5c8cbc850f285639ab4334cae63fe6f527d4fe125" exitCode=255
Sep 09 14:11:24.026376 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.026355    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-wbt89" event={"ID":"6ee3ce3e-01df-4ee9-a69c-0a3c709a8117","Type":"ContainerDied","Data":"7fe6d21c186614174e33b7a5c8cbc850f285639ab4334cae63fe6f527d4fe125"}
Sep 09 14:11:24.026443 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.026407    2562 scope.go:117] "RemoveContainer" containerID="d09d073e99547228a1fa613702935cf081113d5be74341511a32cd4070951182"
Sep 09 14:11:24.026658 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.026627    2562 scope.go:117] "RemoveContainer" containerID="7fe6d21c186614174e33b7a5c8cbc850f285639ab4334cae63fe6f527d4fe125"
Sep 09 14:11:24.026824 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:24.026805    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-wbt89_openshift-console-operator(6ee3ce3e-01df-4ee9-a69c-0a3c709a8117)\"" pod="openshift-console-operator/console-operator-85b454874b-wbt89" podUID="6ee3ce3e-01df-4ee9-a69c-0a3c709a8117"
Sep 09 14:11:24.073476 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.073439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:24.133833 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.133774    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:24.255928 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.255892    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gvhz4"]
Sep 09 14:11:24.283754 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.283660    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gvhz4"]
Sep 09 14:11:24.283754 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.283719    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:24.283966 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.283877    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:24.285750 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.285729    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 14:11:24.285750 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.285740    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 14:11:24.285927 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.285741    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rghsj\""
Sep 09 14:11:24.342148 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.342120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:24.473751 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.473722    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:24.473870 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.473754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e192feb-9db9-49fb-ad44-193782cc8ca9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:24.473870 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.473783    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vd9j\" (UniqueName: \"kubernetes.io/projected/6e192feb-9db9-49fb-ad44-193782cc8ca9-kube-api-access-9vd9j\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:24.473870 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.473830    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e192feb-9db9-49fb-ad44-193782cc8ca9-crio-socket\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:24.473870 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.473863    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e192feb-9db9-49fb-ad44-193782cc8ca9-data-volume\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:24.531621 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.531592    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:24.574438 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.574412    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:24.574546 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.574444    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e192feb-9db9-49fb-ad44-193782cc8ca9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:24.574546 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.574477    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vd9j\" (UniqueName: \"kubernetes.io/projected/6e192feb-9db9-49fb-ad44-193782cc8ca9-kube-api-access-9vd9j\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:24.574546 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.574495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e192feb-9db9-49fb-ad44-193782cc8ca9-crio-socket\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:24.574675 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:24.574544    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 14:11:24.574675 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:24.574563    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:24.574675 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:24.574607    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e192feb-9db9-49fb-ad44-193782cc8ca9-kube-rbac-proxy-cm podName:6e192feb-9db9-49fb-ad44-193782cc8ca9 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:25.07459313 +0000 UTC m=+49.801133223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e192feb-9db9-49fb-ad44-193782cc8ca9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gvhz4" (UID: "6e192feb-9db9-49fb-ad44-193782cc8ca9") : configmap "kube-rbac-proxy" not found
Sep 09 14:11:24.574675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.574605    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e192feb-9db9-49fb-ad44-193782cc8ca9-data-volume\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:24.574675 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:24.574622    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls podName:6e192feb-9db9-49fb-ad44-193782cc8ca9 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:25.074615388 +0000 UTC m=+49.801155467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gvhz4" (UID: "6e192feb-9db9-49fb-ad44-193782cc8ca9") : secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:24.574675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.574655    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e192feb-9db9-49fb-ad44-193782cc8ca9-crio-socket\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:24.574949 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.574881    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e192feb-9db9-49fb-ad44-193782cc8ca9-data-volume\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:24.582145 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.582125    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vd9j\" (UniqueName: \"kubernetes.io/projected/6e192feb-9db9-49fb-ad44-193782cc8ca9-kube-api-access-9vd9j\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:24.600367 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:24.600340    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:25.034117 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:25.034046    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:11:25.034570 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:25.034430    2562 scope.go:117] "RemoveContainer" containerID="7fe6d21c186614174e33b7a5c8cbc850f285639ab4334cae63fe6f527d4fe125"
Sep 09 14:11:25.034656 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:25.034634    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-wbt89_openshift-console-operator(6ee3ce3e-01df-4ee9-a69c-0a3c709a8117)\"" pod="openshift-console-operator/console-operator-85b454874b-wbt89" podUID="6ee3ce3e-01df-4ee9-a69c-0a3c709a8117"
Sep 09 14:11:25.080098 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:25.080058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:25.080284 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:25.080106    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e192feb-9db9-49fb-ad44-193782cc8ca9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:25.080284 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:25.080243    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:25.080392 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:25.080279    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:25.080392 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:25.080329    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls podName:6e192feb-9db9-49fb-ad44-193782cc8ca9 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:26.080309227 +0000 UTC m=+50.806849322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gvhz4" (UID: "6e192feb-9db9-49fb-ad44-193782cc8ca9") : secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:25.080392 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:25.080355    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:25.080392 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:25.080382    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 14:11:25.080592 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:25.080423    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls podName:f692545a-25d0-42aa-acaa-57d3c20c4ac9 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:41.080411994 +0000 UTC m=+65.806952089 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls") pod "dns-default-4w2mf" (UID: "f692545a-25d0-42aa-acaa-57d3c20c4ac9") : secret "dns-default-metrics-tls" not found
Sep 09 14:11:25.080592 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:25.080243    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 14:11:25.080592 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:25.080500    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 14:11:25.080592 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:25.080513    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65df65b68f-5q84h: secret "image-registry-tls" not found
Sep 09 14:11:25.080592 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:25.080529    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e192feb-9db9-49fb-ad44-193782cc8ca9-kube-rbac-proxy-cm podName:6e192feb-9db9-49fb-ad44-193782cc8ca9 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:26.080506593 +0000 UTC m=+50.807046690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6e192feb-9db9-49fb-ad44-193782cc8ca9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gvhz4" (UID: "6e192feb-9db9-49fb-ad44-193782cc8ca9") : configmap "kube-rbac-proxy" not found
Sep 09 14:11:25.080592 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:25.080552    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls podName:67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:41.080540205 +0000 UTC m=+65.807080289 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls") pod "image-registry-65df65b68f-5q84h" (UID: "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40") : secret "image-registry-tls" not found
Sep 09 14:11:25.320436 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:25.320407    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:25.320572 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:25.320492    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:25.552674 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:25.552640    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:26.039334 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:26.039258    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b2rhm" event={"ID":"2e6b02e2-28ae-4caa-a679-0a6b0884a2db","Type":"ContainerStarted","Data":"31fa44377af01a90c4e0206bb3a06bd218deda8fcfb8c46795a7514fb5fe2c5b"}
Sep 09 14:11:26.039334 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:26.039308    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b2rhm" event={"ID":"2e6b02e2-28ae-4caa-a679-0a6b0884a2db","Type":"ContainerStarted","Data":"e1fb6243b20ba4d5cf9bb0400540c42723d30e67bd18aab080bfa7b550c4b3ce"}
Sep 09 14:11:26.039711 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:26.039557    2562 scope.go:117] "RemoveContainer" containerID="7fe6d21c186614174e33b7a5c8cbc850f285639ab4334cae63fe6f527d4fe125"
Sep 09 14:11:26.039711 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:26.039691    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-wbt89_openshift-console-operator(6ee3ce3e-01df-4ee9-a69c-0a3c709a8117)\"" pod="openshift-console-operator/console-operator-85b454874b-wbt89" podUID="6ee3ce3e-01df-4ee9-a69c-0a3c709a8117"
Sep 09 14:11:26.058638 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:26.058595    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-b2rhm" podStartSLOduration=1.460971802 podStartE2EDuration="3.05858065s" totalImagesPullingTime="1.597608848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:26.057648563 +0000 UTC m=+50.784188669" watchObservedRunningTime="2026-09-09 14:11:26.05858065 +0000 UTC m=+50.785120785"
Sep 09 14:11:26.088182 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:26.088021    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:26.088476 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:26.088454    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e192feb-9db9-49fb-ad44-193782cc8ca9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:26.088651 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:26.088483    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:26.088651 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:26.088561    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls podName:6e192feb-9db9-49fb-ad44-193782cc8ca9 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:28.088541871 +0000 UTC m=+52.815081965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gvhz4" (UID: "6e192feb-9db9-49fb-ad44-193782cc8ca9") : secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:26.090739 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:26.090711    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e192feb-9db9-49fb-ad44-193782cc8ca9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:26.144337 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:26.144308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:26.245256 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:26.245220    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:26.825607 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:26.825583    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qb5mh_ff4bddfd-4a5d-48a4-a767-3a2a114b2a73/dns-node-resolver/0.log"
Sep 09 14:11:27.226269 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:27.226157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:27.625848 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:27.625819    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f26x4_e92fae6c-046f-4d03-86a4-76c97d721a66/node-ca/0.log"
Sep 09 14:11:28.104647 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:28.104609    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:28.104836 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:28.104766    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:28.104836 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:28.104830    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls podName:6e192feb-9db9-49fb-ad44-193782cc8ca9 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:32.104814112 +0000 UTC m=+56.831354192 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gvhz4" (UID: "6e192feb-9db9-49fb-ad44-193782cc8ca9") : secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:28.358246 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:28.358146    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:28.428602 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:28.428576    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g6g92_e92f8856-f50c-4c13-b7d0-d9c4c5038953/serve-healthcheck-canary/0.log"
Sep 09 14:11:28.470542 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:28.470506    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:28.626296 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:28.626220    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-b2rhm_2e6b02e2-28ae-4caa-a679-0a6b0884a2db/migrator/0.log"
Sep 09 14:11:28.827291 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:28.827260    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-b2rhm_2e6b02e2-28ae-4caa-a679-0a6b0884a2db/graceful-termination/0.log"
Sep 09 14:11:29.028413 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:29.028333    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-jj6kk_69326219-c4b6-4bfa-b215-8b1eaeb1cac4/kube-storage-version-migrator-operator/0.log"
Sep 09 14:11:30.346452 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:30.346420    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:30.446530 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:30.446493    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:30.790618 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:30.790532    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:30.890964 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:30.890924    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:31.007813 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:31.007771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:31.030932 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:31.030901    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:31.031066 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:31.031048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rzpnp\" (UID: \"e82b314b-f0af-4e00-abf5-1991687d1ea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"
Sep 09 14:11:31.031107 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:31.031049    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 14:11:31.031139 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:31.031087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:31.031139 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:31.031086    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 14:11:31.031216 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:31.031144    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs podName:755fce16-cc81-4661-8e58-2fee5c71966f nodeName:}" failed. No retries permitted until 2026-09-09 14:11:47.031129105 +0000 UTC m=+71.757669204 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs") pod "router-default-cd68d9db8-hbl96" (UID: "755fce16-cc81-4661-8e58-2fee5c71966f") : secret "router-metrics-certs-default" not found
Sep 09 14:11:31.031216 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:31.031161    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle podName:755fce16-cc81-4661-8e58-2fee5c71966f nodeName:}" failed. No retries permitted until 2026-09-09 14:11:47.03115413 +0000 UTC m=+71.757694209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle") pod "router-default-cd68d9db8-hbl96" (UID: "755fce16-cc81-4661-8e58-2fee5c71966f") : configmap references non-existent config key: service-ca.crt
Sep 09 14:11:31.031216 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:31.031206    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls podName:e82b314b-f0af-4e00-abf5-1991687d1ea0 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:47.031190604 +0000 UTC m=+71.757730689 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-rzpnp" (UID: "e82b314b-f0af-4e00-abf5-1991687d1ea0") : secret "samples-operator-tls" not found
Sep 09 14:11:31.110317 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:31.110265    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:31.131658 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:31.131624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-dlzvp\" (UID: \"78d7aa56-30f6-44a0-9fb2-c37ecc381b62\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:31.131808 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:31.131732    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 14:11:31.131808 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:31.131795    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls podName:78d7aa56-30f6-44a0-9fb2-c37ecc381b62 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:47.131780544 +0000 UTC m=+71.858320640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-dlzvp" (UID: "78d7aa56-30f6-44a0-9fb2-c37ecc381b62") : secret "cluster-monitoring-operator-tls" not found
Sep 09 14:11:31.298804 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:31.298757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:31.492997 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:31.492914    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:32.139834 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:32.139802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:32.140008 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:32.139922    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:32.140008 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:11:32.139976    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls podName:6e192feb-9db9-49fb-ad44-193782cc8ca9 nodeName:}" failed. No retries permitted until 2026-09-09 14:11:40.13996264 +0000 UTC m=+64.866502723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gvhz4" (UID: "6e192feb-9db9-49fb-ad44-193782cc8ca9") : secret "insights-runtime-extractor-tls" not found
Sep 09 14:11:32.484430 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:32.484361    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:32.891223 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:32.891152    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:33.088604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:33.088575    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:33.786405 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:33.786371    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:33.887347 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:33.887315    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:33.941604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:33.941582    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgbdd"
Sep 09 14:11:33.990456 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:33.990421    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:34.322018 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:34.321978    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:34.490527 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:34.490497    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:34.706089 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:34.706009    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:34.824747 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:34.824710    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:35.122488 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:35.122437    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:35.752806 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:35.752771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:35.886588 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:35.886526    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:36.525688 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:36.525648    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:36.691222 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:36.691178    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:36.976803 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:36.976757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:37.099484 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:37.099453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:37.304924 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:37.304888    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:37.700350 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:37.700249    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:38.319601 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:38.319540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:38.679631 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:38.679552    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:39.109580 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:39.109543    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:39.219373 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:39.219334    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:39.291995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:39.291943    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:39.890391 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:39.890357    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:40.209960 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:40.209879    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:40.212104 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:40.212084    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e192feb-9db9-49fb-ad44-193782cc8ca9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gvhz4\" (UID: \"6e192feb-9db9-49fb-ad44-193782cc8ca9\") " pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:40.495354 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:40.495272    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rghsj\""
Sep 09 14:11:40.502104 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:40.502068    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:40.503840 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:40.503823    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gvhz4"
Sep 09 14:11:40.692735 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:40.692700    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:40.787375 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:40.787312    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gvhz4"]
Sep 09 14:11:40.790352 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:40.790327    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e192feb_9db9_49fb_ad44_193782cc8ca9.slice/crio-0aa055cf360ff3f54a9e8cc1c8a18bcd54f215a6ce3840d879f23a1e7b6eee8d WatchSource:0}: Error finding container 0aa055cf360ff3f54a9e8cc1c8a18bcd54f215a6ce3840d879f23a1e7b6eee8d: Status 404 returned error can't find the container with id 0aa055cf360ff3f54a9e8cc1c8a18bcd54f215a6ce3840d879f23a1e7b6eee8d
Sep 09 14:11:40.913049 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:40.913015    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:41.083656 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.083619    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:41.085075 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.085054    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gvhz4" event={"ID":"6e192feb-9db9-49fb-ad44-193782cc8ca9","Type":"ContainerStarted","Data":"3cc02fe13cdc06a884229c32b15d5cc1371c0e025add525de03c0e5de3ab506f"}
Sep 09 14:11:41.085188 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.085102    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gvhz4" event={"ID":"6e192feb-9db9-49fb-ad44-193782cc8ca9","Type":"ContainerStarted","Data":"0aa055cf360ff3f54a9e8cc1c8a18bcd54f215a6ce3840d879f23a1e7b6eee8d"}
Sep 09 14:11:41.119070 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.119045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:41.119203 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.119074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:41.121334 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.121313    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f692545a-25d0-42aa-acaa-57d3c20c4ac9-metrics-tls\") pod \"dns-default-4w2mf\" (UID: \"f692545a-25d0-42aa-acaa-57d3c20c4ac9\") " pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:41.121422 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.121334    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls\") pod \"image-registry-65df65b68f-5q84h\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") " pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:41.289644 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.289611    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v89ml\""
Sep 09 14:11:41.297851 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.297827    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:41.299942 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.299926    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tfl8h\""
Sep 09 14:11:41.308720 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.308694    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:41.576831 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.576751    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65df65b68f-5q84h"]
Sep 09 14:11:41.584950 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:41.584920    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c1a8d3_8a30_41bb_81f7_7fcfc4edaa40.slice/crio-8925e9376eeb87a85cc0193313fc057f31a3c3c01b5757658ee06212803f922a WatchSource:0}: Error finding container 8925e9376eeb87a85cc0193313fc057f31a3c3c01b5757658ee06212803f922a: Status 404 returned error can't find the container with id 8925e9376eeb87a85cc0193313fc057f31a3c3c01b5757658ee06212803f922a
Sep 09 14:11:41.595262 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.595239    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4w2mf"]
Sep 09 14:11:41.597378 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:41.597315    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf692545a_25d0_42aa_acaa_57d3c20c4ac9.slice/crio-3bdb7428c8bdab3a2718319ebaad89c6acd1c1f39767a8ee3711eeb6c68ef0a7 WatchSource:0}: Error finding container 3bdb7428c8bdab3a2718319ebaad89c6acd1c1f39767a8ee3711eeb6c68ef0a7: Status 404 returned error can't find the container with id 3bdb7428c8bdab3a2718319ebaad89c6acd1c1f39767a8ee3711eeb6c68ef0a7
Sep 09 14:11:41.597772 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.597746    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:41.624333 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.624303    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret\") pod \"global-pull-secret-syncer-klmjq\" (UID: \"b1c849d7-1e16-4ef7-84e0-9e4236a59980\") " pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:11:41.624439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.624368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs\") pod \"network-metrics-daemon-kmvpw\" (UID: \"686c69bf-f095-4d1a-b378-11e19b6f9e8d\") " pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:11:41.624522 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.624506    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fksr\" (UniqueName: \"kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr\") pod \"network-check-target-w8qtc\" (UID: \"e1389f29-7368-4523-a1a8-0f7a0f62cba7\") " pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:11:41.626903 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.626884    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 14:11:41.627001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.626885    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 14:11:41.627001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.626961    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fksr\" (UniqueName: \"kubernetes.io/projected/e1389f29-7368-4523-a1a8-0f7a0f62cba7-kube-api-access-2fksr\") pod \"network-check-target-w8qtc\" (UID: \"e1389f29-7368-4523-a1a8-0f7a0f62cba7\") " pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:11:41.636541 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.636520    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b1c849d7-1e16-4ef7-84e0-9e4236a59980-original-pull-secret\") pod \"global-pull-secret-syncer-klmjq\" (UID: \"b1c849d7-1e16-4ef7-84e0-9e4236a59980\") " pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:11:41.636734 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.636716    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/686c69bf-f095-4d1a-b378-11e19b6f9e8d-metrics-certs\") pod \"network-metrics-daemon-kmvpw\" (UID: \"686c69bf-f095-4d1a-b378-11e19b6f9e8d\") " pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:11:41.705243 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.705219    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-72t49\""
Sep 09 14:11:41.709183 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.709154    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klmjq"
Sep 09 14:11:41.714013 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.713991    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:11:41.716350 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.716325    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f5zw2\""
Sep 09 14:11:41.724414 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.724392    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kmvpw"
Sep 09 14:11:41.795203 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.794860    2562 scope.go:117] "RemoveContainer" containerID="7fe6d21c186614174e33b7a5c8cbc850f285639ab4334cae63fe6f527d4fe125"
Sep 09 14:11:41.991781 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.991747    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w8qtc"]
Sep 09 14:11:41.996133 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:41.996098    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1389f29_7368_4523_a1a8_0f7a0f62cba7.slice/crio-7a9637cfed189c431b4a2c12b960acc794bc2ff96088f31772778fc5273f9a24 WatchSource:0}: Error finding container 7a9637cfed189c431b4a2c12b960acc794bc2ff96088f31772778fc5273f9a24: Status 404 returned error can't find the container with id 7a9637cfed189c431b4a2c12b960acc794bc2ff96088f31772778fc5273f9a24
Sep 09 14:11:41.998819 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:41.998733    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-klmjq"]
Sep 09 14:11:42.002349 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:42.002322    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c849d7_1e16_4ef7_84e0_9e4236a59980.slice/crio-a15da1f7cba1483aa5cfe872faaa4833a7ea58d9ffd99d4ce8ba2dbf03d95c0f WatchSource:0}: Error finding container a15da1f7cba1483aa5cfe872faaa4833a7ea58d9ffd99d4ce8ba2dbf03d95c0f: Status 404 returned error can't find the container with id a15da1f7cba1483aa5cfe872faaa4833a7ea58d9ffd99d4ce8ba2dbf03d95c0f
Sep 09 14:11:42.018328 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.018301    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kmvpw"]
Sep 09 14:11:42.029310 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:42.029270    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod686c69bf_f095_4d1a_b378_11e19b6f9e8d.slice/crio-ec097ccb00bfe6bf8672b1f0cdc7107df495532e04c8bfc19dd8447033ebe659 WatchSource:0}: Error finding container ec097ccb00bfe6bf8672b1f0cdc7107df495532e04c8bfc19dd8447033ebe659: Status 404 returned error can't find the container with id ec097ccb00bfe6bf8672b1f0cdc7107df495532e04c8bfc19dd8447033ebe659
Sep 09 14:11:42.090516 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.090480    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kmvpw" event={"ID":"686c69bf-f095-4d1a-b378-11e19b6f9e8d","Type":"ContainerStarted","Data":"ec097ccb00bfe6bf8672b1f0cdc7107df495532e04c8bfc19dd8447033ebe659"}
Sep 09 14:11:42.092055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.092029    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w8qtc" event={"ID":"e1389f29-7368-4523-a1a8-0f7a0f62cba7","Type":"ContainerStarted","Data":"4585d7143509792fd249b544697097c135f8d9ce5b9e5bfa824f4191e2727d79"}
Sep 09 14:11:42.092217 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.092072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w8qtc" event={"ID":"e1389f29-7368-4523-a1a8-0f7a0f62cba7","Type":"ContainerStarted","Data":"7a9637cfed189c431b4a2c12b960acc794bc2ff96088f31772778fc5273f9a24"}
Sep 09 14:11:42.092217 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.092205    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:11:42.093300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.093281    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-klmjq" event={"ID":"b1c849d7-1e16-4ef7-84e0-9e4236a59980","Type":"ContainerStarted","Data":"a15da1f7cba1483aa5cfe872faaa4833a7ea58d9ffd99d4ce8ba2dbf03d95c0f"}
Sep 09 14:11:42.094402 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.094382    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4w2mf" event={"ID":"f692545a-25d0-42aa-acaa-57d3c20c4ac9","Type":"ContainerStarted","Data":"3bdb7428c8bdab3a2718319ebaad89c6acd1c1f39767a8ee3711eeb6c68ef0a7"}
Sep 09 14:11:42.096062 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.096041    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65df65b68f-5q84h" event={"ID":"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40","Type":"ContainerStarted","Data":"dd44a7ebc50bb036c57113b6476a0d00c70626979ff1d0cdb3745cf5d536f845"}
Sep 09 14:11:42.096181 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.096075    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65df65b68f-5q84h" event={"ID":"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40","Type":"ContainerStarted","Data":"8925e9376eeb87a85cc0193313fc057f31a3c3c01b5757658ee06212803f922a"}
Sep 09 14:11:42.096181 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.096135    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:11:42.098026 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.098005    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gvhz4" event={"ID":"6e192feb-9db9-49fb-ad44-193782cc8ca9","Type":"ContainerStarted","Data":"bbc5f86ee799dc272071de4c1f736a269484b3091465653f1d4596628b6802dc"}
Sep 09 14:11:42.099875 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.099828    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:11:42.099949 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.099876    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-wbt89" event={"ID":"6ee3ce3e-01df-4ee9-a69c-0a3c709a8117","Type":"ContainerStarted","Data":"e6112222e266b1f8e96585190c72b5b62ab2b855bcd535a2c023c258053b8c4b"}
Sep 09 14:11:42.100136 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.100120    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:42.107702 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.107660    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w8qtc" podStartSLOduration=66.107647297 podStartE2EDuration="1m6.107647297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:10:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:42.107401845 +0000 UTC m=+66.833941948" watchObservedRunningTime="2026-09-09 14:11:42.107647297 +0000 UTC m=+66.834187396"
Sep 09 14:11:42.125862 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.125816    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65df65b68f-5q84h" podStartSLOduration=45.125800934 podStartE2EDuration="45.125800934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:10:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:42.125202904 +0000 UTC m=+66.851743008" watchObservedRunningTime="2026-09-09 14:11:42.125800934 +0000 UTC m=+66.852341036"
Sep 09 14:11:42.143296 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:42.143255    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-wbt89" podStartSLOduration=21.723759603 podStartE2EDuration="28.143237803s" totalImagesPullingTime="6.4194782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:42.143227186 +0000 UTC m=+66.869767287" watchObservedRunningTime="2026-09-09 14:11:42.143237803 +0000 UTC m=+66.869777924"
Sep 09 14:11:43.100933 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:43.100853    2562 patch_prober.go:28] interesting pod/console-operator-85b454874b-wbt89 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.10:8443/readyz\": context deadline exceeded" start-of-body=
Sep 09 14:11:43.101423 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:43.100968    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-85b454874b-wbt89" podUID="6ee3ce3e-01df-4ee9-a69c-0a3c709a8117" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.10:8443/readyz\": context deadline exceeded"
Sep 09 14:11:43.750109 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:43.750078    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-wbt89"
Sep 09 14:11:43.931744 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:43.931652    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:44.042885 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:44.042768    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:44.138520 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:44.138488    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:44.241434 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:44.241355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:44.626048 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:44.626013    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:44.700628 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:44.700579    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:44.819250 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:44.819219    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:45.027998 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:45.027954    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:45.115812 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:45.115728    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kmvpw" event={"ID":"686c69bf-f095-4d1a-b378-11e19b6f9e8d","Type":"ContainerStarted","Data":"40a05b9e2d122c2b88b3175df112ff5dd75d054784a79710df2f68ac6eee4c2b"}
Sep 09 14:11:45.117490 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:45.117463    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4w2mf" event={"ID":"f692545a-25d0-42aa-acaa-57d3c20c4ac9","Type":"ContainerStarted","Data":"209dee715980617e5b7a59cb35a7dd41789ad8e9e7b3e8bf39860ecebe067866"}
Sep 09 14:11:45.119893 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:45.119862    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gvhz4" event={"ID":"6e192feb-9db9-49fb-ad44-193782cc8ca9","Type":"ContainerStarted","Data":"2e37014e1aa9a3ea30cf980ef77471e32892663849599b0662a81ceab9e107e3"}
Sep 09 14:11:45.126376 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:45.126350    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:45.140678 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:45.140624    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gvhz4" podStartSLOduration=17.262465672 podStartE2EDuration="21.140606205s" totalImagesPullingTime="3.878140533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:11:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:45.13919077 +0000 UTC m=+69.865730874" watchObservedRunningTime="2026-09-09 14:11:45.140606205 +0000 UTC m=+69.867146311"
Sep 09 14:11:45.339740 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:45.339705    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:45.466269 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:45.466139    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:45.534531 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:45.534472    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:45.634278 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:45.634151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:46.027345 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:46.027303    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:47.055430 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.055394    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:47.077309 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.077285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:47.077387 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.077340    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rzpnp\" (UID: \"e82b314b-f0af-4e00-abf5-1991687d1ea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"
Sep 09 14:11:47.077387 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.077373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:47.077959 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.077934    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755fce16-cc81-4661-8e58-2fee5c71966f-service-ca-bundle\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:47.079700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.079669    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82b314b-f0af-4e00-abf5-1991687d1ea0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-rzpnp\" (UID: \"e82b314b-f0af-4e00-abf5-1991687d1ea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"
Sep 09 14:11:47.079792 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.079721    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/755fce16-cc81-4661-8e58-2fee5c71966f-metrics-certs\") pod \"router-default-cd68d9db8-hbl96\" (UID: \"755fce16-cc81-4661-8e58-2fee5c71966f\") " pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:47.129415 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.129379    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kmvpw" event={"ID":"686c69bf-f095-4d1a-b378-11e19b6f9e8d","Type":"ContainerStarted","Data":"b17ee6d4fc091bd7ef91bc583bd05cebc6b426c20d9e94e1cc29f93fea4836bb"}
Sep 09 14:11:47.130957 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.130932    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-klmjq" event={"ID":"b1c849d7-1e16-4ef7-84e0-9e4236a59980","Type":"ContainerStarted","Data":"07c6a3ed9aeb5f21045c1bb8b9cde342cccfc3a175eb04c1c4795b038972b813"}
Sep 09 14:11:47.132788 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.132768    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4w2mf" event={"ID":"f692545a-25d0-42aa-acaa-57d3c20c4ac9","Type":"ContainerStarted","Data":"54c9217d06a62c48ce4a6afd03e3cda7491a5a9a3e2328d5d608adf829ca5dba"}
Sep 09 14:11:47.132901 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.132890    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:47.145536 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.145483    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kmvpw" podStartSLOduration=68.397571077 podStartE2EDuration="1m11.14546712s" totalImagesPullingTime="2.747896043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:47.14510479 +0000 UTC m=+71.871644891" watchObservedRunningTime="2026-09-09 14:11:47.14546712 +0000 UTC m=+71.872007222"
Sep 09 14:11:47.149781 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.149749    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:47.162388 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.162348    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4w2mf" podStartSLOduration=34.981442019 podStartE2EDuration="38.162335162s" totalImagesPullingTime="3.180893143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:47.161538236 +0000 UTC m=+71.888078339" watchObservedRunningTime="2026-09-09 14:11:47.162335162 +0000 UTC m=+71.888875317"
Sep 09 14:11:47.176548 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.176511    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-klmjq" podStartSLOduration=66.804734656 podStartE2EDuration="1m11.176497801s" totalImagesPullingTime="4.371763145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:47.176488986 +0000 UTC m=+71.903029088" watchObservedRunningTime="2026-09-09 14:11:47.176497801 +0000 UTC m=+71.903037903"
Sep 09 14:11:47.177720 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.177696    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-dlzvp\" (UID: \"78d7aa56-30f6-44a0-9fb2-c37ecc381b62\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:47.180036 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.180014    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/78d7aa56-30f6-44a0-9fb2-c37ecc381b62-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-dlzvp\" (UID: \"78d7aa56-30f6-44a0-9fb2-c37ecc381b62\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:47.263336 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.263306    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r8f54\""
Sep 09 14:11:47.271996 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.271971    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:47.316342 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.316276    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dqxzr\""
Sep 09 14:11:47.325396 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.325374    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"
Sep 09 14:11:47.345352 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.345298    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nqc58\""
Sep 09 14:11:47.353206 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.353184    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"
Sep 09 14:11:47.545417 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.545385    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-cd68d9db8-hbl96"]
Sep 09 14:11:47.549467 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:47.549440    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod755fce16_cc81_4661_8e58_2fee5c71966f.slice/crio-0a3c4e04e31f5691ffc4c9e8c0958a444ad4182767eeb01c8477d2ac991539ad WatchSource:0}: Error finding container 0a3c4e04e31f5691ffc4c9e8c0958a444ad4182767eeb01c8477d2ac991539ad: Status 404 returned error can't find the container with id 0a3c4e04e31f5691ffc4c9e8c0958a444ad4182767eeb01c8477d2ac991539ad
Sep 09 14:11:47.600514 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.600489    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp"]
Sep 09 14:11:47.632325 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:47.632297    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp"]
Sep 09 14:11:47.636145 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:47.636123    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78d7aa56_30f6_44a0_9fb2_c37ecc381b62.slice/crio-13f17776db5c55bcb484f05db1be472b18f3df0fa363e0e5178d72c1df2f272a WatchSource:0}: Error finding container 13f17776db5c55bcb484f05db1be472b18f3df0fa363e0e5178d72c1df2f272a: Status 404 returned error can't find the container with id 13f17776db5c55bcb484f05db1be472b18f3df0fa363e0e5178d72c1df2f272a
Sep 09 14:11:48.002536 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.002464    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v"]
Sep 09 14:11:48.005683 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.005655    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v"
Sep 09 14:11:48.007891 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.007867    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 09 14:11:48.008065 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.008045    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 09 14:11:48.008694 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.008624    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 09 14:11:48.008694 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.008625    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xkj4k\""
Sep 09 14:11:48.008694 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.008626    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 09 14:11:48.018236 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.018214    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v"]
Sep 09 14:11:48.084270 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.084239    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/707c69bc-bf3a-4845-b23a-a6aa3912ca91-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v\" (UID: \"707c69bc-bf3a-4845-b23a-a6aa3912ca91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v"
Sep 09 14:11:48.084683 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.084283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bdvn\" (UniqueName: \"kubernetes.io/projected/707c69bc-bf3a-4845-b23a-a6aa3912ca91-kube-api-access-5bdvn\") pod \"managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v\" (UID: \"707c69bc-bf3a-4845-b23a-a6aa3912ca91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v"
Sep 09 14:11:48.097413 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.097383    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-v9mkl"]
Sep 09 14:11:48.101720 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.101698    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-v9mkl"
Sep 09 14:11:48.103880 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.103846    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nds7f\""
Sep 09 14:11:48.103880 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.103848    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 09 14:11:48.104074 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.103848    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 09 14:11:48.113187 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.113153    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-v9mkl"]
Sep 09 14:11:48.140511 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.140480    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp" event={"ID":"78d7aa56-30f6-44a0-9fb2-c37ecc381b62","Type":"ContainerStarted","Data":"13f17776db5c55bcb484f05db1be472b18f3df0fa363e0e5178d72c1df2f272a"}
Sep 09 14:11:48.141556 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.141390    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:48.142122 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.142100    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp" event={"ID":"e82b314b-f0af-4e00-abf5-1991687d1ea0","Type":"ContainerStarted","Data":"19d07484de5c9511e2336360e9ae49077dbf69025fe9cd163f93b546eefbac33"}
Sep 09 14:11:48.143876 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.143849    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-cd68d9db8-hbl96" event={"ID":"755fce16-cc81-4661-8e58-2fee5c71966f","Type":"ContainerStarted","Data":"81e2543c04448dee1656efe64cd42a6e99ce5041b6b95c8a5dbe3b42497c10ae"}
Sep 09 14:11:48.144006 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.143895    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-cd68d9db8-hbl96" event={"ID":"755fce16-cc81-4661-8e58-2fee5c71966f","Type":"ContainerStarted","Data":"0a3c4e04e31f5691ffc4c9e8c0958a444ad4182767eeb01c8477d2ac991539ad"}
Sep 09 14:11:48.168005 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.167966    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-cd68d9db8-hbl96" podStartSLOduration=33.16795213 podStartE2EDuration="33.16795213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:48.166965138 +0000 UTC m=+72.893505241" watchObservedRunningTime="2026-09-09 14:11:48.16795213 +0000 UTC m=+72.894492232"
Sep 09 14:11:48.185392 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.185360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw5zc\" (UniqueName: \"kubernetes.io/projected/3dd40e10-d3bd-44fd-abc3-8cf1210acd7f-kube-api-access-dw5zc\") pod \"downloads-85d98c998f-v9mkl\" (UID: \"3dd40e10-d3bd-44fd-abc3-8cf1210acd7f\") " pod="openshift-console/downloads-85d98c998f-v9mkl"
Sep 09 14:11:48.185501 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.185481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/707c69bc-bf3a-4845-b23a-a6aa3912ca91-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v\" (UID: \"707c69bc-bf3a-4845-b23a-a6aa3912ca91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v"
Sep 09 14:11:48.185556 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.185516    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bdvn\" (UniqueName: \"kubernetes.io/projected/707c69bc-bf3a-4845-b23a-a6aa3912ca91-kube-api-access-5bdvn\") pod \"managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v\" (UID: \"707c69bc-bf3a-4845-b23a-a6aa3912ca91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v"
Sep 09 14:11:48.187912 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.187892    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/707c69bc-bf3a-4845-b23a-a6aa3912ca91-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v\" (UID: \"707c69bc-bf3a-4845-b23a-a6aa3912ca91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v"
Sep 09 14:11:48.194471 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.194448    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bdvn\" (UniqueName: \"kubernetes.io/projected/707c69bc-bf3a-4845-b23a-a6aa3912ca91-kube-api-access-5bdvn\") pod \"managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v\" (UID: \"707c69bc-bf3a-4845-b23a-a6aa3912ca91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v"
Sep 09 14:11:48.244363 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.244332    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:48.272798 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.272727    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:48.275743 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.275717    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:48.286052 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.286015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw5zc\" (UniqueName: \"kubernetes.io/projected/3dd40e10-d3bd-44fd-abc3-8cf1210acd7f-kube-api-access-dw5zc\") pod \"downloads-85d98c998f-v9mkl\" (UID: \"3dd40e10-d3bd-44fd-abc3-8cf1210acd7f\") " pod="openshift-console/downloads-85d98c998f-v9mkl"
Sep 09 14:11:48.295364 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.295338    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw5zc\" (UniqueName: \"kubernetes.io/projected/3dd40e10-d3bd-44fd-abc3-8cf1210acd7f-kube-api-access-dw5zc\") pod \"downloads-85d98c998f-v9mkl\" (UID: \"3dd40e10-d3bd-44fd-abc3-8cf1210acd7f\") " pod="openshift-console/downloads-85d98c998f-v9mkl"
Sep 09 14:11:48.329125 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.329093    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v"
Sep 09 14:11:48.340017 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.339919    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:48.413791 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.413498    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-v9mkl"
Sep 09 14:11:48.440346 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.440303    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:48.615188 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.615147    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v"]
Sep 09 14:11:48.618595 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:48.618570    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod707c69bc_bf3a_4845_b23a_a6aa3912ca91.slice/crio-69da5b4ab94ec8da7dd5960947e55f2812d12cc87dfa6172fd8fd0b1b1420ad3 WatchSource:0}: Error finding container 69da5b4ab94ec8da7dd5960947e55f2812d12cc87dfa6172fd8fd0b1b1420ad3: Status 404 returned error can't find the container with id 69da5b4ab94ec8da7dd5960947e55f2812d12cc87dfa6172fd8fd0b1b1420ad3
Sep 09 14:11:48.688780 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:48.688748    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-v9mkl"]
Sep 09 14:11:48.691623 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:48.691585    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd40e10_d3bd_44fd_abc3_8cf1210acd7f.slice/crio-f022d0f75cffabf4babd6ebc482cfea466c167c50353c3b75fe53b035b16992b WatchSource:0}: Error finding container f022d0f75cffabf4babd6ebc482cfea466c167c50353c3b75fe53b035b16992b: Status 404 returned error can't find the container with id f022d0f75cffabf4babd6ebc482cfea466c167c50353c3b75fe53b035b16992b
Sep 09 14:11:49.082025 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:49.081938    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:49.150586 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:49.150553    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v" event={"ID":"707c69bc-bf3a-4845-b23a-a6aa3912ca91","Type":"ContainerStarted","Data":"69da5b4ab94ec8da7dd5960947e55f2812d12cc87dfa6172fd8fd0b1b1420ad3"}
Sep 09 14:11:49.153012 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:49.152913    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-v9mkl" event={"ID":"3dd40e10-d3bd-44fd-abc3-8cf1210acd7f","Type":"ContainerStarted","Data":"f022d0f75cffabf4babd6ebc482cfea466c167c50353c3b75fe53b035b16992b"}
Sep 09 14:11:49.153012 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:49.152975    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:49.154737 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:49.154690    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-cd68d9db8-hbl96"
Sep 09 14:11:49.155591 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:49.155559    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:49.492070 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:49.491920    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:49.591455 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:49.591249    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:50.160864 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.160715    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp" event={"ID":"e82b314b-f0af-4e00-abf5-1991687d1ea0","Type":"ContainerStarted","Data":"7a7a39435e4b43bf4bfb53b42e6f0678c33138d7b1e59c00cb2b1182f99cc523"}
Sep 09 14:11:50.160864 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.160781    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp" event={"ID":"e82b314b-f0af-4e00-abf5-1991687d1ea0","Type":"ContainerStarted","Data":"ec78cf947999809aadba78699dad330dc90a22819ff173379f1bd19f91503421"}
Sep 09 14:11:50.164374 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.164343    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp" event={"ID":"78d7aa56-30f6-44a0-9fb2-c37ecc381b62","Type":"ContainerStarted","Data":"e62e58dd6c2d6e6172c4e4cfe42eea6a57de12a6be3b289ea9208cc0c2adaf98"}
Sep 09 14:11:50.181413 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.181358    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-rzpnp" podStartSLOduration=32.958549018 podStartE2EDuration="35.181340144s" totalImagesPullingTime="2.222791126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:50.180355365 +0000 UTC m=+74.906895468" watchObservedRunningTime="2026-09-09 14:11:50.181340144 +0000 UTC m=+74.907880249"
Sep 09 14:11:50.203797 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.202915    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-dlzvp" podStartSLOduration=32.988324888 podStartE2EDuration="35.202875705s" totalImagesPullingTime="2.214550817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:50.202013633 +0000 UTC m=+74.928553735" watchObservedRunningTime="2026-09-09 14:11:50.202875705 +0000 UTC m=+74.929415809"
Sep 09 14:11:50.249647 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.249597    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:50.396850 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.396759    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:50.421690 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.421610    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-7c9ww"]
Sep 09 14:11:50.425293 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.425260    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-7c9ww"
Sep 09 14:11:50.427881 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.427628    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cl6sf\""
Sep 09 14:11:50.427881 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.427783    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 09 14:11:50.433842 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.433783    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-7c9ww"]
Sep 09 14:11:50.461263 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.461227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:50.507402 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.507323    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8a154390-4edb-4199-9e71-aca0d4b79a92-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-7c9ww\" (UID: \"8a154390-4edb-4199-9e71-aca0d4b79a92\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-7c9ww"
Sep 09 14:11:50.608398 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.608362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8a154390-4edb-4199-9e71-aca0d4b79a92-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-7c9ww\" (UID: \"8a154390-4edb-4199-9e71-aca0d4b79a92\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-7c9ww"
Sep 09 14:11:50.611853 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.611822    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8a154390-4edb-4199-9e71-aca0d4b79a92-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-7c9ww\" (UID: \"8a154390-4edb-4199-9e71-aca0d4b79a92\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-7c9ww"
Sep 09 14:11:50.739359 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.739272    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-7c9ww"
Sep 09 14:11:50.829023 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:50.828983    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:52.207213 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:52.207083    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-7c9ww"]
Sep 09 14:11:52.210525 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:11:52.210492    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a154390_4edb_4199_9e71_aca0d4b79a92.slice/crio-b0ee4b30f2cb888f51c582e043c42ed2196343452639634e4901075f5ef6834b WatchSource:0}: Error finding container b0ee4b30f2cb888f51c582e043c42ed2196343452639634e4901075f5ef6834b: Status 404 returned error can't find the container with id b0ee4b30f2cb888f51c582e043c42ed2196343452639634e4901075f5ef6834b
Sep 09 14:11:53.184055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:53.184008    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-7c9ww" event={"ID":"8a154390-4edb-4199-9e71-aca0d4b79a92","Type":"ContainerStarted","Data":"b0ee4b30f2cb888f51c582e043c42ed2196343452639634e4901075f5ef6834b"}
Sep 09 14:11:53.186263 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:53.186230    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v" event={"ID":"707c69bc-bf3a-4845-b23a-a6aa3912ca91","Type":"ContainerStarted","Data":"65e98b9e427e4d9ccdbf2dabe51e3aecdeeed663eeca1f1cf209bcf10ba86e19"}
Sep 09 14:11:53.679092 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:53.679046    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:53.784272 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:53.784234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:54.146657 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:54.146623    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4w2mf"
Sep 09 14:11:54.165257 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:54.165205    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9d6dbb9fb-p4v6v" podStartSLOduration=3.566882976 podStartE2EDuration="7.165187983s" totalImagesPullingTime="3.598305007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:53.202542331 +0000 UTC m=+77.929082433" watchObservedRunningTime="2026-09-09 14:11:54.165187983 +0000 UTC m=+78.891728098"
Sep 09 14:11:54.193693 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:54.193659    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-7c9ww" event={"ID":"8a154390-4edb-4199-9e71-aca0d4b79a92","Type":"ContainerStarted","Data":"3955788175ac74a1e1ae08f5dcb9c88d12b24f5680584f952425eeaee130346f"}
Sep 09 14:11:54.193990 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:54.193940    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-7c9ww"
Sep 09 14:11:54.199539 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:54.199517    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-7c9ww"
Sep 09 14:11:54.209335 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:54.209286    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-7c9ww" podStartSLOduration=2.728984606 podStartE2EDuration="4.209270246s" totalImagesPullingTime="1.48028564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:11:54.208552472 +0000 UTC m=+78.935092576" watchObservedRunningTime="2026-09-09 14:11:54.209270246 +0000 UTC m=+78.935810349"
Sep 09 14:11:54.455064 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:54.454975    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:54.533901 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:54.533862    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:54.598689 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:54.598653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:58.182216 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:58.182051    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:58.249237 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:58.249203    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:59.393318 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:59.393209    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:59.459827 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:59.459780    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:11:59.964978 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:11:59.964944    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:00.605414 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:00.605379    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:00.704425 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:00.704393    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:00.886687 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:00.886607    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8hzwz"]
Sep 09 14:12:00.891459 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:00.891432    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:00.894337 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:00.894313    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 14:12:00.895081 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:00.895050    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 14:12:00.895223 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:00.895139    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 14:12:00.895295 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:00.895051    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f2ql4\""
Sep 09 14:12:00.895943 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:00.895915    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 14:12:00.946369 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:00.946332    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:01.000084 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.000056    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3529c80-4d1c-44c0-8718-99a4fa84694c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.000269 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.000094    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz65w\" (UniqueName: \"kubernetes.io/projected/d3529c80-4d1c-44c0-8718-99a4fa84694c-kube-api-access-jz65w\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.000269 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.000157    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3529c80-4d1c-44c0-8718-99a4fa84694c-metrics-client-ca\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.000374 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.000273    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d3529c80-4d1c-44c0-8718-99a4fa84694c-node-exporter-accelerators-collector-config\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.000374 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.000319    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3529c80-4d1c-44c0-8718-99a4fa84694c-sys\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.000467 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.000383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d3529c80-4d1c-44c0-8718-99a4fa84694c-node-exporter-wtmp\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.000467 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.000411    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d3529c80-4d1c-44c0-8718-99a4fa84694c-node-exporter-tls\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.000467 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.000438    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d3529c80-4d1c-44c0-8718-99a4fa84694c-root\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.000467 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.000457    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d3529c80-4d1c-44c0-8718-99a4fa84694c-node-exporter-textfile\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.011048 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.011021    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:01.101835 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.101801    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d3529c80-4d1c-44c0-8718-99a4fa84694c-node-exporter-tls\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.101835 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.101850    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d3529c80-4d1c-44c0-8718-99a4fa84694c-root\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.102439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.101913    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d3529c80-4d1c-44c0-8718-99a4fa84694c-root\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.102439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.101950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d3529c80-4d1c-44c0-8718-99a4fa84694c-node-exporter-textfile\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.102439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.101994    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3529c80-4d1c-44c0-8718-99a4fa84694c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.102439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.102020    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz65w\" (UniqueName: \"kubernetes.io/projected/d3529c80-4d1c-44c0-8718-99a4fa84694c-kube-api-access-jz65w\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.102439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.102104    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3529c80-4d1c-44c0-8718-99a4fa84694c-metrics-client-ca\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.102439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.102133    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d3529c80-4d1c-44c0-8718-99a4fa84694c-node-exporter-accelerators-collector-config\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.102439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.102165    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3529c80-4d1c-44c0-8718-99a4fa84694c-sys\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.102439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.102227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d3529c80-4d1c-44c0-8718-99a4fa84694c-node-exporter-wtmp\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.102439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.102390    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d3529c80-4d1c-44c0-8718-99a4fa84694c-node-exporter-wtmp\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.102439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.102441    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3529c80-4d1c-44c0-8718-99a4fa84694c-sys\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.102916 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.102476    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d3529c80-4d1c-44c0-8718-99a4fa84694c-node-exporter-textfile\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.102916 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.102881    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3529c80-4d1c-44c0-8718-99a4fa84694c-metrics-client-ca\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.103164 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.103142    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d3529c80-4d1c-44c0-8718-99a4fa84694c-node-exporter-accelerators-collector-config\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.104987 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.104966    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d3529c80-4d1c-44c0-8718-99a4fa84694c-node-exporter-tls\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.105106 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.104992    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3529c80-4d1c-44c0-8718-99a4fa84694c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.109905 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.109885    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz65w\" (UniqueName: \"kubernetes.io/projected/d3529c80-4d1c-44c0-8718-99a4fa84694c-kube-api-access-jz65w\") pod \"node-exporter-8hzwz\" (UID: \"d3529c80-4d1c-44c0-8718-99a4fa84694c\") " pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.123408 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.123350    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:01.206746 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.206414    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8hzwz"
Sep 09 14:12:01.268266 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.268229    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:01.302533 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.302499    2562 patch_prober.go:28] interesting pod/image-registry-65df65b68f-5q84h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 09 14:12:01.302679 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.302566    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-65df65b68f-5q84h" podUID="67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 14:12:01.373975 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.373924    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:01.634540 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.634506    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:01.864322 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.864284    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:01.950864 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:01.950762    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:02.165874 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:02.165828    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:02.264707 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:02.264586    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:03.112625 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:03.112598    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:12:03.617485 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:03.617447    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:03.718520 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:03.718456    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:03.849361 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:03.849322    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:03.922492 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:03.922405    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:04.145660 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:04.145606    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:04.441066 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:04.441026    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:04.624766 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:04.624727    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:04.684773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:04.684717    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:05.630770 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:05.630735    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:05.731900 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:05.731842    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:05.820799 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:12:05.820756    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3529c80_4d1c_44c0_8718_99a4fa84694c.slice/crio-77e87a658e8543e12a2f1e2a03d7c1a220bc1cd6056f8c5fcbe7c1a36f74c764 WatchSource:0}: Error finding container 77e87a658e8543e12a2f1e2a03d7c1a220bc1cd6056f8c5fcbe7c1a36f74c764: Status 404 returned error can't find the container with id 77e87a658e8543e12a2f1e2a03d7c1a220bc1cd6056f8c5fcbe7c1a36f74c764
Sep 09 14:12:06.038421 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:06.038385    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:06.124185 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:06.124128    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:06.181087 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:06.180997    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:06.238427 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:06.238391    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:06.244425 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:06.244394    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8hzwz" event={"ID":"d3529c80-4d1c-44c0-8718-99a4fa84694c","Type":"ContainerStarted","Data":"77e87a658e8543e12a2f1e2a03d7c1a220bc1cd6056f8c5fcbe7c1a36f74c764"}
Sep 09 14:12:06.246440 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:06.246403    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-v9mkl" event={"ID":"3dd40e10-d3bd-44fd-abc3-8cf1210acd7f","Type":"ContainerStarted","Data":"8b274bfa9bd38899016da05e7f86d203df54e0abf10fdc3aab395bd5af99aed2"}
Sep 09 14:12:06.246658 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:06.246639    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-v9mkl"
Sep 09 14:12:06.263073 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:06.263052    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-v9mkl"
Sep 09 14:12:06.263623 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:06.263533    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-v9mkl" podStartSLOduration=1.043005357 podStartE2EDuration="18.263519517s" totalImagesPullingTime="17.22051416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:11:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:12:06.261764663 +0000 UTC m=+90.988304767" watchObservedRunningTime="2026-09-09 14:12:06.263519517 +0000 UTC m=+90.990059619"
Sep 09 14:12:07.112681 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:07.112592    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:07.253388 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:07.253308    2562 generic.go:356] "Generic (PLEG): container finished" podID="d3529c80-4d1c-44c0-8718-99a4fa84694c" containerID="44e331ad41d226c7e6f15bfb5eefb132d03d6e4582d35ca5c7c54b561318f04d" exitCode=0
Sep 09 14:12:07.253565 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:07.253464    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8hzwz" event={"ID":"d3529c80-4d1c-44c0-8718-99a4fa84694c","Type":"ContainerDied","Data":"44e331ad41d226c7e6f15bfb5eefb132d03d6e4582d35ca5c7c54b561318f04d"}
Sep 09 14:12:07.824088 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:07.824049    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:07.923544 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:07.923502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:08.023752 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:08.023698    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:08.261453 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:08.261366    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8hzwz" event={"ID":"d3529c80-4d1c-44c0-8718-99a4fa84694c","Type":"ContainerStarted","Data":"2992a97e0e00eca0eb3c66ef1d9cbe57e42029be494e43ff4693be2c8c3616c2"}
Sep 09 14:12:08.261453 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:08.261434    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8hzwz" event={"ID":"d3529c80-4d1c-44c0-8718-99a4fa84694c","Type":"ContainerStarted","Data":"142bb5876ec502ecb5a5dc9202420f18b419870acc3b7d0e0c9a1b6de153e24a"}
Sep 09 14:12:08.280442 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:08.280393    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8hzwz" podStartSLOduration=7.060573819 podStartE2EDuration="8.28037747s" totalImagesPullingTime="1.143091008s" totalInitContainerRuntime="76.712643ms" isStatefulPod=true podCreationTimestamp="2026-09-09 14:12:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:12:08.279398549 +0000 UTC m=+93.005938651" watchObservedRunningTime="2026-09-09 14:12:08.28037747 +0000 UTC m=+93.006917571"
Sep 09 14:12:08.415352 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:08.415312    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:09.120406 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:09.120358    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:09.220203 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:09.220139    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:09.841645 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:09.841594    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:09.941483 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:09.941448    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:10.049013 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:10.048979    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65df65b68f-5q84h"]
Sep 09 14:12:10.183685 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:10.183601    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:10.282557 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:10.282523    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:10.848752 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:10.848715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:10.938691 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:10.938655    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:13.109556 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:13.109480    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w8qtc"
Sep 09 14:12:13.315283 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:13.315239    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:13.420071 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:13.419968    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:15.252293 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:15.252256    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:15.354083 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:15.354032    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:15.423923 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:15.423887    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:15.855269 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:15.855234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:15.924502 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:15.924470    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:19.136620 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:19.136576    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:19.295681 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:19.295644    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:20.155874 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:20.155813    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:20.258111 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:20.258079    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:22.424853 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:22.424816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:22.525543 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:22.525507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:28.241555 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:28.241517    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:30.335021 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:30.334980    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:30.402083 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:30.402050    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:35.073618 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.073580    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65df65b68f-5q84h" podUID="67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40" containerName="registry" containerID="cri-o://dd44a7ebc50bb036c57113b6476a0d00c70626979ff1d0cdb3745cf5d536f845" gracePeriod=30
Sep 09 14:12:35.352606 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.352543    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:12:35.365448 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.365420    2562 generic.go:356] "Generic (PLEG): container finished" podID="67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40" containerID="dd44a7ebc50bb036c57113b6476a0d00c70626979ff1d0cdb3745cf5d536f845" exitCode=0
Sep 09 14:12:35.365583 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.365463    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65df65b68f-5q84h"
Sep 09 14:12:35.365583 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.365465    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65df65b68f-5q84h" event={"ID":"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40","Type":"ContainerDied","Data":"dd44a7ebc50bb036c57113b6476a0d00c70626979ff1d0cdb3745cf5d536f845"}
Sep 09 14:12:35.365680 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.365591    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65df65b68f-5q84h" event={"ID":"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40","Type":"ContainerDied","Data":"8925e9376eeb87a85cc0193313fc057f31a3c3c01b5757658ee06212803f922a"}
Sep 09 14:12:35.365680 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.365617    2562 scope.go:117] "RemoveContainer" containerID="dd44a7ebc50bb036c57113b6476a0d00c70626979ff1d0cdb3745cf5d536f845"
Sep 09 14:12:35.373013 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.372994    2562 scope.go:117] "RemoveContainer" containerID="dd44a7ebc50bb036c57113b6476a0d00c70626979ff1d0cdb3745cf5d536f845"
Sep 09 14:12:35.373276 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:12:35.373254    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd44a7ebc50bb036c57113b6476a0d00c70626979ff1d0cdb3745cf5d536f845\": container with ID starting with dd44a7ebc50bb036c57113b6476a0d00c70626979ff1d0cdb3745cf5d536f845 not found: ID does not exist" containerID="dd44a7ebc50bb036c57113b6476a0d00c70626979ff1d0cdb3745cf5d536f845"
Sep 09 14:12:35.373343 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.373288    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd44a7ebc50bb036c57113b6476a0d00c70626979ff1d0cdb3745cf5d536f845"} err="failed to get container status \"dd44a7ebc50bb036c57113b6476a0d00c70626979ff1d0cdb3745cf5d536f845\": rpc error: code = NotFound desc = could not find container \"dd44a7ebc50bb036c57113b6476a0d00c70626979ff1d0cdb3745cf5d536f845\": container with ID starting with dd44a7ebc50bb036c57113b6476a0d00c70626979ff1d0cdb3745cf5d536f845 not found: ID does not exist"
Sep 09 14:12:35.493993 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.493963    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-installation-pull-secrets\") pod \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") "
Sep 09 14:12:35.494122 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.494000    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-bound-sa-token\") pod \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") "
Sep 09 14:12:35.494122 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.494026    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-trusted-ca\") pod \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") "
Sep 09 14:12:35.494122 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.494047    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-certificates\") pod \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") "
Sep 09 14:12:35.494279 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.494191    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-464kt\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-kube-api-access-464kt\") pod \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") "
Sep 09 14:12:35.494279 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.494248    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls\") pod \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") "
Sep 09 14:12:35.494383 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.494291    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-ca-trust-extracted\") pod \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") "
Sep 09 14:12:35.494383 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.494322    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-image-registry-private-configuration\") pod \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\" (UID: \"67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40\") "
Sep 09 14:12:35.494566 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.494509    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40" (UID: "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:12:35.494566 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.494516    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40" (UID: "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:12:35.496573 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.496546    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40" (UID: "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:12:35.496701 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.496663    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40" (UID: "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:12:35.496701 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.496683    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40" (UID: "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:12:35.496833 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.496806    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40" (UID: "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:12:35.496945 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.496894    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-kube-api-access-464kt" (OuterVolumeSpecName: "kube-api-access-464kt") pod "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40" (UID: "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40"). InnerVolumeSpecName "kube-api-access-464kt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:12:35.502874 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.502849    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40" (UID: "67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:12:35.595236 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.595207    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-installation-pull-secrets\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:12:35.595236 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.595233    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-bound-sa-token\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:12:35.595236 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.595243    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-trusted-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:12:35.595443 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.595251    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-certificates\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:12:35.595443 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.595260    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-464kt\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-kube-api-access-464kt\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:12:35.595443 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.595269    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-registry-tls\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:12:35.595443 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.595276    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-ca-trust-extracted\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:12:35.595443 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.595286    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40-image-registry-private-configuration\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:12:35.685451 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.685422    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65df65b68f-5q84h"]
Sep 09 14:12:35.688375 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.688350    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65df65b68f-5q84h"]
Sep 09 14:12:35.799648 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:35.799616    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40" path="/var/lib/kubelet/pods/67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40/volumes"
Sep 09 14:12:39.380942 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:39.380904    2562 generic.go:356] "Generic (PLEG): container finished" podID="169c00d2-dfda-468c-8753-f18fdcf2d4e6" containerID="3388d2b6f84f239be879b1921059c3844e07d3d5a21b4ae5da32c16ecde43baf" exitCode=0
Sep 09 14:12:39.381440 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:39.380984    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw" event={"ID":"169c00d2-dfda-468c-8753-f18fdcf2d4e6","Type":"ContainerDied","Data":"3388d2b6f84f239be879b1921059c3844e07d3d5a21b4ae5da32c16ecde43baf"}
Sep 09 14:12:39.381508 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:39.381452    2562 scope.go:117] "RemoveContainer" containerID="3388d2b6f84f239be879b1921059c3844e07d3d5a21b4ae5da32c16ecde43baf"
Sep 09 14:12:40.386864 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:40.386830    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-rdvmw" event={"ID":"169c00d2-dfda-468c-8753-f18fdcf2d4e6","Type":"ContainerStarted","Data":"f0b4854fc345a648aff4dbf90550e7ed565f1dbad5c631d79948935a86dc088e"}
Sep 09 14:12:43.727641 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:43.727569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:43.792946 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:43.792917    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:12:44.403375 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:44.403338    2562 generic.go:356] "Generic (PLEG): container finished" podID="da8024d0-341a-4382-ac02-17fcdd053eaa" containerID="355e2e130da1ae85a0c741f468cd7c853589b6d06491a45d77d466b8a8558ad5" exitCode=0
Sep 09 14:12:44.403588 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:44.403394    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq" event={"ID":"da8024d0-341a-4382-ac02-17fcdd053eaa","Type":"ContainerDied","Data":"355e2e130da1ae85a0c741f468cd7c853589b6d06491a45d77d466b8a8558ad5"}
Sep 09 14:12:44.403692 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:44.403679    2562 scope.go:117] "RemoveContainer" containerID="355e2e130da1ae85a0c741f468cd7c853589b6d06491a45d77d466b8a8558ad5"
Sep 09 14:12:45.409180 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:45.409145    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-v57kq" event={"ID":"da8024d0-341a-4382-ac02-17fcdd053eaa","Type":"ContainerStarted","Data":"17ce40d5ce7cd4cf18bfb504ec417d6617c8e0e86c6a406fb51147f68d602c62"}
Sep 09 14:12:53.440500 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:53.440465    2562 generic.go:356] "Generic (PLEG): container finished" podID="69326219-c4b6-4bfa-b215-8b1eaeb1cac4" containerID="0326aa327d21c40748c39287e50f07b3e24e5315084630bbdc2497066314bf5c" exitCode=0
Sep 09 14:12:53.440895 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:53.440536    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk" event={"ID":"69326219-c4b6-4bfa-b215-8b1eaeb1cac4","Type":"ContainerDied","Data":"0326aa327d21c40748c39287e50f07b3e24e5315084630bbdc2497066314bf5c"}
Sep 09 14:12:53.440895 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:53.440859    2562 scope.go:117] "RemoveContainer" containerID="0326aa327d21c40748c39287e50f07b3e24e5315084630bbdc2497066314bf5c"
Sep 09 14:12:54.446107 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:12:54.446069    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-jj6kk" event={"ID":"69326219-c4b6-4bfa-b215-8b1eaeb1cac4","Type":"ContainerStarted","Data":"bff7ef0b22a60947e701a40fb6b458f3bc1d088b67d2062c7f9e53cce354ecd2"}
Sep 09 14:13:17.352863 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:13:17.352833    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:13:17.892215 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:13:17.892163    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:13:19.073721 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:13:19.073675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:13:19.131730 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:13:19.131698    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:13:28.906815 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:13:28.906707    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:13:28.984858 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:13:28.984816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:13:29.673800 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:13:29.673763    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:13:29.774931 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:13:29.774902    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:13:29.877320 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:13:29.877292    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:13:45.345602 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:13:45.345559    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:13:45.441227 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:13:45.441196    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:14:10.388792 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:10.388757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:14:10.449112 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:10.449077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:14:22.665829 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:22.665780    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:14:32.683403 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:32.683366    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:14:32.782202 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:32.782150    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:14:33.461789 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.461745    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj"]
Sep 09 14:14:33.462423 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.462400    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40" containerName="registry"
Sep 09 14:14:33.462423 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.462426    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40" containerName="registry"
Sep 09 14:14:33.462576 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.462548    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="67c1a8d3-8a30-41bb-81f7-7fcfc4edaa40" containerName="registry"
Sep 09 14:14:33.465413 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.465390    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj"
Sep 09 14:14:33.468021 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.467998    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tpr4d\""
Sep 09 14:14:33.468161 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.468140    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 14:14:33.468758 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.468740    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 14:14:33.479729 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.479709    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj"]
Sep 09 14:14:33.520731 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.520707    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njgbp\" (UniqueName: \"kubernetes.io/projected/55de343a-986b-44dc-9b97-8b0385564679-kube-api-access-njgbp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj\" (UID: \"55de343a-986b-44dc-9b97-8b0385564679\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj"
Sep 09 14:14:33.520847 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.520738    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55de343a-986b-44dc-9b97-8b0385564679-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj\" (UID: \"55de343a-986b-44dc-9b97-8b0385564679\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj"
Sep 09 14:14:33.520847 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.520797    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55de343a-986b-44dc-9b97-8b0385564679-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj\" (UID: \"55de343a-986b-44dc-9b97-8b0385564679\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj"
Sep 09 14:14:33.622114 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.622086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njgbp\" (UniqueName: \"kubernetes.io/projected/55de343a-986b-44dc-9b97-8b0385564679-kube-api-access-njgbp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj\" (UID: \"55de343a-986b-44dc-9b97-8b0385564679\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj"
Sep 09 14:14:33.622241 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.622120    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55de343a-986b-44dc-9b97-8b0385564679-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj\" (UID: \"55de343a-986b-44dc-9b97-8b0385564679\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj"
Sep 09 14:14:33.622241 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.622157    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55de343a-986b-44dc-9b97-8b0385564679-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj\" (UID: \"55de343a-986b-44dc-9b97-8b0385564679\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj"
Sep 09 14:14:33.622594 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.622574    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55de343a-986b-44dc-9b97-8b0385564679-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj\" (UID: \"55de343a-986b-44dc-9b97-8b0385564679\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj"
Sep 09 14:14:33.622629 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.622589    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55de343a-986b-44dc-9b97-8b0385564679-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj\" (UID: \"55de343a-986b-44dc-9b97-8b0385564679\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj"
Sep 09 14:14:33.630470 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.630451    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njgbp\" (UniqueName: \"kubernetes.io/projected/55de343a-986b-44dc-9b97-8b0385564679-kube-api-access-njgbp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj\" (UID: \"55de343a-986b-44dc-9b97-8b0385564679\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj"
Sep 09 14:14:33.774514 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:33.774442    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj"
Sep 09 14:14:34.043409 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:34.043326    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj"]
Sep 09 14:14:34.046182 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:14:34.046139    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55de343a_986b_44dc_9b97_8b0385564679.slice/crio-0c5aeb1daf51338fe5be1ad51325745036e99394e04dd30245f8db4e06433473 WatchSource:0}: Error finding container 0c5aeb1daf51338fe5be1ad51325745036e99394e04dd30245f8db4e06433473: Status 404 returned error can't find the container with id 0c5aeb1daf51338fe5be1ad51325745036e99394e04dd30245f8db4e06433473
Sep 09 14:14:34.812208 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:34.812156    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj" event={"ID":"55de343a-986b-44dc-9b97-8b0385564679","Type":"ContainerStarted","Data":"0c5aeb1daf51338fe5be1ad51325745036e99394e04dd30245f8db4e06433473"}
Sep 09 14:14:40.836053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:40.836020    2562 generic.go:356] "Generic (PLEG): container finished" podID="55de343a-986b-44dc-9b97-8b0385564679" containerID="41750605b1450d198884456668d53d6c019be93611fd60e35d0cd66ea80c756f" exitCode=0
Sep 09 14:14:40.836499 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:40.836108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj" event={"ID":"55de343a-986b-44dc-9b97-8b0385564679","Type":"ContainerDied","Data":"41750605b1450d198884456668d53d6c019be93611fd60e35d0cd66ea80c756f"}
Sep 09 14:14:43.850506 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:43.850471    2562 generic.go:356] "Generic (PLEG): container finished" podID="55de343a-986b-44dc-9b97-8b0385564679" containerID="62ec739166dda0a915dbe4830775be0f9157dc06820056455291d158b774c058" exitCode=0
Sep 09 14:14:43.850872 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:43.850519    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj" event={"ID":"55de343a-986b-44dc-9b97-8b0385564679","Type":"ContainerDied","Data":"62ec739166dda0a915dbe4830775be0f9157dc06820056455291d158b774c058"}
Sep 09 14:14:51.885661 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:51.885619    2562 generic.go:356] "Generic (PLEG): container finished" podID="55de343a-986b-44dc-9b97-8b0385564679" containerID="66ccf66bd85a09e05ad90864c3a32a61ffccab6af7b9cee5a9f68cb9a26ac214" exitCode=0
Sep 09 14:14:51.886043 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:51.885703    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj" event={"ID":"55de343a-986b-44dc-9b97-8b0385564679","Type":"ContainerDied","Data":"66ccf66bd85a09e05ad90864c3a32a61ffccab6af7b9cee5a9f68cb9a26ac214"}
Sep 09 14:14:53.012330 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:53.012307    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj"
Sep 09 14:14:53.179389 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:53.179319    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55de343a-986b-44dc-9b97-8b0385564679-bundle\") pod \"55de343a-986b-44dc-9b97-8b0385564679\" (UID: \"55de343a-986b-44dc-9b97-8b0385564679\") "
Sep 09 14:14:53.179389 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:53.179355    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55de343a-986b-44dc-9b97-8b0385564679-util\") pod \"55de343a-986b-44dc-9b97-8b0385564679\" (UID: \"55de343a-986b-44dc-9b97-8b0385564679\") "
Sep 09 14:14:53.179547 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:53.179408    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njgbp\" (UniqueName: \"kubernetes.io/projected/55de343a-986b-44dc-9b97-8b0385564679-kube-api-access-njgbp\") pod \"55de343a-986b-44dc-9b97-8b0385564679\" (UID: \"55de343a-986b-44dc-9b97-8b0385564679\") "
Sep 09 14:14:53.180068 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:53.180045    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55de343a-986b-44dc-9b97-8b0385564679-bundle" (OuterVolumeSpecName: "bundle") pod "55de343a-986b-44dc-9b97-8b0385564679" (UID: "55de343a-986b-44dc-9b97-8b0385564679"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:14:53.181642 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:53.181621    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55de343a-986b-44dc-9b97-8b0385564679-kube-api-access-njgbp" (OuterVolumeSpecName: "kube-api-access-njgbp") pod "55de343a-986b-44dc-9b97-8b0385564679" (UID: "55de343a-986b-44dc-9b97-8b0385564679"). InnerVolumeSpecName "kube-api-access-njgbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:14:53.184466 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:53.184437    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55de343a-986b-44dc-9b97-8b0385564679-util" (OuterVolumeSpecName: "util") pod "55de343a-986b-44dc-9b97-8b0385564679" (UID: "55de343a-986b-44dc-9b97-8b0385564679"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:14:53.280234 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:53.280208    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55de343a-986b-44dc-9b97-8b0385564679-util\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:14:53.280234 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:53.280233    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njgbp\" (UniqueName: \"kubernetes.io/projected/55de343a-986b-44dc-9b97-8b0385564679-kube-api-access-njgbp\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:14:53.280360 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:53.280248    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55de343a-986b-44dc-9b97-8b0385564679-bundle\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:14:53.899214 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:53.899164    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj" event={"ID":"55de343a-986b-44dc-9b97-8b0385564679","Type":"ContainerDied","Data":"0c5aeb1daf51338fe5be1ad51325745036e99394e04dd30245f8db4e06433473"}
Sep 09 14:14:53.899335 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:53.899234    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c5aeb1daf51338fe5be1ad51325745036e99394e04dd30245f8db4e06433473"
Sep 09 14:14:53.899335 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:53.899192    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q22fj"
Sep 09 14:14:57.935232 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:57.935196    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:14:59.366586 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:14:59.366548    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:00.666701 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:00.666653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:01.269539 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.269501    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9phb"]
Sep 09 14:15:01.269785 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.269774    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55de343a-986b-44dc-9b97-8b0385564679" containerName="util"
Sep 09 14:15:01.269827 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.269787    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="55de343a-986b-44dc-9b97-8b0385564679" containerName="util"
Sep 09 14:15:01.269827 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.269798    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55de343a-986b-44dc-9b97-8b0385564679" containerName="extract"
Sep 09 14:15:01.269827 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.269804    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="55de343a-986b-44dc-9b97-8b0385564679" containerName="extract"
Sep 09 14:15:01.269827 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.269824    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55de343a-986b-44dc-9b97-8b0385564679" containerName="pull"
Sep 09 14:15:01.269938 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.269830    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="55de343a-986b-44dc-9b97-8b0385564679" containerName="pull"
Sep 09 14:15:01.269938 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.269875    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="55de343a-986b-44dc-9b97-8b0385564679" containerName="extract"
Sep 09 14:15:01.272510 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.272491    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9phb"
Sep 09 14:15:01.274653 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.274631    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zrbdt\""
Sep 09 14:15:01.274797 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.274776    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 09 14:15:01.275014 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.274997    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 09 14:15:01.285498 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.285477    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9phb"]
Sep 09 14:15:01.438882 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.438843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/127209e7-4e02-48b8-b515-fd31af6ae055-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-k9phb\" (UID: \"127209e7-4e02-48b8-b515-fd31af6ae055\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9phb"
Sep 09 14:15:01.439035 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.438887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7g7c\" (UniqueName: \"kubernetes.io/projected/127209e7-4e02-48b8-b515-fd31af6ae055-kube-api-access-q7g7c\") pod \"cert-manager-operator-controller-manager-55c444bf86-k9phb\" (UID: \"127209e7-4e02-48b8-b515-fd31af6ae055\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9phb"
Sep 09 14:15:01.539613 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.539540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/127209e7-4e02-48b8-b515-fd31af6ae055-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-k9phb\" (UID: \"127209e7-4e02-48b8-b515-fd31af6ae055\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9phb"
Sep 09 14:15:01.539613 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.539583    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7g7c\" (UniqueName: \"kubernetes.io/projected/127209e7-4e02-48b8-b515-fd31af6ae055-kube-api-access-q7g7c\") pod \"cert-manager-operator-controller-manager-55c444bf86-k9phb\" (UID: \"127209e7-4e02-48b8-b515-fd31af6ae055\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9phb"
Sep 09 14:15:01.539943 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.539923    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/127209e7-4e02-48b8-b515-fd31af6ae055-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-k9phb\" (UID: \"127209e7-4e02-48b8-b515-fd31af6ae055\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9phb"
Sep 09 14:15:01.548115 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.548077    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7g7c\" (UniqueName: \"kubernetes.io/projected/127209e7-4e02-48b8-b515-fd31af6ae055-kube-api-access-q7g7c\") pod \"cert-manager-operator-controller-manager-55c444bf86-k9phb\" (UID: \"127209e7-4e02-48b8-b515-fd31af6ae055\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9phb"
Sep 09 14:15:01.581899 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.581862    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9phb"
Sep 09 14:15:01.882437 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.882396    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9phb"]
Sep 09 14:15:01.885943 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:15:01.885917    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127209e7_4e02_48b8_b515_fd31af6ae055.slice/crio-9e7234243a9f11851b3e2f20bde7b8dd01641d032394a34f05f3c1eef231427b WatchSource:0}: Error finding container 9e7234243a9f11851b3e2f20bde7b8dd01641d032394a34f05f3c1eef231427b: Status 404 returned error can't find the container with id 9e7234243a9f11851b3e2f20bde7b8dd01641d032394a34f05f3c1eef231427b
Sep 09 14:15:01.930616 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:01.930589    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9phb" event={"ID":"127209e7-4e02-48b8-b515-fd31af6ae055","Type":"ContainerStarted","Data":"9e7234243a9f11851b3e2f20bde7b8dd01641d032394a34f05f3c1eef231427b"}
Sep 09 14:15:02.931913 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:02.931874    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:03.170766 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:03.170729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:03.940762 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:03.940730    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9phb" event={"ID":"127209e7-4e02-48b8-b515-fd31af6ae055","Type":"ContainerStarted","Data":"abb934ed8641804341b52744737dd48426b68820e2cc5a44649c72dc2f2a76ca"}
Sep 09 14:15:03.962996 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:03.962949    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-k9phb" podStartSLOduration=1.062200268 podStartE2EDuration="2.96293433s" totalImagesPullingTime="1.900734062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:15:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:15:03.960749273 +0000 UTC m=+268.687289376" watchObservedRunningTime="2026-09-09 14:15:03.96293433 +0000 UTC m=+268.689474431"
Sep 09 14:15:04.363161 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:04.363114    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:04.476575 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:04.476540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:04.596546 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:04.596512    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:04.697227 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:04.697111    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:06.823550 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:06.823521    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:07.168752 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:07.168675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:07.344525 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:07.344495    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xdr6p"]
Sep 09 14:15:07.347815 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:07.347798    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xdr6p"
Sep 09 14:15:07.350519 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:07.350495    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-sbh2d\""
Sep 09 14:15:07.350660 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:07.350558    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 09 14:15:07.350660 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:07.350501    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 09 14:15:07.356754 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:07.356729    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xdr6p"]
Sep 09 14:15:07.484110 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:07.484054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dccdd471-e4a7-4452-8ea6-f415dfbd5625-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xdr6p\" (UID: \"dccdd471-e4a7-4452-8ea6-f415dfbd5625\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xdr6p"
Sep 09 14:15:07.484110 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:07.484100    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxkjz\" (UniqueName: \"kubernetes.io/projected/dccdd471-e4a7-4452-8ea6-f415dfbd5625-kube-api-access-lxkjz\") pod \"cert-manager-cainjector-559cdd8c87-xdr6p\" (UID: \"dccdd471-e4a7-4452-8ea6-f415dfbd5625\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xdr6p"
Sep 09 14:15:07.584394 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:07.584369    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dccdd471-e4a7-4452-8ea6-f415dfbd5625-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xdr6p\" (UID: \"dccdd471-e4a7-4452-8ea6-f415dfbd5625\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xdr6p"
Sep 09 14:15:07.584505 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:07.584410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxkjz\" (UniqueName: \"kubernetes.io/projected/dccdd471-e4a7-4452-8ea6-f415dfbd5625-kube-api-access-lxkjz\") pod \"cert-manager-cainjector-559cdd8c87-xdr6p\" (UID: \"dccdd471-e4a7-4452-8ea6-f415dfbd5625\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xdr6p"
Sep 09 14:15:07.592648 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:07.592619    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dccdd471-e4a7-4452-8ea6-f415dfbd5625-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xdr6p\" (UID: \"dccdd471-e4a7-4452-8ea6-f415dfbd5625\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xdr6p"
Sep 09 14:15:07.592884 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:07.592865    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxkjz\" (UniqueName: \"kubernetes.io/projected/dccdd471-e4a7-4452-8ea6-f415dfbd5625-kube-api-access-lxkjz\") pod \"cert-manager-cainjector-559cdd8c87-xdr6p\" (UID: \"dccdd471-e4a7-4452-8ea6-f415dfbd5625\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xdr6p"
Sep 09 14:15:07.656819 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:07.656791    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xdr6p"
Sep 09 14:15:07.927990 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:07.927962    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xdr6p"]
Sep 09 14:15:07.931024 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:15:07.930985    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddccdd471_e4a7_4452_8ea6_f415dfbd5625.slice/crio-d13d7016a54bd50841c48e60c29acc455b45034a5ec7b69eb2bd843ea4d72a26 WatchSource:0}: Error finding container d13d7016a54bd50841c48e60c29acc455b45034a5ec7b69eb2bd843ea4d72a26: Status 404 returned error can't find the container with id d13d7016a54bd50841c48e60c29acc455b45034a5ec7b69eb2bd843ea4d72a26
Sep 09 14:15:07.961346 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:07.961315    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xdr6p" event={"ID":"dccdd471-e4a7-4452-8ea6-f415dfbd5625","Type":"ContainerStarted","Data":"d13d7016a54bd50841c48e60c29acc455b45034a5ec7b69eb2bd843ea4d72a26"}
Sep 09 14:15:09.728431 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:09.728392    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:09.786876 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:09.786836    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:11.981500 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:11.981458    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xdr6p" event={"ID":"dccdd471-e4a7-4452-8ea6-f415dfbd5625","Type":"ContainerStarted","Data":"c4278a4c03001cbf1d8244c7d487072a7c4b8c73ef40d178e1bbf7159cf1422d"}
Sep 09 14:15:11.998826 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:11.998783    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xdr6p" podStartSLOduration=1.918708317 podStartE2EDuration="4.99876779s" totalImagesPullingTime="3.080059473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:15:11.998153712 +0000 UTC m=+276.724693815" watchObservedRunningTime="2026-09-09 14:15:11.99876779 +0000 UTC m=+276.725307892"
Sep 09 14:15:14.585483 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:14.585443    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:29.345385 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:29.345346    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:29.443765 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:29.443713    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:30.622583 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:30.622550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:30.715766 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:30.715736    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:35.480869 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:35.480827    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:35.581049 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:35.581007    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:35.695064 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:35.695038    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:15:35.697459 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:35.697439    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:15:35.706724 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:35.706695    2562 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 14:15:37.091964 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.091932    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87"]
Sep 09 14:15:37.095084 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.095068    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87"
Sep 09 14:15:37.097430 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.097408    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 14:15:37.097968 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.097950    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 14:15:37.098060 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.097951    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tpr4d\""
Sep 09 14:15:37.103666 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.103641    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87"]
Sep 09 14:15:37.187994 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.187961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82f9b704-5e12-4fa8-9e29-039d25987c70-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87\" (UID: \"82f9b704-5e12-4fa8-9e29-039d25987c70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87"
Sep 09 14:15:37.188134 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.188019    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82f9b704-5e12-4fa8-9e29-039d25987c70-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87\" (UID: \"82f9b704-5e12-4fa8-9e29-039d25987c70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87"
Sep 09 14:15:37.188134 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.188054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wwvq\" (UniqueName: \"kubernetes.io/projected/82f9b704-5e12-4fa8-9e29-039d25987c70-kube-api-access-4wwvq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87\" (UID: \"82f9b704-5e12-4fa8-9e29-039d25987c70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87"
Sep 09 14:15:37.211738 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.211704    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:37.288439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.288404    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82f9b704-5e12-4fa8-9e29-039d25987c70-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87\" (UID: \"82f9b704-5e12-4fa8-9e29-039d25987c70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87"
Sep 09 14:15:37.288617 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.288447    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82f9b704-5e12-4fa8-9e29-039d25987c70-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87\" (UID: \"82f9b704-5e12-4fa8-9e29-039d25987c70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87"
Sep 09 14:15:37.288617 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.288467    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wwvq\" (UniqueName: \"kubernetes.io/projected/82f9b704-5e12-4fa8-9e29-039d25987c70-kube-api-access-4wwvq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87\" (UID: \"82f9b704-5e12-4fa8-9e29-039d25987c70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87"
Sep 09 14:15:37.288805 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.288784    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82f9b704-5e12-4fa8-9e29-039d25987c70-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87\" (UID: \"82f9b704-5e12-4fa8-9e29-039d25987c70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87"
Sep 09 14:15:37.288870 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.288827    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82f9b704-5e12-4fa8-9e29-039d25987c70-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87\" (UID: \"82f9b704-5e12-4fa8-9e29-039d25987c70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87"
Sep 09 14:15:37.296281 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.296259    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wwvq\" (UniqueName: \"kubernetes.io/projected/82f9b704-5e12-4fa8-9e29-039d25987c70-kube-api-access-4wwvq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87\" (UID: \"82f9b704-5e12-4fa8-9e29-039d25987c70\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87"
Sep 09 14:15:37.405064 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.404979    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87"
Sep 09 14:15:37.673264 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:37.673225    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87"]
Sep 09 14:15:37.675856 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:15:37.675831    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f9b704_5e12_4fa8_9e29_039d25987c70.slice/crio-1b575eb12e5c976260e38e7a7aa8bb78068ef657ae26e6ca279002d3c87b7a1f WatchSource:0}: Error finding container 1b575eb12e5c976260e38e7a7aa8bb78068ef657ae26e6ca279002d3c87b7a1f: Status 404 returned error can't find the container with id 1b575eb12e5c976260e38e7a7aa8bb78068ef657ae26e6ca279002d3c87b7a1f
Sep 09 14:15:38.094857 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:38.094824    2562 generic.go:356] "Generic (PLEG): container finished" podID="82f9b704-5e12-4fa8-9e29-039d25987c70" containerID="456955f321bedda574a9204ebf6068e1f00f3eeb6675d9233e51c4b45fb7dced" exitCode=0
Sep 09 14:15:38.095340 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:38.094861    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87" event={"ID":"82f9b704-5e12-4fa8-9e29-039d25987c70","Type":"ContainerDied","Data":"456955f321bedda574a9204ebf6068e1f00f3eeb6675d9233e51c4b45fb7dced"}
Sep 09 14:15:38.095340 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:38.094898    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87" event={"ID":"82f9b704-5e12-4fa8-9e29-039d25987c70","Type":"ContainerStarted","Data":"1b575eb12e5c976260e38e7a7aa8bb78068ef657ae26e6ca279002d3c87b7a1f"}
Sep 09 14:15:38.095496 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:38.095478    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 14:15:39.100811 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:39.100778    2562 generic.go:356] "Generic (PLEG): container finished" podID="82f9b704-5e12-4fa8-9e29-039d25987c70" containerID="66775e3b7b3ccaf151f4e5fa1063e9771981ca182663b6b61f967abd175fca75" exitCode=0
Sep 09 14:15:39.101332 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:39.100827    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87" event={"ID":"82f9b704-5e12-4fa8-9e29-039d25987c70","Type":"ContainerDied","Data":"66775e3b7b3ccaf151f4e5fa1063e9771981ca182663b6b61f967abd175fca75"}
Sep 09 14:15:40.106667 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:40.106628    2562 generic.go:356] "Generic (PLEG): container finished" podID="82f9b704-5e12-4fa8-9e29-039d25987c70" containerID="7ec951a95aef3c3701f14f09c23b3c24dfa29385cf2aeae58d8e6b12429b6288" exitCode=0
Sep 09 14:15:40.107067 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:40.106713    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87" event={"ID":"82f9b704-5e12-4fa8-9e29-039d25987c70","Type":"ContainerDied","Data":"7ec951a95aef3c3701f14f09c23b3c24dfa29385cf2aeae58d8e6b12429b6288"}
Sep 09 14:15:41.239235 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:41.239211    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87"
Sep 09 14:15:41.318288 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:41.318261    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wwvq\" (UniqueName: \"kubernetes.io/projected/82f9b704-5e12-4fa8-9e29-039d25987c70-kube-api-access-4wwvq\") pod \"82f9b704-5e12-4fa8-9e29-039d25987c70\" (UID: \"82f9b704-5e12-4fa8-9e29-039d25987c70\") "
Sep 09 14:15:41.318469 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:41.318294    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82f9b704-5e12-4fa8-9e29-039d25987c70-util\") pod \"82f9b704-5e12-4fa8-9e29-039d25987c70\" (UID: \"82f9b704-5e12-4fa8-9e29-039d25987c70\") "
Sep 09 14:15:41.318469 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:41.318346    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82f9b704-5e12-4fa8-9e29-039d25987c70-bundle\") pod \"82f9b704-5e12-4fa8-9e29-039d25987c70\" (UID: \"82f9b704-5e12-4fa8-9e29-039d25987c70\") "
Sep 09 14:15:41.319008 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:41.318982    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f9b704-5e12-4fa8-9e29-039d25987c70-bundle" (OuterVolumeSpecName: "bundle") pod "82f9b704-5e12-4fa8-9e29-039d25987c70" (UID: "82f9b704-5e12-4fa8-9e29-039d25987c70"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:15:41.320360 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:41.320336    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82f9b704-5e12-4fa8-9e29-039d25987c70-kube-api-access-4wwvq" (OuterVolumeSpecName: "kube-api-access-4wwvq") pod "82f9b704-5e12-4fa8-9e29-039d25987c70" (UID: "82f9b704-5e12-4fa8-9e29-039d25987c70"). InnerVolumeSpecName "kube-api-access-4wwvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:15:41.323804 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:41.323780    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82f9b704-5e12-4fa8-9e29-039d25987c70-util" (OuterVolumeSpecName: "util") pod "82f9b704-5e12-4fa8-9e29-039d25987c70" (UID: "82f9b704-5e12-4fa8-9e29-039d25987c70"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:15:41.419368 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:41.419275    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82f9b704-5e12-4fa8-9e29-039d25987c70-bundle\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:15:41.419368 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:41.419317    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wwvq\" (UniqueName: \"kubernetes.io/projected/82f9b704-5e12-4fa8-9e29-039d25987c70-kube-api-access-4wwvq\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:15:41.419368 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:41.419327    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82f9b704-5e12-4fa8-9e29-039d25987c70-util\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:15:42.116879 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:42.116792    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87" event={"ID":"82f9b704-5e12-4fa8-9e29-039d25987c70","Type":"ContainerDied","Data":"1b575eb12e5c976260e38e7a7aa8bb78068ef657ae26e6ca279002d3c87b7a1f"}
Sep 09 14:15:42.116879 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:42.116812    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzlz87"
Sep 09 14:15:42.116879 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:42.116836    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b575eb12e5c976260e38e7a7aa8bb78068ef657ae26e6ca279002d3c87b7a1f"
Sep 09 14:15:49.423211 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.423158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:49.481164 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.481134    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"]
Sep 09 14:15:49.481433 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.481421    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82f9b704-5e12-4fa8-9e29-039d25987c70" containerName="util"
Sep 09 14:15:49.481474 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.481434    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="82f9b704-5e12-4fa8-9e29-039d25987c70" containerName="util"
Sep 09 14:15:49.481474 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.481451    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82f9b704-5e12-4fa8-9e29-039d25987c70" containerName="pull"
Sep 09 14:15:49.481474 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.481457    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="82f9b704-5e12-4fa8-9e29-039d25987c70" containerName="pull"
Sep 09 14:15:49.481474 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.481462    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82f9b704-5e12-4fa8-9e29-039d25987c70" containerName="extract"
Sep 09 14:15:49.481474 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.481468    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="82f9b704-5e12-4fa8-9e29-039d25987c70" containerName="extract"
Sep 09 14:15:49.481645 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.481522    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="82f9b704-5e12-4fa8-9e29-039d25987c70" containerName="extract"
Sep 09 14:15:49.483973 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.483958    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"
Sep 09 14:15:49.486999 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.486972    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 09 14:15:49.487128 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.487111    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vtcw9\""
Sep 09 14:15:49.487220 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.487137    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 09 14:15:49.487220 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.487186    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 14:15:49.487220 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.487203    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 14:15:49.487388 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.487217    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 09 14:15:49.494442 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.494421    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"]
Sep 09 14:15:49.575623 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.575596    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/433da259-09d6-4085-82f5-9689ed5dc8b6-manager-config\") pod \"lws-controller-manager-784f875f86-rczvl\" (UID: \"433da259-09d6-4085-82f5-9689ed5dc8b6\") " pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"
Sep 09 14:15:49.575623 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.575624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glhk6\" (UniqueName: \"kubernetes.io/projected/433da259-09d6-4085-82f5-9689ed5dc8b6-kube-api-access-glhk6\") pod \"lws-controller-manager-784f875f86-rczvl\" (UID: \"433da259-09d6-4085-82f5-9689ed5dc8b6\") " pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"
Sep 09 14:15:49.575832 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.575646    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/433da259-09d6-4085-82f5-9689ed5dc8b6-metrics-cert\") pod \"lws-controller-manager-784f875f86-rczvl\" (UID: \"433da259-09d6-4085-82f5-9689ed5dc8b6\") " pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"
Sep 09 14:15:49.575832 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.575750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/433da259-09d6-4085-82f5-9689ed5dc8b6-cert\") pod \"lws-controller-manager-784f875f86-rczvl\" (UID: \"433da259-09d6-4085-82f5-9689ed5dc8b6\") " pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"
Sep 09 14:15:49.676766 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.676703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/433da259-09d6-4085-82f5-9689ed5dc8b6-manager-config\") pod \"lws-controller-manager-784f875f86-rczvl\" (UID: \"433da259-09d6-4085-82f5-9689ed5dc8b6\") " pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"
Sep 09 14:15:49.676766 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.676732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glhk6\" (UniqueName: \"kubernetes.io/projected/433da259-09d6-4085-82f5-9689ed5dc8b6-kube-api-access-glhk6\") pod \"lws-controller-manager-784f875f86-rczvl\" (UID: \"433da259-09d6-4085-82f5-9689ed5dc8b6\") " pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"
Sep 09 14:15:49.676766 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.676752    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/433da259-09d6-4085-82f5-9689ed5dc8b6-metrics-cert\") pod \"lws-controller-manager-784f875f86-rczvl\" (UID: \"433da259-09d6-4085-82f5-9689ed5dc8b6\") " pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"
Sep 09 14:15:49.677032 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.677015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/433da259-09d6-4085-82f5-9689ed5dc8b6-cert\") pod \"lws-controller-manager-784f875f86-rczvl\" (UID: \"433da259-09d6-4085-82f5-9689ed5dc8b6\") " pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"
Sep 09 14:15:49.677413 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.677393    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/433da259-09d6-4085-82f5-9689ed5dc8b6-manager-config\") pod \"lws-controller-manager-784f875f86-rczvl\" (UID: \"433da259-09d6-4085-82f5-9689ed5dc8b6\") " pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"
Sep 09 14:15:49.679126 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.679096    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/433da259-09d6-4085-82f5-9689ed5dc8b6-metrics-cert\") pod \"lws-controller-manager-784f875f86-rczvl\" (UID: \"433da259-09d6-4085-82f5-9689ed5dc8b6\") " pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"
Sep 09 14:15:49.679226 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.679132    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/433da259-09d6-4085-82f5-9689ed5dc8b6-cert\") pod \"lws-controller-manager-784f875f86-rczvl\" (UID: \"433da259-09d6-4085-82f5-9689ed5dc8b6\") " pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"
Sep 09 14:15:49.684799 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.684767    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glhk6\" (UniqueName: \"kubernetes.io/projected/433da259-09d6-4085-82f5-9689ed5dc8b6-kube-api-access-glhk6\") pod \"lws-controller-manager-784f875f86-rczvl\" (UID: \"433da259-09d6-4085-82f5-9689ed5dc8b6\") " pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"
Sep 09 14:15:49.793215 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:49.793165    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"
Sep 09 14:15:50.061094 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:50.061065    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"]
Sep 09 14:15:50.064286 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:15:50.064260    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod433da259_09d6_4085_82f5_9689ed5dc8b6.slice/crio-0bfd0cfeb9de97d022b1f8795daaf5f20ba0e58ebfb6fced2ac0ca7ac54aab8a WatchSource:0}: Error finding container 0bfd0cfeb9de97d022b1f8795daaf5f20ba0e58ebfb6fced2ac0ca7ac54aab8a: Status 404 returned error can't find the container with id 0bfd0cfeb9de97d022b1f8795daaf5f20ba0e58ebfb6fced2ac0ca7ac54aab8a
Sep 09 14:15:50.150717 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:50.150687    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl" event={"ID":"433da259-09d6-4085-82f5-9689ed5dc8b6","Type":"ContainerStarted","Data":"0bfd0cfeb9de97d022b1f8795daaf5f20ba0e58ebfb6fced2ac0ca7ac54aab8a"}
Sep 09 14:15:50.496072 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:50.495963    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:53.165025 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:53.164992    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl" event={"ID":"433da259-09d6-4085-82f5-9689ed5dc8b6","Type":"ContainerStarted","Data":"b82f368e1fcc4afed1755ea6f052326d244388800b6595b79561399c25ba4d06"}
Sep 09 14:15:53.165420 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:53.165111    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"
Sep 09 14:15:53.183144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:53.183099    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl" podStartSLOduration=2.045084741 podStartE2EDuration="4.18308649s" totalImagesPullingTime="2.138001749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:15:53.181471173 +0000 UTC m=+317.908011276" watchObservedRunningTime="2026-09-09 14:15:53.18308649 +0000 UTC m=+317.909626640"
Sep 09 14:15:53.286474 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:53.286436    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:53.381303 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:53.381264    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:53.910505 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:53.910468    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:54.191446 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.191353    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:54.289317 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.289279    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:54.335544 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.335515    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n"]
Sep 09 14:15:54.338899 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.338883    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n"
Sep 09 14:15:54.341158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.341136    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tpr4d\""
Sep 09 14:15:54.341377 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.341362    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 09 14:15:54.341885 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.341870    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 09 14:15:54.349796 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.349761    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"]
Sep 09 14:15:54.352984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.352966    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n"]
Sep 09 14:15:54.353076 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.353064    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.355390 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.355369    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 14:15:54.355851 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.355832    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 14:15:54.356107 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.356093    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 14:15:54.356380 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.356365    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 14:15:54.356473 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.356451    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6nlw9\""
Sep 09 14:15:54.371367 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.371345    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"]
Sep 09 14:15:54.414575 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.414546    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36953ed7-5963-41a8-b18a-604b0cfaa2d0-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n\" (UID: \"36953ed7-5963-41a8-b18a-604b0cfaa2d0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n"
Sep 09 14:15:54.414675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.414585    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1215e5a3-04eb-4bbc-9dd9-c17fc34257e3-manifests\") pod \"opendatahub-operator-controller-manager-686db84dc8-8wff4\" (UID: \"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.414675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.414612    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1215e5a3-04eb-4bbc-9dd9-c17fc34257e3-tmp\") pod \"opendatahub-operator-controller-manager-686db84dc8-8wff4\" (UID: \"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.414675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.414662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1215e5a3-04eb-4bbc-9dd9-c17fc34257e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-686db84dc8-8wff4\" (UID: \"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.414781 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.414691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwxcn\" (UniqueName: \"kubernetes.io/projected/1215e5a3-04eb-4bbc-9dd9-c17fc34257e3-kube-api-access-rwxcn\") pod \"opendatahub-operator-controller-manager-686db84dc8-8wff4\" (UID: \"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.414781 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.414716    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4mfv\" (UniqueName: \"kubernetes.io/projected/36953ed7-5963-41a8-b18a-604b0cfaa2d0-kube-api-access-h4mfv\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n\" (UID: \"36953ed7-5963-41a8-b18a-604b0cfaa2d0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n"
Sep 09 14:15:54.414781 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.414742    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1215e5a3-04eb-4bbc-9dd9-c17fc34257e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-686db84dc8-8wff4\" (UID: \"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.414781 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.414769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36953ed7-5963-41a8-b18a-604b0cfaa2d0-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n\" (UID: \"36953ed7-5963-41a8-b18a-604b0cfaa2d0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n"
Sep 09 14:15:54.514836 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.514758    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:54.515085 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.515062    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36953ed7-5963-41a8-b18a-604b0cfaa2d0-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n\" (UID: \"36953ed7-5963-41a8-b18a-604b0cfaa2d0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n"
Sep 09 14:15:54.515134 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.515105    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1215e5a3-04eb-4bbc-9dd9-c17fc34257e3-manifests\") pod \"opendatahub-operator-controller-manager-686db84dc8-8wff4\" (UID: \"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.515200 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.515131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1215e5a3-04eb-4bbc-9dd9-c17fc34257e3-tmp\") pod \"opendatahub-operator-controller-manager-686db84dc8-8wff4\" (UID: \"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.515200 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.515162    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1215e5a3-04eb-4bbc-9dd9-c17fc34257e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-686db84dc8-8wff4\" (UID: \"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.515334 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.515220    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwxcn\" (UniqueName: \"kubernetes.io/projected/1215e5a3-04eb-4bbc-9dd9-c17fc34257e3-kube-api-access-rwxcn\") pod \"opendatahub-operator-controller-manager-686db84dc8-8wff4\" (UID: \"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.515334 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.515258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4mfv\" (UniqueName: \"kubernetes.io/projected/36953ed7-5963-41a8-b18a-604b0cfaa2d0-kube-api-access-h4mfv\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n\" (UID: \"36953ed7-5963-41a8-b18a-604b0cfaa2d0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n"
Sep 09 14:15:54.515334 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.515294    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1215e5a3-04eb-4bbc-9dd9-c17fc34257e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-686db84dc8-8wff4\" (UID: \"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.515334 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.515322    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36953ed7-5963-41a8-b18a-604b0cfaa2d0-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n\" (UID: \"36953ed7-5963-41a8-b18a-604b0cfaa2d0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n"
Sep 09 14:15:54.515575 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.515552    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36953ed7-5963-41a8-b18a-604b0cfaa2d0-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n\" (UID: \"36953ed7-5963-41a8-b18a-604b0cfaa2d0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n"
Sep 09 14:15:54.515675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.515552    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1215e5a3-04eb-4bbc-9dd9-c17fc34257e3-manifests\") pod \"opendatahub-operator-controller-manager-686db84dc8-8wff4\" (UID: \"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.515675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.515592    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36953ed7-5963-41a8-b18a-604b0cfaa2d0-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n\" (UID: \"36953ed7-5963-41a8-b18a-604b0cfaa2d0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n"
Sep 09 14:15:54.517478 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.517449    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1215e5a3-04eb-4bbc-9dd9-c17fc34257e3-tmp\") pod \"opendatahub-operator-controller-manager-686db84dc8-8wff4\" (UID: \"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.517629 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.517610    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1215e5a3-04eb-4bbc-9dd9-c17fc34257e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-686db84dc8-8wff4\" (UID: \"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.517755 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.517738    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1215e5a3-04eb-4bbc-9dd9-c17fc34257e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-686db84dc8-8wff4\" (UID: \"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.523529 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.523502    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4mfv\" (UniqueName: \"kubernetes.io/projected/36953ed7-5963-41a8-b18a-604b0cfaa2d0-kube-api-access-h4mfv\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n\" (UID: \"36953ed7-5963-41a8-b18a-604b0cfaa2d0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n"
Sep 09 14:15:54.523611 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.523597    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwxcn\" (UniqueName: \"kubernetes.io/projected/1215e5a3-04eb-4bbc-9dd9-c17fc34257e3-kube-api-access-rwxcn\") pod \"opendatahub-operator-controller-manager-686db84dc8-8wff4\" (UID: \"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3\") " pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.615085 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.615057    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:54.647718 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.647698    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n"
Sep 09 14:15:54.662845 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.662825    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:15:54.720302 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.720209    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:54.821435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.821403    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:54.915285 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.915249    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:15:54.928504 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.928475    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n"]
Sep 09 14:15:54.930590 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:15:54.930564    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36953ed7_5963_41a8_b18a_604b0cfaa2d0.slice/crio-754db26257578b3878ba9a0c6d91bb79ef10129a11fed89f7f7c7e2d50a7b48b WatchSource:0}: Error finding container 754db26257578b3878ba9a0c6d91bb79ef10129a11fed89f7f7c7e2d50a7b48b: Status 404 returned error can't find the container with id 754db26257578b3878ba9a0c6d91bb79ef10129a11fed89f7f7c7e2d50a7b48b
Sep 09 14:15:54.949406 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:54.949379    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"]
Sep 09 14:15:54.963200 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:15:54.963153    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1215e5a3_04eb_4bbc_9dd9_c17fc34257e3.slice/crio-84036e4d2f7d189f5e764a943f2edc7d76256121fd8113c29e1089cd2e541682 WatchSource:0}: Error finding container 84036e4d2f7d189f5e764a943f2edc7d76256121fd8113c29e1089cd2e541682: Status 404 returned error can't find the container with id 84036e4d2f7d189f5e764a943f2edc7d76256121fd8113c29e1089cd2e541682
Sep 09 14:15:55.175723 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:55.175638    2562 generic.go:356] "Generic (PLEG): container finished" podID="36953ed7-5963-41a8-b18a-604b0cfaa2d0" containerID="4ddd53cbde4628fe9dec10dc46a20591b53f85f70af9f18750ba0d1877e1ceb1" exitCode=0
Sep 09 14:15:55.175723 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:55.175689    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n" event={"ID":"36953ed7-5963-41a8-b18a-604b0cfaa2d0","Type":"ContainerDied","Data":"4ddd53cbde4628fe9dec10dc46a20591b53f85f70af9f18750ba0d1877e1ceb1"}
Sep 09 14:15:55.175905 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:55.175748    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n" event={"ID":"36953ed7-5963-41a8-b18a-604b0cfaa2d0","Type":"ContainerStarted","Data":"754db26257578b3878ba9a0c6d91bb79ef10129a11fed89f7f7c7e2d50a7b48b"}
Sep 09 14:15:55.177101 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:55.177078    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4" event={"ID":"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3","Type":"ContainerStarted","Data":"84036e4d2f7d189f5e764a943f2edc7d76256121fd8113c29e1089cd2e541682"}
Sep 09 14:15:56.185614 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:56.185570    2562 generic.go:356] "Generic (PLEG): container finished" podID="36953ed7-5963-41a8-b18a-604b0cfaa2d0" containerID="5512c81303abfd53586b86d71d6706c96d2846615882b64a3114385becf8ac0e" exitCode=0
Sep 09 14:15:56.186063 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:56.185646    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n" event={"ID":"36953ed7-5963-41a8-b18a-604b0cfaa2d0","Type":"ContainerDied","Data":"5512c81303abfd53586b86d71d6706c96d2846615882b64a3114385becf8ac0e"}
Sep 09 14:15:57.193998 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:57.193961    2562 generic.go:356] "Generic (PLEG): container finished" podID="36953ed7-5963-41a8-b18a-604b0cfaa2d0" containerID="3c7202870ae30d3b889a35010a41e68c477c637b2b5e165cd26e0b103027b812" exitCode=0
Sep 09 14:15:57.194383 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:57.194042    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n" event={"ID":"36953ed7-5963-41a8-b18a-604b0cfaa2d0","Type":"ContainerDied","Data":"3c7202870ae30d3b889a35010a41e68c477c637b2b5e165cd26e0b103027b812"}
Sep 09 14:15:58.200415 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:58.200341    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4" event={"ID":"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3","Type":"ContainerStarted","Data":"c07084a108c10104efbc577ba69e2fdaf0ab7bb0be634241e6c43133ece08b01"}
Sep 09 14:15:58.328096 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:58.328066    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n"
Sep 09 14:15:58.451558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:58.451494    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36953ed7-5963-41a8-b18a-604b0cfaa2d0-util\") pod \"36953ed7-5963-41a8-b18a-604b0cfaa2d0\" (UID: \"36953ed7-5963-41a8-b18a-604b0cfaa2d0\") "
Sep 09 14:15:58.451558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:58.451522    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36953ed7-5963-41a8-b18a-604b0cfaa2d0-bundle\") pod \"36953ed7-5963-41a8-b18a-604b0cfaa2d0\" (UID: \"36953ed7-5963-41a8-b18a-604b0cfaa2d0\") "
Sep 09 14:15:58.451558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:58.451558    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4mfv\" (UniqueName: \"kubernetes.io/projected/36953ed7-5963-41a8-b18a-604b0cfaa2d0-kube-api-access-h4mfv\") pod \"36953ed7-5963-41a8-b18a-604b0cfaa2d0\" (UID: \"36953ed7-5963-41a8-b18a-604b0cfaa2d0\") "
Sep 09 14:15:58.452417 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:58.452389    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36953ed7-5963-41a8-b18a-604b0cfaa2d0-bundle" (OuterVolumeSpecName: "bundle") pod "36953ed7-5963-41a8-b18a-604b0cfaa2d0" (UID: "36953ed7-5963-41a8-b18a-604b0cfaa2d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:15:58.453572 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:58.453547    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36953ed7-5963-41a8-b18a-604b0cfaa2d0-kube-api-access-h4mfv" (OuterVolumeSpecName: "kube-api-access-h4mfv") pod "36953ed7-5963-41a8-b18a-604b0cfaa2d0" (UID: "36953ed7-5963-41a8-b18a-604b0cfaa2d0"). InnerVolumeSpecName "kube-api-access-h4mfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:15:58.458833 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:58.458809    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36953ed7-5963-41a8-b18a-604b0cfaa2d0-util" (OuterVolumeSpecName: "util") pod "36953ed7-5963-41a8-b18a-604b0cfaa2d0" (UID: "36953ed7-5963-41a8-b18a-604b0cfaa2d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:15:58.552464 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:58.552438    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36953ed7-5963-41a8-b18a-604b0cfaa2d0-util\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:15:58.552464 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:58.552460    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36953ed7-5963-41a8-b18a-604b0cfaa2d0-bundle\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:15:58.552597 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:58.552469    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4mfv\" (UniqueName: \"kubernetes.io/projected/36953ed7-5963-41a8-b18a-604b0cfaa2d0-kube-api-access-h4mfv\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:15:59.206700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:59.206675    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n"
Sep 09 14:15:59.206700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:59.206694    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04bp5n" event={"ID":"36953ed7-5963-41a8-b18a-604b0cfaa2d0","Type":"ContainerDied","Data":"754db26257578b3878ba9a0c6d91bb79ef10129a11fed89f7f7c7e2d50a7b48b"}
Sep 09 14:15:59.207140 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:59.206744    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="754db26257578b3878ba9a0c6d91bb79ef10129a11fed89f7f7c7e2d50a7b48b"
Sep 09 14:15:59.208305 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:59.208277    2562 generic.go:356] "Generic (PLEG): container finished" podID="1215e5a3-04eb-4bbc-9dd9-c17fc34257e3" containerID="c07084a108c10104efbc577ba69e2fdaf0ab7bb0be634241e6c43133ece08b01" exitCode=0
Sep 09 14:15:59.208423 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:15:59.208349    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4" event={"ID":"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3","Type":"ContainerDied","Data":"c07084a108c10104efbc577ba69e2fdaf0ab7bb0be634241e6c43133ece08b01"}
Sep 09 14:16:00.216220 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:00.216157    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4" event={"ID":"1215e5a3-04eb-4bbc-9dd9-c17fc34257e3","Type":"ContainerStarted","Data":"ffebe5463a1ccca347cc1e83c57d0986bae6c26024fb06f21091f16fdffde716"}
Sep 09 14:16:00.216567 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:00.216249    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:16:00.237862 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:00.237818    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4" podStartSLOduration=1.8760559030000001 podStartE2EDuration="6.237802874s" totalImagesPullingTime="3.297292454s" totalInitContainerRuntime="1.064454517s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:15:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:16:00.237480859 +0000 UTC m=+324.964020985" watchObservedRunningTime="2026-09-09 14:16:00.237802874 +0000 UTC m=+324.964342955"
Sep 09 14:16:04.171832 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:04.171803    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-784f875f86-rczvl"
Sep 09 14:16:07.061222 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:07.061150    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:07.121863 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:07.121832    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:07.177457 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:07.177438    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:11.223150 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:11.223115    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-686db84dc8-8wff4"
Sep 09 14:16:13.473912 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:13.473874    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:13.560367 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:13.560327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:13.698678 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:13.698638    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:13.874838 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:13.874799    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:15.124752 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:15.124711    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:15.187197 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:15.187148    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:16.093611 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:16.093575    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:20.091300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.091250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:20.157165 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.157125    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:20.345686 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.345598    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"]
Sep 09 14:16:20.345974 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.345956    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36953ed7-5963-41a8-b18a-604b0cfaa2d0" containerName="pull"
Sep 09 14:16:20.346058 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.345978    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="36953ed7-5963-41a8-b18a-604b0cfaa2d0" containerName="pull"
Sep 09 14:16:20.346058 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.345996    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36953ed7-5963-41a8-b18a-604b0cfaa2d0" containerName="extract"
Sep 09 14:16:20.346058 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.346005    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="36953ed7-5963-41a8-b18a-604b0cfaa2d0" containerName="extract"
Sep 09 14:16:20.346058 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.346035    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36953ed7-5963-41a8-b18a-604b0cfaa2d0" containerName="util"
Sep 09 14:16:20.346058 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.346043    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="36953ed7-5963-41a8-b18a-604b0cfaa2d0" containerName="util"
Sep 09 14:16:20.346315 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.346126    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="36953ed7-5963-41a8-b18a-604b0cfaa2d0" containerName="extract"
Sep 09 14:16:20.360784 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.360755    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"]
Sep 09 14:16:20.360935 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.360868    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.363081 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.363054    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 14:16:20.363221 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.363136    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mhwrs\""
Sep 09 14:16:20.370151 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.370120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:20.398310 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.398280    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"]
Sep 09 14:16:20.401500 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.401482    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.414195 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.414152    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"]
Sep 09 14:16:20.507752 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.507715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.507958 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.507760    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.507958 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.507787    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfnp2\" (UniqueName: \"kubernetes.io/projected/b8ef64ee-de19-490b-a2a6-f86c394cad08-kube-api-access-jfnp2\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.507958 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.507892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ae263f7-ae5b-40f4-a969-b94f1127a452-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.507958 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.507931    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ae263f7-ae5b-40f4-a969-b94f1127a452-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.508157 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.507960    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ae263f7-ae5b-40f4-a969-b94f1127a452-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.508157 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.507984    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.508157 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.508019    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ae263f7-ae5b-40f4-a969-b94f1127a452-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.508157 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.508045    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66xtb\" (UniqueName: \"kubernetes.io/projected/6ae263f7-ae5b-40f4-a969-b94f1127a452-kube-api-access-66xtb\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.508157 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.508073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ae263f7-ae5b-40f4-a969-b94f1127a452-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.508157 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.508134    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ae263f7-ae5b-40f4-a969-b94f1127a452-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.508412 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.508179    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8ef64ee-de19-490b-a2a6-f86c394cad08-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.508412 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.508218    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ae263f7-ae5b-40f4-a969-b94f1127a452-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.508412 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.508252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.508412 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.508268    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.508412 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.508283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ae263f7-ae5b-40f4-a969-b94f1127a452-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.508412 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.508308    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.508412 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.508322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.534914 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.534881    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:20.609290 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609206    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ae263f7-ae5b-40f4-a969-b94f1127a452-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.609290 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609243    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ae263f7-ae5b-40f4-a969-b94f1127a452-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.609290 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609263    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ae263f7-ae5b-40f4-a969-b94f1127a452-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.609290 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609282    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.609608 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ae263f7-ae5b-40f4-a969-b94f1127a452-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.609608 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66xtb\" (UniqueName: \"kubernetes.io/projected/6ae263f7-ae5b-40f4-a969-b94f1127a452-kube-api-access-66xtb\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.609608 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609483    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ae263f7-ae5b-40f4-a969-b94f1127a452-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.609608 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609530    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ae263f7-ae5b-40f4-a969-b94f1127a452-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.609608 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609560    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8ef64ee-de19-490b-a2a6-f86c394cad08-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.609608 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609588    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ae263f7-ae5b-40f4-a969-b94f1127a452-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.609902 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609623    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.609902 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609647    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.609902 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609673    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ae263f7-ae5b-40f4-a969-b94f1127a452-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.609902 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609718    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.609902 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609743    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.609902 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609787    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.609902 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609803    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ae263f7-ae5b-40f4-a969-b94f1127a452-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.609902 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.609902 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.609876    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnp2\" (UniqueName: \"kubernetes.io/projected/b8ef64ee-de19-490b-a2a6-f86c394cad08-kube-api-access-jfnp2\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.610360 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.610038    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ae263f7-ae5b-40f4-a969-b94f1127a452-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.610360 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.610065    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.610360 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.610254    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ae263f7-ae5b-40f4-a969-b94f1127a452-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.610515 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.610357    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8ef64ee-de19-490b-a2a6-f86c394cad08-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.610515 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.610395    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ae263f7-ae5b-40f4-a969-b94f1127a452-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.610515 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.610425    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.610681 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.610528    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.610681 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.610547    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.610681 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.610547    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ae263f7-ae5b-40f4-a969-b94f1127a452-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.612158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.612124    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ae263f7-ae5b-40f4-a969-b94f1127a452-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.612456 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.612430    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.612543 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.612522    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ae263f7-ae5b-40f4-a969-b94f1127a452-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.612599 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.612580    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.617134 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.617110    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66xtb\" (UniqueName: \"kubernetes.io/projected/6ae263f7-ae5b-40f4-a969-b94f1127a452-kube-api-access-66xtb\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.617134 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.617124    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ae263f7-ae5b-40f4-a969-b94f1127a452-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87\" (UID: \"6ae263f7-ae5b-40f4-a969-b94f1127a452\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.617134 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.617118    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.617590 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.617574    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfnp2\" (UniqueName: \"kubernetes.io/projected/b8ef64ee-de19-490b-a2a6-f86c394cad08-kube-api-access-jfnp2\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.671307 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.671272    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:20.710618 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.710578    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:20.844239 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.844198    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:20.947067 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.947040    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"]
Sep 09 14:16:20.948785 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:16:20.948758    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ef64ee_de19_490b_a2a6_f86c394cad08.slice/crio-6886903a67eab3ef905c98572935c299cdd8b81877a4b1bdf10c90c3b834c5a6 WatchSource:0}: Error finding container 6886903a67eab3ef905c98572935c299cdd8b81877a4b1bdf10c90c3b834c5a6: Status 404 returned error can't find the container with id 6886903a67eab3ef905c98572935c299cdd8b81877a4b1bdf10c90c3b834c5a6
Sep 09 14:16:20.992774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:20.992747    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"]
Sep 09 14:16:20.995074 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:16:20.995047    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae263f7_ae5b_40f4_a969_b94f1127a452.slice/crio-765f08b9775df050c64b1562ea7e2c7618cd8f9ff8a7ed75869dd8b9591421db WatchSource:0}: Error finding container 765f08b9775df050c64b1562ea7e2c7618cd8f9ff8a7ed75869dd8b9591421db: Status 404 returned error can't find the container with id 765f08b9775df050c64b1562ea7e2c7618cd8f9ff8a7ed75869dd8b9591421db
Sep 09 14:16:21.313228 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:21.313193    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87" event={"ID":"6ae263f7-ae5b-40f4-a969-b94f1127a452","Type":"ContainerStarted","Data":"765f08b9775df050c64b1562ea7e2c7618cd8f9ff8a7ed75869dd8b9591421db"}
Sep 09 14:16:21.314271 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:21.314251    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g" event={"ID":"b8ef64ee-de19-490b-a2a6-f86c394cad08","Type":"ContainerStarted","Data":"6886903a67eab3ef905c98572935c299cdd8b81877a4b1bdf10c90c3b834c5a6"}
Sep 09 14:16:24.235683 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:24.235646    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:16:24.235989 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:24.235715    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:16:24.235989 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:24.235742    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:16:24.241473 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:24.241444    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:16:24.241573 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:24.241519    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:16:24.241573 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:24.241551    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:16:24.333838 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:24.333799    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g" event={"ID":"b8ef64ee-de19-490b-a2a6-f86c394cad08","Type":"ContainerStarted","Data":"d6bda8cecce5628bdec2bee603bc8f7c516a4ca68ce8d560e3a31eeaca34a38d"}
Sep 09 14:16:24.335618 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:24.335585    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87" event={"ID":"6ae263f7-ae5b-40f4-a969-b94f1127a452","Type":"ContainerStarted","Data":"7e29714b4c81faa6a29be3320ffda87fbe9f56b770c77f62fcc4ce7953fcc600"}
Sep 09 14:16:24.353389 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:24.353331    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g" podStartSLOduration=1.068636106 podStartE2EDuration="4.353311475s" totalImagesPullingTime="3.284675369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:16:24.351609099 +0000 UTC m=+349.078149201" watchObservedRunningTime="2026-09-09 14:16:24.353311475 +0000 UTC m=+349.079851578"
Sep 09 14:16:24.373662 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:24.373612    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87" podStartSLOduration=1.129459912 podStartE2EDuration="4.373594622s" totalImagesPullingTime="3.24413471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:16:24.372968451 +0000 UTC m=+349.099508563" watchObservedRunningTime="2026-09-09 14:16:24.373594622 +0000 UTC m=+349.100134745"
Sep 09 14:16:24.533189 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:24.533080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:24.600771 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:24.600739    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:24.671976 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:24.671951    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:24.701571 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:24.701544    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:24.711421 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:24.711402    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:24.927807 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:24.927777    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:25.027010 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.024484    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9jrwg"]
Sep 09 14:16:25.029728 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.029706    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-9jrwg"
Sep 09 14:16:25.031978 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.031957    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 09 14:16:25.032141 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.032052    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-6mgjd\""
Sep 09 14:16:25.037066 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.037036    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9jrwg"]
Sep 09 14:16:25.039364 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.039336    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:25.148733 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.148706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aa94433-337d-43ac-87c4-0b6474d25b18-tls-certs\") pod \"model-serving-api-54d89bd5fc-9jrwg\" (UID: \"3aa94433-337d-43ac-87c4-0b6474d25b18\") " pod="opendatahub/model-serving-api-54d89bd5fc-9jrwg"
Sep 09 14:16:25.148880 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.148776    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrvdx\" (UniqueName: \"kubernetes.io/projected/3aa94433-337d-43ac-87c4-0b6474d25b18-kube-api-access-wrvdx\") pod \"model-serving-api-54d89bd5fc-9jrwg\" (UID: \"3aa94433-337d-43ac-87c4-0b6474d25b18\") " pod="opendatahub/model-serving-api-54d89bd5fc-9jrwg"
Sep 09 14:16:25.250024 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.249959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrvdx\" (UniqueName: \"kubernetes.io/projected/3aa94433-337d-43ac-87c4-0b6474d25b18-kube-api-access-wrvdx\") pod \"model-serving-api-54d89bd5fc-9jrwg\" (UID: \"3aa94433-337d-43ac-87c4-0b6474d25b18\") " pod="opendatahub/model-serving-api-54d89bd5fc-9jrwg"
Sep 09 14:16:25.250024 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.249998    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aa94433-337d-43ac-87c4-0b6474d25b18-tls-certs\") pod \"model-serving-api-54d89bd5fc-9jrwg\" (UID: \"3aa94433-337d-43ac-87c4-0b6474d25b18\") " pod="opendatahub/model-serving-api-54d89bd5fc-9jrwg"
Sep 09 14:16:25.252471 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.252454    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3aa94433-337d-43ac-87c4-0b6474d25b18-tls-certs\") pod \"model-serving-api-54d89bd5fc-9jrwg\" (UID: \"3aa94433-337d-43ac-87c4-0b6474d25b18\") " pod="opendatahub/model-serving-api-54d89bd5fc-9jrwg"
Sep 09 14:16:25.257772 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.257749    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrvdx\" (UniqueName: \"kubernetes.io/projected/3aa94433-337d-43ac-87c4-0b6474d25b18-kube-api-access-wrvdx\") pod \"model-serving-api-54d89bd5fc-9jrwg\" (UID: \"3aa94433-337d-43ac-87c4-0b6474d25b18\") " pod="opendatahub/model-serving-api-54d89bd5fc-9jrwg"
Sep 09 14:16:25.327405 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.327353    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:25.340037 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.340015    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-9jrwg"
Sep 09 14:16:25.609164 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.609104    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9jrwg"]
Sep 09 14:16:25.611430 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:16:25.611404    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa94433_337d_43ac_87c4_0b6474d25b18.slice/crio-543f29fcaba4e516a739a2f65c1cd9662b279b6e3890605451de40610199a6ba WatchSource:0}: Error finding container 543f29fcaba4e516a739a2f65c1cd9662b279b6e3890605451de40610199a6ba: Status 404 returned error can't find the container with id 543f29fcaba4e516a739a2f65c1cd9662b279b6e3890605451de40610199a6ba
Sep 09 14:16:25.673336 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.673305    2562 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 09 14:16:25.673422 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.673352    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g" podUID="b8ef64ee-de19-490b-a2a6-f86c394cad08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 09 14:16:25.715850 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:25.715820    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:26.345442 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:26.345407    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-9jrwg" event={"ID":"3aa94433-337d-43ac-87c4-0b6474d25b18","Type":"ContainerStarted","Data":"543f29fcaba4e516a739a2f65c1cd9662b279b6e3890605451de40610199a6ba"}
Sep 09 14:16:26.345808 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:26.345777    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:26.346594 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:26.346575    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87"
Sep 09 14:16:26.403216 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:26.403136    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"]
Sep 09 14:16:26.671908 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:26.671828    2562 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 09 14:16:26.672072 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:26.671929    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g" podUID="b8ef64ee-de19-490b-a2a6-f86c394cad08" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 09 14:16:27.350487 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:27.350450    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g" podUID="b8ef64ee-de19-490b-a2a6-f86c394cad08" containerName="istio-proxy" containerID="cri-o://d6bda8cecce5628bdec2bee603bc8f7c516a4ca68ce8d560e3a31eeaca34a38d" gracePeriod=30
Sep 09 14:16:29.362233 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:29.362193    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-9jrwg" event={"ID":"3aa94433-337d-43ac-87c4-0b6474d25b18","Type":"ContainerStarted","Data":"f01363757560f196ee9a12f47c236d86efbb81a91ec3cc00d17d92fe05760202"}
Sep 09 14:16:29.362589 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:29.362277    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-9jrwg"
Sep 09 14:16:29.379339 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:29.379289    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-9jrwg" podStartSLOduration=1.675982498 podStartE2EDuration="4.379272467s" totalImagesPullingTime="2.703289969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:16:29.377602405 +0000 UTC m=+354.104142507" watchObservedRunningTime="2026-09-09 14:16:29.379272467 +0000 UTC m=+354.105812570"
Sep 09 14:16:30.500711 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:30.500671    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:32.341967 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.341928    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:32.442348 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.442317    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:32.594851 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.594793    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:32.707535 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.707500    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-envoy\") pod \"b8ef64ee-de19-490b-a2a6-f86c394cad08\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") "
Sep 09 14:16:32.707686 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.707549    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-data\") pod \"b8ef64ee-de19-490b-a2a6-f86c394cad08\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") "
Sep 09 14:16:32.707686 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.707587    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-workload-certs\") pod \"b8ef64ee-de19-490b-a2a6-f86c394cad08\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") "
Sep 09 14:16:32.707686 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.707620    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfnp2\" (UniqueName: \"kubernetes.io/projected/b8ef64ee-de19-490b-a2a6-f86c394cad08-kube-api-access-jfnp2\") pod \"b8ef64ee-de19-490b-a2a6-f86c394cad08\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") "
Sep 09 14:16:32.707686 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.707639    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-credential-socket\") pod \"b8ef64ee-de19-490b-a2a6-f86c394cad08\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") "
Sep 09 14:16:32.707686 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.707679    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-token\") pod \"b8ef64ee-de19-490b-a2a6-f86c394cad08\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") "
Sep 09 14:16:32.707948 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.707713    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-workload-socket\") pod \"b8ef64ee-de19-490b-a2a6-f86c394cad08\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") "
Sep 09 14:16:32.707948 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.707738    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8ef64ee-de19-490b-a2a6-f86c394cad08-istiod-ca-cert\") pod \"b8ef64ee-de19-490b-a2a6-f86c394cad08\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") "
Sep 09 14:16:32.707948 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.707784    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-podinfo\") pod \"b8ef64ee-de19-490b-a2a6-f86c394cad08\" (UID: \"b8ef64ee-de19-490b-a2a6-f86c394cad08\") "
Sep 09 14:16:32.707948 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.707875    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8ef64ee-de19-490b-a2a6-f86c394cad08" (UID: "b8ef64ee-de19-490b-a2a6-f86c394cad08"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:16:32.707948 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.707892    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8ef64ee-de19-490b-a2a6-f86c394cad08" (UID: "b8ef64ee-de19-490b-a2a6-f86c394cad08"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:16:32.708254 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.707968    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8ef64ee-de19-490b-a2a6-f86c394cad08" (UID: "b8ef64ee-de19-490b-a2a6-f86c394cad08"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:16:32.708254 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.708056    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-workload-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:16:32.708254 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.708073    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-data\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:16:32.708254 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.708088    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-workload-certs\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:16:32.708254 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.708158    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8ef64ee-de19-490b-a2a6-f86c394cad08-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8ef64ee-de19-490b-a2a6-f86c394cad08" (UID: "b8ef64ee-de19-490b-a2a6-f86c394cad08"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:16:32.708254 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.708218    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8ef64ee-de19-490b-a2a6-f86c394cad08" (UID: "b8ef64ee-de19-490b-a2a6-f86c394cad08"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:16:32.709936 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.709902    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8ef64ee-de19-490b-a2a6-f86c394cad08" (UID: "b8ef64ee-de19-490b-a2a6-f86c394cad08"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:16:32.710044 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.709944    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8ef64ee-de19-490b-a2a6-f86c394cad08" (UID: "b8ef64ee-de19-490b-a2a6-f86c394cad08"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:16:32.710044 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.709952    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8ef64ee-de19-490b-a2a6-f86c394cad08" (UID: "b8ef64ee-de19-490b-a2a6-f86c394cad08"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:16:32.710044 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.709948    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8ef64ee-de19-490b-a2a6-f86c394cad08-kube-api-access-jfnp2" (OuterVolumeSpecName: "kube-api-access-jfnp2") pod "b8ef64ee-de19-490b-a2a6-f86c394cad08" (UID: "b8ef64ee-de19-490b-a2a6-f86c394cad08"). InnerVolumeSpecName "kube-api-access-jfnp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:16:32.721862 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.721833    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:32.809251 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.809223    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfnp2\" (UniqueName: \"kubernetes.io/projected/b8ef64ee-de19-490b-a2a6-f86c394cad08-kube-api-access-jfnp2\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:16:32.809251 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.809248    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-credential-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:16:32.809398 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.809266    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-token\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:16:32.809398 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.809278    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8ef64ee-de19-490b-a2a6-f86c394cad08-istiod-ca-cert\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:16:32.809398 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.809291    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-podinfo\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:16:32.809398 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.809302    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8ef64ee-de19-490b-a2a6-f86c394cad08-istio-envoy\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:16:32.811875 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.811849    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:32.913314 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:32.913245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:33.382963 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:33.382930    2562 generic.go:356] "Generic (PLEG): container finished" podID="b8ef64ee-de19-490b-a2a6-f86c394cad08" containerID="d6bda8cecce5628bdec2bee603bc8f7c516a4ca68ce8d560e3a31eeaca34a38d" exitCode=0
Sep 09 14:16:33.383364 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:33.382976    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"
Sep 09 14:16:33.383364 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:33.383000    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g" event={"ID":"b8ef64ee-de19-490b-a2a6-f86c394cad08","Type":"ContainerDied","Data":"d6bda8cecce5628bdec2bee603bc8f7c516a4ca68ce8d560e3a31eeaca34a38d"}
Sep 09 14:16:33.383364 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:33.383052    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g" event={"ID":"b8ef64ee-de19-490b-a2a6-f86c394cad08","Type":"ContainerDied","Data":"6886903a67eab3ef905c98572935c299cdd8b81877a4b1bdf10c90c3b834c5a6"}
Sep 09 14:16:33.383364 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:33.383078    2562 scope.go:117] "RemoveContainer" containerID="d6bda8cecce5628bdec2bee603bc8f7c516a4ca68ce8d560e3a31eeaca34a38d"
Sep 09 14:16:33.392388 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:33.392371    2562 scope.go:117] "RemoveContainer" containerID="d6bda8cecce5628bdec2bee603bc8f7c516a4ca68ce8d560e3a31eeaca34a38d"
Sep 09 14:16:33.392628 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:16:33.392612    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6bda8cecce5628bdec2bee603bc8f7c516a4ca68ce8d560e3a31eeaca34a38d\": container with ID starting with d6bda8cecce5628bdec2bee603bc8f7c516a4ca68ce8d560e3a31eeaca34a38d not found: ID does not exist" containerID="d6bda8cecce5628bdec2bee603bc8f7c516a4ca68ce8d560e3a31eeaca34a38d"
Sep 09 14:16:33.392671 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:33.392634    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6bda8cecce5628bdec2bee603bc8f7c516a4ca68ce8d560e3a31eeaca34a38d"} err="failed to get container status \"d6bda8cecce5628bdec2bee603bc8f7c516a4ca68ce8d560e3a31eeaca34a38d\": rpc error: code = NotFound desc = could not find container \"d6bda8cecce5628bdec2bee603bc8f7c516a4ca68ce8d560e3a31eeaca34a38d\": container with ID starting with d6bda8cecce5628bdec2bee603bc8f7c516a4ca68ce8d560e3a31eeaca34a38d not found: ID does not exist"
Sep 09 14:16:33.411456 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:33.411430    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"]
Sep 09 14:16:33.415103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:33.415077    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjmq8g"]
Sep 09 14:16:33.798987 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:33.798913    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8ef64ee-de19-490b-a2a6-f86c394cad08" path="/var/lib/kubelet/pods/b8ef64ee-de19-490b-a2a6-f86c394cad08/volumes"
Sep 09 14:16:33.982364 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:33.982327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:34.075310 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.075268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:34.128498 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.128465    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v9xsl"]
Sep 09 14:16:34.128801 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.128788    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ef64ee-de19-490b-a2a6-f86c394cad08" containerName="istio-proxy"
Sep 09 14:16:34.128844 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.128802    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ef64ee-de19-490b-a2a6-f86c394cad08" containerName="istio-proxy"
Sep 09 14:16:34.128875 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.128855    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ef64ee-de19-490b-a2a6-f86c394cad08" containerName="istio-proxy"
Sep 09 14:16:34.133546 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.133527    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9xsl"
Sep 09 14:16:34.136894 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.136859    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7vmqm\""
Sep 09 14:16:34.137002 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.136985    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 09 14:16:34.144719 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.144659    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v9xsl"]
Sep 09 14:16:34.155780 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.155759    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh"]
Sep 09 14:16:34.159141 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.159122    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh"
Sep 09 14:16:34.161438 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.161417    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7dj5q\""
Sep 09 14:16:34.161547 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.161481    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 09 14:16:34.169150 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.169080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:34.169150 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.169096    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh"]
Sep 09 14:16:34.221349 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.221326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0227f62c-bc6c-4b9e-b528-20b855650eb0-cert\") pod \"kserve-controller-manager-d6f4b65b8-v9xsl\" (UID: \"0227f62c-bc6c-4b9e-b528-20b855650eb0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9xsl"
Sep 09 14:16:34.221426 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.221355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bxj8\" (UniqueName: \"kubernetes.io/projected/0227f62c-bc6c-4b9e-b528-20b855650eb0-kube-api-access-6bxj8\") pod \"kserve-controller-manager-d6f4b65b8-v9xsl\" (UID: \"0227f62c-bc6c-4b9e-b528-20b855650eb0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9xsl"
Sep 09 14:16:34.322721 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.322688    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0227f62c-bc6c-4b9e-b528-20b855650eb0-cert\") pod \"kserve-controller-manager-d6f4b65b8-v9xsl\" (UID: \"0227f62c-bc6c-4b9e-b528-20b855650eb0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9xsl"
Sep 09 14:16:34.322866 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.322729    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bxj8\" (UniqueName: \"kubernetes.io/projected/0227f62c-bc6c-4b9e-b528-20b855650eb0-kube-api-access-6bxj8\") pod \"kserve-controller-manager-d6f4b65b8-v9xsl\" (UID: \"0227f62c-bc6c-4b9e-b528-20b855650eb0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9xsl"
Sep 09 14:16:34.322866 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.322798    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh9xd\" (UniqueName: \"kubernetes.io/projected/f5df07d3-a53d-4f55-bc5f-071b93d4ed9d-kube-api-access-hh9xd\") pod \"llmisvc-controller-manager-777c6bd7d5-27sgh\" (UID: \"f5df07d3-a53d-4f55-bc5f-071b93d4ed9d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh"
Sep 09 14:16:34.322866 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.322837    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5df07d3-a53d-4f55-bc5f-071b93d4ed9d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-27sgh\" (UID: \"f5df07d3-a53d-4f55-bc5f-071b93d4ed9d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh"
Sep 09 14:16:34.325083 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.325054    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0227f62c-bc6c-4b9e-b528-20b855650eb0-cert\") pod \"kserve-controller-manager-d6f4b65b8-v9xsl\" (UID: \"0227f62c-bc6c-4b9e-b528-20b855650eb0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9xsl"
Sep 09 14:16:34.334426 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.334373    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bxj8\" (UniqueName: \"kubernetes.io/projected/0227f62c-bc6c-4b9e-b528-20b855650eb0-kube-api-access-6bxj8\") pod \"kserve-controller-manager-d6f4b65b8-v9xsl\" (UID: \"0227f62c-bc6c-4b9e-b528-20b855650eb0\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9xsl"
Sep 09 14:16:34.423249 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.423223    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh9xd\" (UniqueName: \"kubernetes.io/projected/f5df07d3-a53d-4f55-bc5f-071b93d4ed9d-kube-api-access-hh9xd\") pod \"llmisvc-controller-manager-777c6bd7d5-27sgh\" (UID: \"f5df07d3-a53d-4f55-bc5f-071b93d4ed9d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh"
Sep 09 14:16:34.423535 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.423261    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5df07d3-a53d-4f55-bc5f-071b93d4ed9d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-27sgh\" (UID: \"f5df07d3-a53d-4f55-bc5f-071b93d4ed9d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh"
Sep 09 14:16:34.423535 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:16:34.423365    2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 09 14:16:34.423535 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:16:34.423425    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5df07d3-a53d-4f55-bc5f-071b93d4ed9d-cert podName:f5df07d3-a53d-4f55-bc5f-071b93d4ed9d nodeName:}" failed. No retries permitted until 2026-09-09 14:16:34.923407431 +0000 UTC m=+359.649947517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f5df07d3-a53d-4f55-bc5f-071b93d4ed9d-cert") pod "llmisvc-controller-manager-777c6bd7d5-27sgh" (UID: "f5df07d3-a53d-4f55-bc5f-071b93d4ed9d") : secret "llmisvc-webhook-server-cert" not found
Sep 09 14:16:34.434551 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.434524    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh9xd\" (UniqueName: \"kubernetes.io/projected/f5df07d3-a53d-4f55-bc5f-071b93d4ed9d-kube-api-access-hh9xd\") pod \"llmisvc-controller-manager-777c6bd7d5-27sgh\" (UID: \"f5df07d3-a53d-4f55-bc5f-071b93d4ed9d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh"
Sep 09 14:16:34.444423 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.444401    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9xsl"
Sep 09 14:16:34.523792 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.523746    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:34.722875 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.722852    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v9xsl"]
Sep 09 14:16:34.725021 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:16:34.724996    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0227f62c_bc6c_4b9e_b528_20b855650eb0.slice/crio-b47236beced52afa19662c582056924138611fc5a6aabd8149dba6882f5ba181 WatchSource:0}: Error finding container b47236beced52afa19662c582056924138611fc5a6aabd8149dba6882f5ba181: Status 404 returned error can't find the container with id b47236beced52afa19662c582056924138611fc5a6aabd8149dba6882f5ba181
Sep 09 14:16:34.926373 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.926342    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5df07d3-a53d-4f55-bc5f-071b93d4ed9d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-27sgh\" (UID: \"f5df07d3-a53d-4f55-bc5f-071b93d4ed9d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh"
Sep 09 14:16:34.928632 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:34.928614    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5df07d3-a53d-4f55-bc5f-071b93d4ed9d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-27sgh\" (UID: \"f5df07d3-a53d-4f55-bc5f-071b93d4ed9d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh"
Sep 09 14:16:35.069754 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:35.069725    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh"
Sep 09 14:16:35.366519 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:35.366494    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh"]
Sep 09 14:16:35.368122 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:16:35.368090    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf5df07d3_a53d_4f55_bc5f_071b93d4ed9d.slice/crio-f87ef39828161bb433294398785fdd04e4137b2b02b3164d4c7062f2f8cc8d64 WatchSource:0}: Error finding container f87ef39828161bb433294398785fdd04e4137b2b02b3164d4c7062f2f8cc8d64: Status 404 returned error can't find the container with id f87ef39828161bb433294398785fdd04e4137b2b02b3164d4c7062f2f8cc8d64
Sep 09 14:16:35.390537 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:35.390501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:35.394720 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:35.394690    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh" event={"ID":"f5df07d3-a53d-4f55-bc5f-071b93d4ed9d","Type":"ContainerStarted","Data":"f87ef39828161bb433294398785fdd04e4137b2b02b3164d4c7062f2f8cc8d64"}
Sep 09 14:16:35.395862 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:35.395842    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9xsl" event={"ID":"0227f62c-bc6c-4b9e-b528-20b855650eb0","Type":"ContainerStarted","Data":"b47236beced52afa19662c582056924138611fc5a6aabd8149dba6882f5ba181"}
Sep 09 14:16:35.486059 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:35.486027    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:35.593097 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:35.593061    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:38.413435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:38.413396    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh" event={"ID":"f5df07d3-a53d-4f55-bc5f-071b93d4ed9d","Type":"ContainerStarted","Data":"319739c4a6eacbe72ec5d13a21265a59b17a908668e76f114e221c065dce382f"}
Sep 09 14:16:38.413902 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:38.413571    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh"
Sep 09 14:16:38.415136 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:38.415108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9xsl" event={"ID":"0227f62c-bc6c-4b9e-b528-20b855650eb0","Type":"ContainerStarted","Data":"0018c2ea8a3d1d1156fdf7a8eb06877cae313f3a6eff93bb42d1a6931d0c73e2"}
Sep 09 14:16:38.415295 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:38.415207    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9xsl"
Sep 09 14:16:38.429460 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:38.429417    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh" podStartSLOduration=1.802198498 podStartE2EDuration="4.429403647s" totalImagesPullingTime="2.627205149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:16:38.428601881 +0000 UTC m=+363.155141983" watchObservedRunningTime="2026-09-09 14:16:38.429403647 +0000 UTC m=+363.155943749"
Sep 09 14:16:38.444108 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:38.444067    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9xsl" podStartSLOduration=1.807482044 podStartE2EDuration="4.444055184s" totalImagesPullingTime="2.63657314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:16:38.44286547 +0000 UTC m=+363.169405574" watchObservedRunningTime="2026-09-09 14:16:38.444055184 +0000 UTC m=+363.170595288"
Sep 09 14:16:40.372086 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:40.372053    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-9jrwg"
Sep 09 14:16:45.425157 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:45.425116    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:45.480669 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:45.480636    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:58.691005 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:58.690963    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:16:58.752211 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:16:58.752154    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:09.422685 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:09.422647    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-27sgh"
Sep 09 14:17:09.425699 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:09.425676    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v9xsl"
Sep 09 14:17:09.604342 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:09.604304    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:09.705968 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:09.705887    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:09.767866 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:09.767837    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:25.892629 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:25.892594    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:25.986443 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:25.986390    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:38.641552 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:38.641520    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:39.449546 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:39.449484    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:42.522484 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:42.522449    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:42.622070 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:42.622022    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:42.722259 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:42.722222    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:44.478346 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:44.478305    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:44.645569 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:44.645534    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:45.256022 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:45.255958    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:45.590509 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:45.590480    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:45.686930 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:45.686899    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:45.795364 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:45.795330    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:48.349364 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:48.349335    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"]
Sep 09 14:17:48.352659 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:48.352638    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:17:48.355112 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:48.355089    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 14:17:48.355248 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:48.355109    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 14:17:48.355248 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:48.355145    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w9wb4\""
Sep 09 14:17:48.366775 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:48.366754    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"]
Sep 09 14:17:48.382532 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:48.382512    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv958\" (UniqueName: \"kubernetes.io/projected/2d379bdf-1acb-422b-8417-8b2fbb5f8f06-kube-api-access-wv958\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7bnw5\" (UID: \"2d379bdf-1acb-422b-8417-8b2fbb5f8f06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:17:48.382616 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:48.382539    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d379bdf-1acb-422b-8417-8b2fbb5f8f06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7bnw5\" (UID: \"2d379bdf-1acb-422b-8417-8b2fbb5f8f06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:17:48.482998 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:48.482977    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv958\" (UniqueName: \"kubernetes.io/projected/2d379bdf-1acb-422b-8417-8b2fbb5f8f06-kube-api-access-wv958\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7bnw5\" (UID: \"2d379bdf-1acb-422b-8417-8b2fbb5f8f06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:17:48.483094 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:48.483006    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d379bdf-1acb-422b-8417-8b2fbb5f8f06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7bnw5\" (UID: \"2d379bdf-1acb-422b-8417-8b2fbb5f8f06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:17:48.483354 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:48.483338    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d379bdf-1acb-422b-8417-8b2fbb5f8f06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7bnw5\" (UID: \"2d379bdf-1acb-422b-8417-8b2fbb5f8f06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:17:48.508162 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:48.508134    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv958\" (UniqueName: \"kubernetes.io/projected/2d379bdf-1acb-422b-8417-8b2fbb5f8f06-kube-api-access-wv958\") pod \"kuadrant-operator-controller-manager-76f8f686bf-7bnw5\" (UID: \"2d379bdf-1acb-422b-8417-8b2fbb5f8f06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:17:48.663313 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:48.663258    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:17:48.882735 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:48.882696    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:48.937248 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:48.937152    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"]
Sep 09 14:17:48.941088 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:17:48.941059    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d379bdf_1acb_422b_8417_8b2fbb5f8f06.slice/crio-8b903304d41b76a30a25ca64883f00cec38c46679737f853fc35a7d97611af3c WatchSource:0}: Error finding container 8b903304d41b76a30a25ca64883f00cec38c46679737f853fc35a7d97611af3c: Status 404 returned error can't find the container with id 8b903304d41b76a30a25ca64883f00cec38c46679737f853fc35a7d97611af3c
Sep 09 14:17:49.746190 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:49.746140    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5" event={"ID":"2d379bdf-1acb-422b-8417-8b2fbb5f8f06","Type":"ContainerStarted","Data":"8b903304d41b76a30a25ca64883f00cec38c46679737f853fc35a7d97611af3c"}
Sep 09 14:17:49.899082 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:49.899047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:51.883120 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:51.883073    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:51.983241 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:51.983195    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:52.256451 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:52.256376    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:52.329460 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:52.329429    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:55.858908 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:55.858868    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:55.959915 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:55.959874    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:56.782929 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:56.782892    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5" event={"ID":"2d379bdf-1acb-422b-8417-8b2fbb5f8f06","Type":"ContainerStarted","Data":"bd038aca12320bef0932795df4a28fb485dcead582f2051f3b651f003b10b464"}
Sep 09 14:17:56.783131 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:56.782995    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:17:56.805653 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:56.805596    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5" podStartSLOduration=1.656778772 podStartE2EDuration="8.805578015s" totalImagesPullingTime="7.148799243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:17:56.804422535 +0000 UTC m=+441.530962628" watchObservedRunningTime="2026-09-09 14:17:56.805578015 +0000 UTC m=+441.532118118"
Sep 09 14:17:58.610585 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:58.610482    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:17:58.907819 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:17:58.907727    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:00.197463 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:00.197429    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:00.296457 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:00.296425    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:00.357196 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:00.357148    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:06.673146 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:06.673105    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:06.772165 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:06.772118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:07.790618 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:07.790589    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:18:10.073802 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.073764    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"]
Sep 09 14:18:10.074195 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.073958    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5" podUID="2d379bdf-1acb-422b-8417-8b2fbb5f8f06" containerName="manager" containerID="cri-o://bd038aca12320bef0932795df4a28fb485dcead582f2051f3b651f003b10b464" gracePeriod=2
Sep 09 14:18:10.088255 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:18:10.086889    2562 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"2d379bdf-1acb-422b-8417-8b2fbb5f8f06\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-7bnw5\": pods \"kuadrant-operator-controller-manager-76f8f686bf-7bnw5\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:18:10.088255 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.088160    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"]
Sep 09 14:18:10.097309 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.097279    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"]
Sep 09 14:18:10.097805 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.097783    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d379bdf-1acb-422b-8417-8b2fbb5f8f06" containerName="manager"
Sep 09 14:18:10.097944 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.097929    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d379bdf-1acb-422b-8417-8b2fbb5f8f06" containerName="manager"
Sep 09 14:18:10.098196 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.098159    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d379bdf-1acb-422b-8417-8b2fbb5f8f06" containerName="manager"
Sep 09 14:18:10.101431 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.101411    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"
Sep 09 14:18:10.115021 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.114870    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"]
Sep 09 14:18:10.129220 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:18:10.129185    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-7bnw5\" is forbidden: User \"system:node:ip-10-0-140-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-6.ec2.internal' and this object" podUID="2d379bdf-1acb-422b-8417-8b2fbb5f8f06" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:18:10.145828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.145804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86ef0ee6-0b54-4a4a-a853-10160177b771-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dgxs6\" (UID: \"86ef0ee6-0b54-4a4a-a853-10160177b771\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"
Sep 09 14:18:10.145916 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.145854    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntxz7\" (UniqueName: \"kubernetes.io/projected/86ef0ee6-0b54-4a4a-a853-10160177b771-kube-api-access-ntxz7\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dgxs6\" (UID: \"86ef0ee6-0b54-4a4a-a853-10160177b771\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"
Sep 09 14:18:10.246883 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.246695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86ef0ee6-0b54-4a4a-a853-10160177b771-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dgxs6\" (UID: \"86ef0ee6-0b54-4a4a-a853-10160177b771\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"
Sep 09 14:18:10.246883 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.246777    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntxz7\" (UniqueName: \"kubernetes.io/projected/86ef0ee6-0b54-4a4a-a853-10160177b771-kube-api-access-ntxz7\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dgxs6\" (UID: \"86ef0ee6-0b54-4a4a-a853-10160177b771\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"
Sep 09 14:18:10.247143 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.247115    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86ef0ee6-0b54-4a4a-a853-10160177b771-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dgxs6\" (UID: \"86ef0ee6-0b54-4a4a-a853-10160177b771\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"
Sep 09 14:18:10.255327 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.255304    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntxz7\" (UniqueName: \"kubernetes.io/projected/86ef0ee6-0b54-4a4a-a853-10160177b771-kube-api-access-ntxz7\") pod \"kuadrant-operator-controller-manager-76f8f686bf-dgxs6\" (UID: \"86ef0ee6-0b54-4a4a-a853-10160177b771\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"
Sep 09 14:18:10.306903 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.306883    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:18:10.308851 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:18:10.308825    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-7bnw5\" is forbidden: User \"system:node:ip-10-0-140-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-6.ec2.internal' and this object" podUID="2d379bdf-1acb-422b-8417-8b2fbb5f8f06" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:18:10.347734 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.347690    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d379bdf-1acb-422b-8417-8b2fbb5f8f06-extensions-socket-volume\") pod \"2d379bdf-1acb-422b-8417-8b2fbb5f8f06\" (UID: \"2d379bdf-1acb-422b-8417-8b2fbb5f8f06\") "
Sep 09 14:18:10.347821 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.347735    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv958\" (UniqueName: \"kubernetes.io/projected/2d379bdf-1acb-422b-8417-8b2fbb5f8f06-kube-api-access-wv958\") pod \"2d379bdf-1acb-422b-8417-8b2fbb5f8f06\" (UID: \"2d379bdf-1acb-422b-8417-8b2fbb5f8f06\") "
Sep 09 14:18:10.348190 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.348145    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d379bdf-1acb-422b-8417-8b2fbb5f8f06-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2d379bdf-1acb-422b-8417-8b2fbb5f8f06" (UID: "2d379bdf-1acb-422b-8417-8b2fbb5f8f06"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:18:10.349707 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.349686    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d379bdf-1acb-422b-8417-8b2fbb5f8f06-kube-api-access-wv958" (OuterVolumeSpecName: "kube-api-access-wv958") pod "2d379bdf-1acb-422b-8417-8b2fbb5f8f06" (UID: "2d379bdf-1acb-422b-8417-8b2fbb5f8f06"). InnerVolumeSpecName "kube-api-access-wv958". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:18:10.448538 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.448517    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d379bdf-1acb-422b-8417-8b2fbb5f8f06-extensions-socket-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:18:10.448538 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.448536    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv958\" (UniqueName: \"kubernetes.io/projected/2d379bdf-1acb-422b-8417-8b2fbb5f8f06-kube-api-access-wv958\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:18:10.455884 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.455866    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"
Sep 09 14:18:10.734257 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.734159    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"]
Sep 09 14:18:10.738213 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:18:10.738156    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86ef0ee6_0b54_4a4a_a853_10160177b771.slice/crio-d5b6e1e3e17a20a16d8313cef5e0b90b5fec3b9787e13e9317f71bafc14c96c3 WatchSource:0}: Error finding container d5b6e1e3e17a20a16d8313cef5e0b90b5fec3b9787e13e9317f71bafc14c96c3: Status 404 returned error can't find the container with id d5b6e1e3e17a20a16d8313cef5e0b90b5fec3b9787e13e9317f71bafc14c96c3
Sep 09 14:18:10.847995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.847962    2562 generic.go:356] "Generic (PLEG): container finished" podID="2d379bdf-1acb-422b-8417-8b2fbb5f8f06" containerID="bd038aca12320bef0932795df4a28fb485dcead582f2051f3b651f003b10b464" exitCode=0
Sep 09 14:18:10.848137 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.848027    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:18:10.848137 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.848066    2562 scope.go:117] "RemoveContainer" containerID="bd038aca12320bef0932795df4a28fb485dcead582f2051f3b651f003b10b464"
Sep 09 14:18:10.850065 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.850039    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6" event={"ID":"86ef0ee6-0b54-4a4a-a853-10160177b771","Type":"ContainerStarted","Data":"d938f28769f0f3ba938c4ef239b65ab32a06a27189ba763425ccf954fa512558"}
Sep 09 14:18:10.850203 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.850090    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6" event={"ID":"86ef0ee6-0b54-4a4a-a853-10160177b771","Type":"ContainerStarted","Data":"d5b6e1e3e17a20a16d8313cef5e0b90b5fec3b9787e13e9317f71bafc14c96c3"}
Sep 09 14:18:10.850203 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.850131    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"
Sep 09 14:18:10.850332 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:18:10.850282    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-7bnw5\" is forbidden: User \"system:node:ip-10-0-140-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-6.ec2.internal' and this object" podUID="2d379bdf-1acb-422b-8417-8b2fbb5f8f06" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:18:10.852107 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:18:10.852077    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-7bnw5\" is forbidden: User \"system:node:ip-10-0-140-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-6.ec2.internal' and this object" podUID="2d379bdf-1acb-422b-8417-8b2fbb5f8f06" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:18:10.857922 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.857894    2562 scope.go:117] "RemoveContainer" containerID="bd038aca12320bef0932795df4a28fb485dcead582f2051f3b651f003b10b464"
Sep 09 14:18:10.858263 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:18:10.858242    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd038aca12320bef0932795df4a28fb485dcead582f2051f3b651f003b10b464\": container with ID starting with bd038aca12320bef0932795df4a28fb485dcead582f2051f3b651f003b10b464 not found: ID does not exist" containerID="bd038aca12320bef0932795df4a28fb485dcead582f2051f3b651f003b10b464"
Sep 09 14:18:10.858365 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.858268    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd038aca12320bef0932795df4a28fb485dcead582f2051f3b651f003b10b464"} err="failed to get container status \"bd038aca12320bef0932795df4a28fb485dcead582f2051f3b651f003b10b464\": rpc error: code = NotFound desc = could not find container \"bd038aca12320bef0932795df4a28fb485dcead582f2051f3b651f003b10b464\": container with ID starting with bd038aca12320bef0932795df4a28fb485dcead582f2051f3b651f003b10b464 not found: ID does not exist"
Sep 09 14:18:10.871612 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:10.871573    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6" podStartSLOduration=0.871560111 podStartE2EDuration="871.560111ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:18:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:18:10.870872384 +0000 UTC m=+455.597412487" watchObservedRunningTime="2026-09-09 14:18:10.871560111 +0000 UTC m=+455.598100213"
Sep 09 14:18:10.873419 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:18:10.873398    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-7bnw5\" is forbidden: User \"system:node:ip-10-0-140-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-6.ec2.internal' and this object" podUID="2d379bdf-1acb-422b-8417-8b2fbb5f8f06" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-7bnw5"
Sep 09 14:18:11.799672 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:11.799636    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d379bdf-1acb-422b-8417-8b2fbb5f8f06" path="/var/lib/kubelet/pods/2d379bdf-1acb-422b-8417-8b2fbb5f8f06/volumes"
Sep 09 14:18:12.429396 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:12.429348    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:12.528893 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:12.528864    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:12.838968 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:12.838918    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:12.938826 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:12.938794    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:16.232380 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:16.232342    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:16.351665 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:16.351623    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:20.010793 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:20.010758    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:20.108392 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:20.108359    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:20.207434 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:20.207405    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:21.858439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:21.858408    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"
Sep 09 14:18:24.838308 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:24.838243    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"]
Sep 09 14:18:24.838725 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:24.838519    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6" podUID="86ef0ee6-0b54-4a4a-a853-10160177b771" containerName="manager" containerID="cri-o://d938f28769f0f3ba938c4ef239b65ab32a06a27189ba763425ccf954fa512558" gracePeriod=10
Sep 09 14:18:25.087987 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.087964    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"
Sep 09 14:18:25.098977 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.098912    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"]
Sep 09 14:18:25.099318 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.099300    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86ef0ee6-0b54-4a4a-a853-10160177b771" containerName="manager"
Sep 09 14:18:25.099366 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.099323    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="86ef0ee6-0b54-4a4a-a853-10160177b771" containerName="manager"
Sep 09 14:18:25.099434 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.099423    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="86ef0ee6-0b54-4a4a-a853-10160177b771" containerName="manager"
Sep 09 14:18:25.101395 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.101378    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"
Sep 09 14:18:25.123119 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.123098    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"]
Sep 09 14:18:25.160962 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.160936    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86ef0ee6-0b54-4a4a-a853-10160177b771-extensions-socket-volume\") pod \"86ef0ee6-0b54-4a4a-a853-10160177b771\" (UID: \"86ef0ee6-0b54-4a4a-a853-10160177b771\") "
Sep 09 14:18:25.161076 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.161006    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntxz7\" (UniqueName: \"kubernetes.io/projected/86ef0ee6-0b54-4a4a-a853-10160177b771-kube-api-access-ntxz7\") pod \"86ef0ee6-0b54-4a4a-a853-10160177b771\" (UID: \"86ef0ee6-0b54-4a4a-a853-10160177b771\") "
Sep 09 14:18:25.161145 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.161117    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nszp8\" (UniqueName: \"kubernetes.io/projected/b1ca0f14-cd6a-4b6a-85a7-275268321d77-kube-api-access-nszp8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nt4jr\" (UID: \"b1ca0f14-cd6a-4b6a-85a7-275268321d77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"
Sep 09 14:18:25.161221 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.161143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1ca0f14-cd6a-4b6a-85a7-275268321d77-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nt4jr\" (UID: \"b1ca0f14-cd6a-4b6a-85a7-275268321d77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"
Sep 09 14:18:25.161374 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.161351    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86ef0ee6-0b54-4a4a-a853-10160177b771-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "86ef0ee6-0b54-4a4a-a853-10160177b771" (UID: "86ef0ee6-0b54-4a4a-a853-10160177b771"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:18:25.163136 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.163110    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86ef0ee6-0b54-4a4a-a853-10160177b771-kube-api-access-ntxz7" (OuterVolumeSpecName: "kube-api-access-ntxz7") pod "86ef0ee6-0b54-4a4a-a853-10160177b771" (UID: "86ef0ee6-0b54-4a4a-a853-10160177b771"). InnerVolumeSpecName "kube-api-access-ntxz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:18:25.261987 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.261958    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nszp8\" (UniqueName: \"kubernetes.io/projected/b1ca0f14-cd6a-4b6a-85a7-275268321d77-kube-api-access-nszp8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nt4jr\" (UID: \"b1ca0f14-cd6a-4b6a-85a7-275268321d77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"
Sep 09 14:18:25.262104 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.261991    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1ca0f14-cd6a-4b6a-85a7-275268321d77-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nt4jr\" (UID: \"b1ca0f14-cd6a-4b6a-85a7-275268321d77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"
Sep 09 14:18:25.262104 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.262030    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntxz7\" (UniqueName: \"kubernetes.io/projected/86ef0ee6-0b54-4a4a-a853-10160177b771-kube-api-access-ntxz7\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:18:25.262104 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.262040    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86ef0ee6-0b54-4a4a-a853-10160177b771-extensions-socket-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:18:25.262337 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.262318    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1ca0f14-cd6a-4b6a-85a7-275268321d77-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nt4jr\" (UID: \"b1ca0f14-cd6a-4b6a-85a7-275268321d77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"
Sep 09 14:18:25.270200 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.270179    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nszp8\" (UniqueName: \"kubernetes.io/projected/b1ca0f14-cd6a-4b6a-85a7-275268321d77-kube-api-access-nszp8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nt4jr\" (UID: \"b1ca0f14-cd6a-4b6a-85a7-275268321d77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"
Sep 09 14:18:25.411823 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.411768    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"
Sep 09 14:18:25.687681 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.687658    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"]
Sep 09 14:18:25.689786 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:18:25.689758    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ca0f14_cd6a_4b6a_85a7_275268321d77.slice/crio-97a42f4dda08931258f10d56606e7ab16feefc613bb38bdb93e48f17ee19c0f2 WatchSource:0}: Error finding container 97a42f4dda08931258f10d56606e7ab16feefc613bb38bdb93e48f17ee19c0f2: Status 404 returned error can't find the container with id 97a42f4dda08931258f10d56606e7ab16feefc613bb38bdb93e48f17ee19c0f2
Sep 09 14:18:25.921794 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.921759    2562 generic.go:356] "Generic (PLEG): container finished" podID="86ef0ee6-0b54-4a4a-a853-10160177b771" containerID="d938f28769f0f3ba938c4ef239b65ab32a06a27189ba763425ccf954fa512558" exitCode=0
Sep 09 14:18:25.922143 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.921814    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"
Sep 09 14:18:25.922143 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.921844    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6" event={"ID":"86ef0ee6-0b54-4a4a-a853-10160177b771","Type":"ContainerDied","Data":"d938f28769f0f3ba938c4ef239b65ab32a06a27189ba763425ccf954fa512558"}
Sep 09 14:18:25.922143 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.921913    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6" event={"ID":"86ef0ee6-0b54-4a4a-a853-10160177b771","Type":"ContainerDied","Data":"d5b6e1e3e17a20a16d8313cef5e0b90b5fec3b9787e13e9317f71bafc14c96c3"}
Sep 09 14:18:25.922143 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.921945    2562 scope.go:117] "RemoveContainer" containerID="d938f28769f0f3ba938c4ef239b65ab32a06a27189ba763425ccf954fa512558"
Sep 09 14:18:25.924011 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.923988    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr" event={"ID":"b1ca0f14-cd6a-4b6a-85a7-275268321d77","Type":"ContainerStarted","Data":"621d0c3d4ba55c535aba733d32a02adbafdaa813a82fafdea03fe2f5ff4971ec"}
Sep 09 14:18:25.924132 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.924033    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr" event={"ID":"b1ca0f14-cd6a-4b6a-85a7-275268321d77","Type":"ContainerStarted","Data":"97a42f4dda08931258f10d56606e7ab16feefc613bb38bdb93e48f17ee19c0f2"}
Sep 09 14:18:25.924132 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.924073    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"
Sep 09 14:18:25.930267 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.930251    2562 scope.go:117] "RemoveContainer" containerID="d938f28769f0f3ba938c4ef239b65ab32a06a27189ba763425ccf954fa512558"
Sep 09 14:18:25.930516 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:18:25.930498    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d938f28769f0f3ba938c4ef239b65ab32a06a27189ba763425ccf954fa512558\": container with ID starting with d938f28769f0f3ba938c4ef239b65ab32a06a27189ba763425ccf954fa512558 not found: ID does not exist" containerID="d938f28769f0f3ba938c4ef239b65ab32a06a27189ba763425ccf954fa512558"
Sep 09 14:18:25.930565 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.930522    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d938f28769f0f3ba938c4ef239b65ab32a06a27189ba763425ccf954fa512558"} err="failed to get container status \"d938f28769f0f3ba938c4ef239b65ab32a06a27189ba763425ccf954fa512558\": rpc error: code = NotFound desc = could not find container \"d938f28769f0f3ba938c4ef239b65ab32a06a27189ba763425ccf954fa512558\": container with ID starting with d938f28769f0f3ba938c4ef239b65ab32a06a27189ba763425ccf954fa512558 not found: ID does not exist"
Sep 09 14:18:25.945900 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.945816    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr" podStartSLOduration=0.945804197 podStartE2EDuration="945.804197ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:18:25.943219289 +0000 UTC m=+470.669759391" watchObservedRunningTime="2026-09-09 14:18:25.945804197 +0000 UTC m=+470.672344296"
Sep 09 14:18:25.959787 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.959760    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"]
Sep 09 14:18:25.965702 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:25.965680    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-dgxs6"]
Sep 09 14:18:26.492452 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:26.492420    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:26.593068 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:26.593026    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:27.798904 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:27.798870    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86ef0ee6-0b54-4a4a-a853-10160177b771" path="/var/lib/kubelet/pods/86ef0ee6-0b54-4a4a-a853-10160177b771/volumes"
Sep 09 14:18:36.932433 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:36.932402    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"
Sep 09 14:18:41.394723 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.394686    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"]
Sep 09 14:18:41.399318 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.399298    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.401554 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.401532    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jv9nn\""
Sep 09 14:18:41.408542 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.408515    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"]
Sep 09 14:18:41.428860 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.428830    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:41.478690 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.478665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.478802 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.478696    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.478802 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.478716    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.478921 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.478847    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.478921 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.478885    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.479027 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.478942    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnq88\" (UniqueName: \"kubernetes.io/projected/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-kube-api-access-qnq88\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.479027 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.478967    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.479027 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.478997    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.479143 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.479045    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.571633 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.571594    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:41.579598 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.579576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.579692 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.579603    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.579692 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.579627    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnq88\" (UniqueName: \"kubernetes.io/projected/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-kube-api-access-qnq88\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.579692 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.579645    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.579896 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.579717    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.579896 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.579779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.579896 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.579820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.580038 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.579991    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.580038 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.579996    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.580150 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.580033    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.580150 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.580055    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.580266 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.580148    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.580266 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.580196    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.580596 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.580573    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.582055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.582026    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.582265 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.582249    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.587822 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.587798    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnq88\" (UniqueName: \"kubernetes.io/projected/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-kube-api-access-qnq88\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.588251 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.588233    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hsjqp\" (UID: \"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.710073 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.710014    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:41.984510 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.984488    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"]
Sep 09 14:18:41.986360 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:18:41.986333    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf1d5b3_2b0a_4214_a7b2_eb6854ca36c9.slice/crio-f10670da01095ededdc9dc426c5cd4576a3fddd547654706e6aafe490a52d625 WatchSource:0}: Error finding container f10670da01095ededdc9dc426c5cd4576a3fddd547654706e6aafe490a52d625: Status 404 returned error can't find the container with id f10670da01095ededdc9dc426c5cd4576a3fddd547654706e6aafe490a52d625
Sep 09 14:18:41.988305 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.988272    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:18:41.988384 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.988351    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:18:41.988422 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:41.988386    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:18:42.001396 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:42.001374    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp" event={"ID":"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9","Type":"ContainerStarted","Data":"f10670da01095ededdc9dc426c5cd4576a3fddd547654706e6aafe490a52d625"}
Sep 09 14:18:43.007148 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:43.007108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp" event={"ID":"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9","Type":"ContainerStarted","Data":"c9bca75a9c2d86621916c0fb09e2fa307a286fd849930c1115531ab968d8c461"}
Sep 09 14:18:43.027584 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:43.027532    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp" podStartSLOduration=2.027520165 podStartE2EDuration="2.027520165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:18:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:18:43.026096532 +0000 UTC m=+487.752636636" watchObservedRunningTime="2026-09-09 14:18:43.027520165 +0000 UTC m=+487.754060267"
Sep 09 14:18:43.711126 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:43.711089    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:43.715570 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:43.715545    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:43.930771 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:43.930735    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:44.011599 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:44.011528    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:44.012501 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:44.012480    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:18:55.089791 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:55.089747    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:55.273934 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:55.273890    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:55.371836 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:55.371732    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:55.903840 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:55.903808    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9w4vb"]
Sep 09 14:18:55.907343 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:55.907323    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-9w4vb"
Sep 09 14:18:55.910110 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:55.910090    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2qvvt\""
Sep 09 14:18:55.916929 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:55.916907    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9w4vb"]
Sep 09 14:18:55.940916 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:55.940877    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:55.990865 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:55.990837    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-697r8\" (UniqueName: \"kubernetes.io/projected/24898fd4-c92b-494b-96fd-82467276f9d4-kube-api-access-697r8\") pod \"authorino-7bcfd8f9cd-9w4vb\" (UID: \"24898fd4-c92b-494b-96fd-82467276f9d4\") " pod="kuadrant-system/authorino-7bcfd8f9cd-9w4vb"
Sep 09 14:18:56.041316 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:56.041294    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:18:56.092163 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:56.092141    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-697r8\" (UniqueName: \"kubernetes.io/projected/24898fd4-c92b-494b-96fd-82467276f9d4-kube-api-access-697r8\") pod \"authorino-7bcfd8f9cd-9w4vb\" (UID: \"24898fd4-c92b-494b-96fd-82467276f9d4\") " pod="kuadrant-system/authorino-7bcfd8f9cd-9w4vb"
Sep 09 14:18:56.106307 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:56.106283    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-697r8\" (UniqueName: \"kubernetes.io/projected/24898fd4-c92b-494b-96fd-82467276f9d4-kube-api-access-697r8\") pod \"authorino-7bcfd8f9cd-9w4vb\" (UID: \"24898fd4-c92b-494b-96fd-82467276f9d4\") " pod="kuadrant-system/authorino-7bcfd8f9cd-9w4vb"
Sep 09 14:18:56.217507 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:56.217438    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-9w4vb"
Sep 09 14:18:56.484377 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:56.484302    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9w4vb"]
Sep 09 14:18:56.486784 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:18:56.486751    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24898fd4_c92b_494b_96fd_82467276f9d4.slice/crio-5ce7f98c2c1cdc0fc9102615d27eda0d93b2060b0132330482420e4c6d36ef64 WatchSource:0}: Error finding container 5ce7f98c2c1cdc0fc9102615d27eda0d93b2060b0132330482420e4c6d36ef64: Status 404 returned error can't find the container with id 5ce7f98c2c1cdc0fc9102615d27eda0d93b2060b0132330482420e4c6d36ef64
Sep 09 14:18:57.073225 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:57.073189    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-9w4vb" event={"ID":"24898fd4-c92b-494b-96fd-82467276f9d4","Type":"ContainerStarted","Data":"5ce7f98c2c1cdc0fc9102615d27eda0d93b2060b0132330482420e4c6d36ef64"}
Sep 09 14:18:59.038158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:59.038120    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9w4vb"]
Sep 09 14:18:59.085113 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:59.085076    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-9w4vb" event={"ID":"24898fd4-c92b-494b-96fd-82467276f9d4","Type":"ContainerStarted","Data":"feb4b8dc194a6afe5b1eae2dad2dcebf0c980c4241cb9e7313cb959b438e9722"}
Sep 09 14:18:59.100377 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:18:59.100328    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-9w4vb" podStartSLOduration=2.097895511 podStartE2EDuration="4.100311181s" totalImagesPullingTime="2.00241567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:18:59.098819483 +0000 UTC m=+503.825359582" watchObservedRunningTime="2026-09-09 14:18:59.100311181 +0000 UTC m=+503.826851282"
Sep 09 14:19:00.090124 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:00.090064    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-9w4vb" podUID="24898fd4-c92b-494b-96fd-82467276f9d4" containerName="authorino" containerID="cri-o://feb4b8dc194a6afe5b1eae2dad2dcebf0c980c4241cb9e7313cb959b438e9722" gracePeriod=30
Sep 09 14:19:00.335356 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:00.335331    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-9w4vb"
Sep 09 14:19:00.424622 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:00.424562    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-697r8\" (UniqueName: \"kubernetes.io/projected/24898fd4-c92b-494b-96fd-82467276f9d4-kube-api-access-697r8\") pod \"24898fd4-c92b-494b-96fd-82467276f9d4\" (UID: \"24898fd4-c92b-494b-96fd-82467276f9d4\") "
Sep 09 14:19:00.426495 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:00.426471    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24898fd4-c92b-494b-96fd-82467276f9d4-kube-api-access-697r8" (OuterVolumeSpecName: "kube-api-access-697r8") pod "24898fd4-c92b-494b-96fd-82467276f9d4" (UID: "24898fd4-c92b-494b-96fd-82467276f9d4"). InnerVolumeSpecName "kube-api-access-697r8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:19:00.525658 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:00.525632    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-697r8\" (UniqueName: \"kubernetes.io/projected/24898fd4-c92b-494b-96fd-82467276f9d4-kube-api-access-697r8\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:19:01.096384 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:01.096345    2562 generic.go:356] "Generic (PLEG): container finished" podID="24898fd4-c92b-494b-96fd-82467276f9d4" containerID="feb4b8dc194a6afe5b1eae2dad2dcebf0c980c4241cb9e7313cb959b438e9722" exitCode=0
Sep 09 14:19:01.096798 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:01.096388    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-9w4vb"
Sep 09 14:19:01.096798 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:01.096422    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-9w4vb" event={"ID":"24898fd4-c92b-494b-96fd-82467276f9d4","Type":"ContainerDied","Data":"feb4b8dc194a6afe5b1eae2dad2dcebf0c980c4241cb9e7313cb959b438e9722"}
Sep 09 14:19:01.096798 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:01.096470    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-9w4vb" event={"ID":"24898fd4-c92b-494b-96fd-82467276f9d4","Type":"ContainerDied","Data":"5ce7f98c2c1cdc0fc9102615d27eda0d93b2060b0132330482420e4c6d36ef64"}
Sep 09 14:19:01.096798 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:01.096488    2562 scope.go:117] "RemoveContainer" containerID="feb4b8dc194a6afe5b1eae2dad2dcebf0c980c4241cb9e7313cb959b438e9722"
Sep 09 14:19:01.105010 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:01.104994    2562 scope.go:117] "RemoveContainer" containerID="feb4b8dc194a6afe5b1eae2dad2dcebf0c980c4241cb9e7313cb959b438e9722"
Sep 09 14:19:01.105309 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:19:01.105289    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"feb4b8dc194a6afe5b1eae2dad2dcebf0c980c4241cb9e7313cb959b438e9722\": container with ID starting with feb4b8dc194a6afe5b1eae2dad2dcebf0c980c4241cb9e7313cb959b438e9722 not found: ID does not exist" containerID="feb4b8dc194a6afe5b1eae2dad2dcebf0c980c4241cb9e7313cb959b438e9722"
Sep 09 14:19:01.105398 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:01.105316    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feb4b8dc194a6afe5b1eae2dad2dcebf0c980c4241cb9e7313cb959b438e9722"} err="failed to get container status \"feb4b8dc194a6afe5b1eae2dad2dcebf0c980c4241cb9e7313cb959b438e9722\": rpc error: code = NotFound desc = could not find container \"feb4b8dc194a6afe5b1eae2dad2dcebf0c980c4241cb9e7313cb959b438e9722\": container with ID starting with feb4b8dc194a6afe5b1eae2dad2dcebf0c980c4241cb9e7313cb959b438e9722 not found: ID does not exist"
Sep 09 14:19:01.115564 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:01.115540    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9w4vb"]
Sep 09 14:19:01.118839 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:01.118818    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-9w4vb"]
Sep 09 14:19:01.799279 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:01.799248    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24898fd4-c92b-494b-96fd-82467276f9d4" path="/var/lib/kubelet/pods/24898fd4-c92b-494b-96fd-82467276f9d4/volumes"
Sep 09 14:19:10.602522 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:10.602484    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:19:10.772457 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:10.772416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:19:11.128683 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:11.128654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:19:20.436804 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:20.436762    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:19:20.798023 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:20.797933    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:19:27.373026 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.372987    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f84b7998d-vdclx"]
Sep 09 14:19:27.373543 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.373514    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24898fd4-c92b-494b-96fd-82467276f9d4" containerName="authorino"
Sep 09 14:19:27.373626 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.373546    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="24898fd4-c92b-494b-96fd-82467276f9d4" containerName="authorino"
Sep 09 14:19:27.373693 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.373679    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="24898fd4-c92b-494b-96fd-82467276f9d4" containerName="authorino"
Sep 09 14:19:27.379569 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.379546    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f84b7998d-vdclx"
Sep 09 14:19:27.381686 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.381660    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 14:19:27.381785 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.381665    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 14:19:27.381848 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.381829    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mb8vb\""
Sep 09 14:19:27.382013 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.381998    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 14:19:27.387672 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.387649    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f84b7998d-vdclx"]
Sep 09 14:19:27.407516 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.407485    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:19:27.431798 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.431767    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b235d43-cc5f-47e5-8075-9b531b776e17-metrics-certs\") pod \"maas-controller-6f84b7998d-vdclx\" (UID: \"3b235d43-cc5f-47e5-8075-9b531b776e17\") " pod="opendatahub/maas-controller-6f84b7998d-vdclx"
Sep 09 14:19:27.431944 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.431822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfzgl\" (UniqueName: \"kubernetes.io/projected/3b235d43-cc5f-47e5-8075-9b531b776e17-kube-api-access-rfzgl\") pod \"maas-controller-6f84b7998d-vdclx\" (UID: \"3b235d43-cc5f-47e5-8075-9b531b776e17\") " pod="opendatahub/maas-controller-6f84b7998d-vdclx"
Sep 09 14:19:27.431944 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.431879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b235d43-cc5f-47e5-8075-9b531b776e17-webhook-cert\") pod \"maas-controller-6f84b7998d-vdclx\" (UID: \"3b235d43-cc5f-47e5-8075-9b531b776e17\") " pod="opendatahub/maas-controller-6f84b7998d-vdclx"
Sep 09 14:19:27.473840 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.473813    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:19:27.532804 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.532782    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b235d43-cc5f-47e5-8075-9b531b776e17-webhook-cert\") pod \"maas-controller-6f84b7998d-vdclx\" (UID: \"3b235d43-cc5f-47e5-8075-9b531b776e17\") " pod="opendatahub/maas-controller-6f84b7998d-vdclx"
Sep 09 14:19:27.532904 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.532822    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b235d43-cc5f-47e5-8075-9b531b776e17-metrics-certs\") pod \"maas-controller-6f84b7998d-vdclx\" (UID: \"3b235d43-cc5f-47e5-8075-9b531b776e17\") " pod="opendatahub/maas-controller-6f84b7998d-vdclx"
Sep 09 14:19:27.532904 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.532855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfzgl\" (UniqueName: \"kubernetes.io/projected/3b235d43-cc5f-47e5-8075-9b531b776e17-kube-api-access-rfzgl\") pod \"maas-controller-6f84b7998d-vdclx\" (UID: \"3b235d43-cc5f-47e5-8075-9b531b776e17\") " pod="opendatahub/maas-controller-6f84b7998d-vdclx"
Sep 09 14:19:27.533003 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:19:27.532943    2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 09 14:19:27.533037 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:19:27.533021    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b235d43-cc5f-47e5-8075-9b531b776e17-metrics-certs podName:3b235d43-cc5f-47e5-8075-9b531b776e17 nodeName:}" failed. No retries permitted until 2026-09-09 14:19:28.033001066 +0000 UTC m=+532.759541162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b235d43-cc5f-47e5-8075-9b531b776e17-metrics-certs") pod "maas-controller-6f84b7998d-vdclx" (UID: "3b235d43-cc5f-47e5-8075-9b531b776e17") : secret "maas-controller-metrics-tls" not found
Sep 09 14:19:27.535259 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.535231    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b235d43-cc5f-47e5-8075-9b531b776e17-webhook-cert\") pod \"maas-controller-6f84b7998d-vdclx\" (UID: \"3b235d43-cc5f-47e5-8075-9b531b776e17\") " pod="opendatahub/maas-controller-6f84b7998d-vdclx"
Sep 09 14:19:27.546269 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.546248    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfzgl\" (UniqueName: \"kubernetes.io/projected/3b235d43-cc5f-47e5-8075-9b531b776e17-kube-api-access-rfzgl\") pod \"maas-controller-6f84b7998d-vdclx\" (UID: \"3b235d43-cc5f-47e5-8075-9b531b776e17\") " pod="opendatahub/maas-controller-6f84b7998d-vdclx"
Sep 09 14:19:27.551212 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.551188    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b7c47c475-6h2pb"]
Sep 09 14:19:27.553645 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.553624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:19:27.555555 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.555540    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b7c47c475-6h2pb"
Sep 09 14:19:27.566224 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.566198    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b7c47c475-6h2pb"]
Sep 09 14:19:27.633525 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.633462    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-metrics-certs\") pod \"maas-controller-7b7c47c475-6h2pb\" (UID: \"8b19ca93-87ab-4c75-abb5-dcd8f89650bf\") " pod="opendatahub/maas-controller-7b7c47c475-6h2pb"
Sep 09 14:19:27.633525 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.633507    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4hr5\" (UniqueName: \"kubernetes.io/projected/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-kube-api-access-w4hr5\") pod \"maas-controller-7b7c47c475-6h2pb\" (UID: \"8b19ca93-87ab-4c75-abb5-dcd8f89650bf\") " pod="opendatahub/maas-controller-7b7c47c475-6h2pb"
Sep 09 14:19:27.633657 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.633578    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-webhook-cert\") pod \"maas-controller-7b7c47c475-6h2pb\" (UID: \"8b19ca93-87ab-4c75-abb5-dcd8f89650bf\") " pod="opendatahub/maas-controller-7b7c47c475-6h2pb"
Sep 09 14:19:27.734665 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.734637    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-webhook-cert\") pod \"maas-controller-7b7c47c475-6h2pb\" (UID: \"8b19ca93-87ab-4c75-abb5-dcd8f89650bf\") " pod="opendatahub/maas-controller-7b7c47c475-6h2pb"
Sep 09 14:19:27.734771 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.734689    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-metrics-certs\") pod \"maas-controller-7b7c47c475-6h2pb\" (UID: \"8b19ca93-87ab-4c75-abb5-dcd8f89650bf\") " pod="opendatahub/maas-controller-7b7c47c475-6h2pb"
Sep 09 14:19:27.734771 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.734724    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4hr5\" (UniqueName: \"kubernetes.io/projected/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-kube-api-access-w4hr5\") pod \"maas-controller-7b7c47c475-6h2pb\" (UID: \"8b19ca93-87ab-4c75-abb5-dcd8f89650bf\") " pod="opendatahub/maas-controller-7b7c47c475-6h2pb"
Sep 09 14:19:27.737278 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.737247    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-webhook-cert\") pod \"maas-controller-7b7c47c475-6h2pb\" (UID: \"8b19ca93-87ab-4c75-abb5-dcd8f89650bf\") " pod="opendatahub/maas-controller-7b7c47c475-6h2pb"
Sep 09 14:19:27.737372 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.737291    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-metrics-certs\") pod \"maas-controller-7b7c47c475-6h2pb\" (UID: \"8b19ca93-87ab-4c75-abb5-dcd8f89650bf\") " pod="opendatahub/maas-controller-7b7c47c475-6h2pb"
Sep 09 14:19:27.741866 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.741843    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4hr5\" (UniqueName: \"kubernetes.io/projected/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-kube-api-access-w4hr5\") pod \"maas-controller-7b7c47c475-6h2pb\" (UID: \"8b19ca93-87ab-4c75-abb5-dcd8f89650bf\") " pod="opendatahub/maas-controller-7b7c47c475-6h2pb"
Sep 09 14:19:27.743139 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.743115    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:19:27.867228 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:27.867205    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b7c47c475-6h2pb"
Sep 09 14:19:28.036738 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:28.036707    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b235d43-cc5f-47e5-8075-9b531b776e17-metrics-certs\") pod \"maas-controller-6f84b7998d-vdclx\" (UID: \"3b235d43-cc5f-47e5-8075-9b531b776e17\") " pod="opendatahub/maas-controller-6f84b7998d-vdclx"
Sep 09 14:19:28.038893 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:28.038873    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b235d43-cc5f-47e5-8075-9b531b776e17-metrics-certs\") pod \"maas-controller-6f84b7998d-vdclx\" (UID: \"3b235d43-cc5f-47e5-8075-9b531b776e17\") " pod="opendatahub/maas-controller-6f84b7998d-vdclx"
Sep 09 14:19:28.138946 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:28.138923    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b7c47c475-6h2pb"]
Sep 09 14:19:28.141018 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:19:28.140996    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b19ca93_87ab_4c75_abb5_dcd8f89650bf.slice/crio-80799027e3d5b195ce23bd96bc69bc7bbdef3264fbb150e4ce1b9efaaa123268 WatchSource:0}: Error finding container 80799027e3d5b195ce23bd96bc69bc7bbdef3264fbb150e4ce1b9efaaa123268: Status 404 returned error can't find the container with id 80799027e3d5b195ce23bd96bc69bc7bbdef3264fbb150e4ce1b9efaaa123268
Sep 09 14:19:28.223734 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:28.223676    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b7c47c475-6h2pb" event={"ID":"8b19ca93-87ab-4c75-abb5-dcd8f89650bf","Type":"ContainerStarted","Data":"80799027e3d5b195ce23bd96bc69bc7bbdef3264fbb150e4ce1b9efaaa123268"}
Sep 09 14:19:28.290300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:28.290277    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f84b7998d-vdclx"
Sep 09 14:19:28.563088 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:28.563062    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f84b7998d-vdclx"]
Sep 09 14:19:28.565061 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:19:28.565036    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b235d43_cc5f_47e5_8075_9b531b776e17.slice/crio-4aa4432f314827b3f3bfa6db889f4f391477485706135e21cc5c0064007d3e48 WatchSource:0}: Error finding container 4aa4432f314827b3f3bfa6db889f4f391477485706135e21cc5c0064007d3e48: Status 404 returned error can't find the container with id 4aa4432f314827b3f3bfa6db889f4f391477485706135e21cc5c0064007d3e48
Sep 09 14:19:29.229547 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:29.229509    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f84b7998d-vdclx" event={"ID":"3b235d43-cc5f-47e5-8075-9b531b776e17","Type":"ContainerStarted","Data":"4aa4432f314827b3f3bfa6db889f4f391477485706135e21cc5c0064007d3e48"}
Sep 09 14:19:31.507613 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:31.507579    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:19:31.607332 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:31.607259    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:19:32.250642 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:32.250606    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f84b7998d-vdclx" event={"ID":"3b235d43-cc5f-47e5-8075-9b531b776e17","Type":"ContainerStarted","Data":"209216454ec0586540241e7e689c3d75abfdad50d4ad46ac17b55f59c449941d"}
Sep 09 14:19:32.250894 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:32.250684    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f84b7998d-vdclx"
Sep 09 14:19:32.252241 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:32.252206    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b7c47c475-6h2pb" event={"ID":"8b19ca93-87ab-4c75-abb5-dcd8f89650bf","Type":"ContainerStarted","Data":"4cbeb1e8a68576ec625c6051fb57f408c045c64fb18788c9469a6bb2923b5a58"}
Sep 09 14:19:32.252382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:32.252269    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b7c47c475-6h2pb"
Sep 09 14:19:32.271419 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:32.271378    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f84b7998d-vdclx" podStartSLOduration=2.513274269 podStartE2EDuration="5.271364531s" totalImagesPullingTime="2.758090262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:19:32.269949238 +0000 UTC m=+536.996489340" watchObservedRunningTime="2026-09-09 14:19:32.271364531 +0000 UTC m=+536.997904633"
Sep 09 14:19:32.288963 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:32.288918    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b7c47c475-6h2pb" podStartSLOduration=2.099522335 podStartE2EDuration="5.288903014s" totalImagesPullingTime="3.189380679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:19:32.287163868 +0000 UTC m=+537.013703970" watchObservedRunningTime="2026-09-09 14:19:32.288903014 +0000 UTC m=+537.015443165"
Sep 09 14:19:43.259718 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:43.259684    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f84b7998d-vdclx"
Sep 09 14:19:43.260115 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:43.259861    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b7c47c475-6h2pb"
Sep 09 14:19:43.320588 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:43.320550    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f84b7998d-vdclx"]
Sep 09 14:19:43.320834 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:43.320777    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6f84b7998d-vdclx" podUID="3b235d43-cc5f-47e5-8075-9b531b776e17" containerName="manager" containerID="cri-o://209216454ec0586540241e7e689c3d75abfdad50d4ad46ac17b55f59c449941d" gracePeriod=30
Sep 09 14:19:43.562440 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:43.562416    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f84b7998d-vdclx"
Sep 09 14:19:43.668022 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:43.667990    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b235d43-cc5f-47e5-8075-9b531b776e17-metrics-certs\") pod \"3b235d43-cc5f-47e5-8075-9b531b776e17\" (UID: \"3b235d43-cc5f-47e5-8075-9b531b776e17\") "
Sep 09 14:19:43.668207 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:43.668035    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b235d43-cc5f-47e5-8075-9b531b776e17-webhook-cert\") pod \"3b235d43-cc5f-47e5-8075-9b531b776e17\" (UID: \"3b235d43-cc5f-47e5-8075-9b531b776e17\") "
Sep 09 14:19:43.668293 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:43.668221    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfzgl\" (UniqueName: \"kubernetes.io/projected/3b235d43-cc5f-47e5-8075-9b531b776e17-kube-api-access-rfzgl\") pod \"3b235d43-cc5f-47e5-8075-9b531b776e17\" (UID: \"3b235d43-cc5f-47e5-8075-9b531b776e17\") "
Sep 09 14:19:43.670257 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:43.670226    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b235d43-cc5f-47e5-8075-9b531b776e17-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3b235d43-cc5f-47e5-8075-9b531b776e17" (UID: "3b235d43-cc5f-47e5-8075-9b531b776e17"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:19:43.670257 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:43.670246    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b235d43-cc5f-47e5-8075-9b531b776e17-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3b235d43-cc5f-47e5-8075-9b531b776e17" (UID: "3b235d43-cc5f-47e5-8075-9b531b776e17"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:19:43.670392 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:43.670231    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b235d43-cc5f-47e5-8075-9b531b776e17-kube-api-access-rfzgl" (OuterVolumeSpecName: "kube-api-access-rfzgl") pod "3b235d43-cc5f-47e5-8075-9b531b776e17" (UID: "3b235d43-cc5f-47e5-8075-9b531b776e17"). InnerVolumeSpecName "kube-api-access-rfzgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:19:43.768950 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:43.768924    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfzgl\" (UniqueName: \"kubernetes.io/projected/3b235d43-cc5f-47e5-8075-9b531b776e17-kube-api-access-rfzgl\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:19:43.768950 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:43.768950    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b235d43-cc5f-47e5-8075-9b531b776e17-metrics-certs\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:19:43.769076 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:43.768960    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b235d43-cc5f-47e5-8075-9b531b776e17-webhook-cert\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:19:44.173898 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:44.173819    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:19:44.314702 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:44.314673    2562 generic.go:356] "Generic (PLEG): container finished" podID="3b235d43-cc5f-47e5-8075-9b531b776e17" containerID="209216454ec0586540241e7e689c3d75abfdad50d4ad46ac17b55f59c449941d" exitCode=0
Sep 09 14:19:44.315037 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:44.314708    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f84b7998d-vdclx" event={"ID":"3b235d43-cc5f-47e5-8075-9b531b776e17","Type":"ContainerDied","Data":"209216454ec0586540241e7e689c3d75abfdad50d4ad46ac17b55f59c449941d"}
Sep 09 14:19:44.315037 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:44.314719    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f84b7998d-vdclx"
Sep 09 14:19:44.315037 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:44.314746    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f84b7998d-vdclx" event={"ID":"3b235d43-cc5f-47e5-8075-9b531b776e17","Type":"ContainerDied","Data":"4aa4432f314827b3f3bfa6db889f4f391477485706135e21cc5c0064007d3e48"}
Sep 09 14:19:44.315037 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:44.314769    2562 scope.go:117] "RemoveContainer" containerID="209216454ec0586540241e7e689c3d75abfdad50d4ad46ac17b55f59c449941d"
Sep 09 14:19:44.323611 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:44.323456    2562 scope.go:117] "RemoveContainer" containerID="209216454ec0586540241e7e689c3d75abfdad50d4ad46ac17b55f59c449941d"
Sep 09 14:19:44.323720 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:19:44.323703    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"209216454ec0586540241e7e689c3d75abfdad50d4ad46ac17b55f59c449941d\": container with ID starting with 209216454ec0586540241e7e689c3d75abfdad50d4ad46ac17b55f59c449941d not found: ID does not exist" containerID="209216454ec0586540241e7e689c3d75abfdad50d4ad46ac17b55f59c449941d"
Sep 09 14:19:44.323760 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:44.323729    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"209216454ec0586540241e7e689c3d75abfdad50d4ad46ac17b55f59c449941d"} err="failed to get container status \"209216454ec0586540241e7e689c3d75abfdad50d4ad46ac17b55f59c449941d\": rpc error: code = NotFound desc = could not find container \"209216454ec0586540241e7e689c3d75abfdad50d4ad46ac17b55f59c449941d\": container with ID starting with 209216454ec0586540241e7e689c3d75abfdad50d4ad46ac17b55f59c449941d not found: ID does not exist"
Sep 09 14:19:44.331293 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:44.331270    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f84b7998d-vdclx"]
Sep 09 14:19:44.336750 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:44.336730    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f84b7998d-vdclx"]
Sep 09 14:19:45.799670 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:19:45.799632    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b235d43-cc5f-47e5-8075-9b531b776e17" path="/var/lib/kubelet/pods/3b235d43-cc5f-47e5-8075-9b531b776e17/volumes"
Sep 09 14:20:03.325269 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:03.325221    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:03.498110 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:03.498075    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:04.596109 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:04.596065    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:04.698163 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:04.698127    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:04.797317 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:04.797276    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:04.859311 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:04.859217    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:05.206184 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.206078    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:05.306396 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.306363    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:05.350159 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.350131    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-sslq8"]
Sep 09 14:20:05.350540 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.350526    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b235d43-cc5f-47e5-8075-9b531b776e17" containerName="manager"
Sep 09 14:20:05.350586 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.350541    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b235d43-cc5f-47e5-8075-9b531b776e17" containerName="manager"
Sep 09 14:20:05.350637 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.350627    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b235d43-cc5f-47e5-8075-9b531b776e17" containerName="manager"
Sep 09 14:20:05.356999 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.356981    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-sslq8"
Sep 09 14:20:05.359600 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.359564    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 09 14:20:05.359600 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.359564    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7tp9l\""
Sep 09 14:20:05.364820 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.364788    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-sslq8"]
Sep 09 14:20:05.435513 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.435484    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m59b\" (UniqueName: \"kubernetes.io/projected/add57211-b174-481b-b9b7-d75980ab301c-kube-api-access-4m59b\") pod \"payload-processing-5b54b7fbb7-sslq8\" (UID: \"add57211-b174-481b-b9b7-d75980ab301c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sslq8"
Sep 09 14:20:05.435696 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.435531    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/add57211-b174-481b-b9b7-d75980ab301c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-sslq8\" (UID: \"add57211-b174-481b-b9b7-d75980ab301c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sslq8"
Sep 09 14:20:05.537020 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.536923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m59b\" (UniqueName: \"kubernetes.io/projected/add57211-b174-481b-b9b7-d75980ab301c-kube-api-access-4m59b\") pod \"payload-processing-5b54b7fbb7-sslq8\" (UID: \"add57211-b174-481b-b9b7-d75980ab301c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sslq8"
Sep 09 14:20:05.537020 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.536979    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/add57211-b174-481b-b9b7-d75980ab301c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-sslq8\" (UID: \"add57211-b174-481b-b9b7-d75980ab301c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sslq8"
Sep 09 14:20:05.537897 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.537869    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/add57211-b174-481b-b9b7-d75980ab301c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-sslq8\" (UID: \"add57211-b174-481b-b9b7-d75980ab301c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sslq8"
Sep 09 14:20:05.545440 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.545410    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m59b\" (UniqueName: \"kubernetes.io/projected/add57211-b174-481b-b9b7-d75980ab301c-kube-api-access-4m59b\") pod \"payload-processing-5b54b7fbb7-sslq8\" (UID: \"add57211-b174-481b-b9b7-d75980ab301c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sslq8"
Sep 09 14:20:05.668480 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.668441    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-sslq8"
Sep 09 14:20:05.943199 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:05.943132    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-sslq8"]
Sep 09 14:20:05.953030 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:20:05.953002    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadd57211_b174_481b_b9b7_d75980ab301c.slice/crio-4d7f0169cf77319cdd3a2c35ae388d8b5e627022649b30640ee3ff310588cc59 WatchSource:0}: Error finding container 4d7f0169cf77319cdd3a2c35ae388d8b5e627022649b30640ee3ff310588cc59: Status 404 returned error can't find the container with id 4d7f0169cf77319cdd3a2c35ae388d8b5e627022649b30640ee3ff310588cc59
Sep 09 14:20:06.422280 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:06.422241    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-sslq8" event={"ID":"add57211-b174-481b-b9b7-d75980ab301c","Type":"ContainerStarted","Data":"4d7f0169cf77319cdd3a2c35ae388d8b5e627022649b30640ee3ff310588cc59"}
Sep 09 14:20:08.434020 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:08.433986    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-sslq8" event={"ID":"add57211-b174-481b-b9b7-d75980ab301c","Type":"ContainerStarted","Data":"820a53ed4a9eb42e34638f8c60563d1515ead50f5fb7476e69943f61b20f4d7d"}
Sep 09 14:20:08.434437 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:08.434069    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-sslq8"
Sep 09 14:20:09.321249 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:09.321201    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:14.129582 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:14.128796    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hsjqp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": read tcp 10.132.0.2:46468->10.132.0.38:15021: read: connection reset by peer" start-of-body=
Sep 09 14:20:14.129582 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:14.128853    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp" podUID="dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": read tcp 10.132.0.2:46468->10.132.0.38:15021: read: connection reset by peer"
Sep 09 14:20:14.468549 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:14.468477    2562 generic.go:356] "Generic (PLEG): container finished" podID="dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9" containerID="c9bca75a9c2d86621916c0fb09e2fa307a286fd849930c1115531ab968d8c461" exitCode=0
Sep 09 14:20:14.468683 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:14.468550    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp" event={"ID":"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9","Type":"ContainerDied","Data":"c9bca75a9c2d86621916c0fb09e2fa307a286fd849930c1115531ab968d8c461"}
Sep 09 14:20:14.468921 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:14.468904    2562 scope.go:117] "RemoveContainer" containerID="c9bca75a9c2d86621916c0fb09e2fa307a286fd849930c1115531ab968d8c461"
Sep 09 14:20:14.469855 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:14.469826    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:20:14.469923 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:14.469908    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:20:14.469982 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:14.469969    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:20:14.487876 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:14.487828    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-sslq8" podStartSLOduration=7.446892235 podStartE2EDuration="9.487809498s" totalImagesPullingTime="2.040917263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:20:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:20:08.45330974 +0000 UTC m=+573.179849842" watchObservedRunningTime="2026-09-09 14:20:14.487809498 +0000 UTC m=+579.214349600"
Sep 09 14:20:15.327430 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:15.327398    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:15.481736 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:15.481692    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp" event={"ID":"dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9","Type":"ContainerStarted","Data":"8a1f9a0cb49df1d0e103fb8527656613cca08614c0615dd35c11a757723bbce0"}
Sep 09 14:20:15.710736 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:15.710649    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:20:15.710886 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:15.710866    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hsjqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 09 14:20:15.710928 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:15.710905    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp" podUID="dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 09 14:20:15.777382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:15.777345    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:16.364887 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:16.364848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:16.459812 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:16.459780    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:16.711218 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:16.711118    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hsjqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 09 14:20:16.711218 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:16.711184    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp" podUID="dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 09 14:20:17.710862 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:17.710824    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hsjqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 09 14:20:17.711223 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:17.710880    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp" podUID="dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 09 14:20:18.711379 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:18.711343    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hsjqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 09 14:20:18.711767 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:18.711398    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp" podUID="dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 09 14:20:19.444603 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:19.444569    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-sslq8"
Sep 09 14:20:19.711391 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:19.711305    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hsjqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 09 14:20:19.711391 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:19.711374    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp" podUID="dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 09 14:20:20.713967 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:20.713937    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:20:20.714421 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:20.714292    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:20:20.714978 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:20.714958    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hsjqp"
Sep 09 14:20:21.196948 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.196911    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"]
Sep 09 14:20:21.202453 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.202428    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.205327 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.205303    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 09 14:20:21.205474 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.205327    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-scw2n\""
Sep 09 14:20:21.205474 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.205448    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 14:20:21.205587 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.205535    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 14:20:21.209769 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.209743    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"]
Sep 09 14:20:21.270054 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.270021    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:21.305091 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.305063    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/611e687e-e928-4ab3-b534-7a53568c38db-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.305227 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.305104    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/611e687e-e928-4ab3-b534-7a53568c38db-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.305227 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.305134    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/611e687e-e928-4ab3-b534-7a53568c38db-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.305227 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.305208    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/611e687e-e928-4ab3-b534-7a53568c38db-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.305343 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.305246    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/611e687e-e928-4ab3-b534-7a53568c38db-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.305343 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.305303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mktkg\" (UniqueName: \"kubernetes.io/projected/611e687e-e928-4ab3-b534-7a53568c38db-kube-api-access-mktkg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.405934 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.405900    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/611e687e-e928-4ab3-b534-7a53568c38db-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.406101 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.405951    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/611e687e-e928-4ab3-b534-7a53568c38db-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.406101 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.405967    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/611e687e-e928-4ab3-b534-7a53568c38db-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.406101 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.406088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/611e687e-e928-4ab3-b534-7a53568c38db-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.406301 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.406136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mktkg\" (UniqueName: \"kubernetes.io/projected/611e687e-e928-4ab3-b534-7a53568c38db-kube-api-access-mktkg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.406301 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.406229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/611e687e-e928-4ab3-b534-7a53568c38db-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.406420 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.406314    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/611e687e-e928-4ab3-b534-7a53568c38db-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.406420 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.406395    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/611e687e-e928-4ab3-b534-7a53568c38db-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.406597 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.406570    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/611e687e-e928-4ab3-b534-7a53568c38db-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.408297 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.408274    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/611e687e-e928-4ab3-b534-7a53568c38db-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.408468 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.408453    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/611e687e-e928-4ab3-b534-7a53568c38db-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.413698 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.413675    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mktkg\" (UniqueName: \"kubernetes.io/projected/611e687e-e928-4ab3-b534-7a53568c38db-kube-api-access-mktkg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm\" (UID: \"611e687e-e928-4ab3-b534-7a53568c38db\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.515022 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.514952    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:21.786817 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:21.786797    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"]
Sep 09 14:20:21.789258 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:20:21.789226    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611e687e_e928_4ab3_b534_7a53568c38db.slice/crio-faad19dabf9fcb97a312b551d36e20b68cb8f632c3f6eadfc48a95a85ee78cb6 WatchSource:0}: Error finding container faad19dabf9fcb97a312b551d36e20b68cb8f632c3f6eadfc48a95a85ee78cb6: Status 404 returned error can't find the container with id faad19dabf9fcb97a312b551d36e20b68cb8f632c3f6eadfc48a95a85ee78cb6
Sep 09 14:20:22.518844 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:22.518806    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm" event={"ID":"611e687e-e928-4ab3-b534-7a53568c38db","Type":"ContainerStarted","Data":"faad19dabf9fcb97a312b551d36e20b68cb8f632c3f6eadfc48a95a85ee78cb6"}
Sep 09 14:20:23.525060 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:23.525016    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm" event={"ID":"611e687e-e928-4ab3-b534-7a53568c38db","Type":"ContainerStarted","Data":"36837623921f5cfa18ca6af6aabc2f06bf3dc3a745f098e7786ab505caa8a59b"}
Sep 09 14:20:23.541739 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:23.541679    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm" podStartSLOduration=1.3973271010000001 podStartE2EDuration="2.541663696s" totalImagesPullingTime="1.144336595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:20:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:20:23.540721811 +0000 UTC m=+588.267261911" watchObservedRunningTime="2026-09-09 14:20:23.541663696 +0000 UTC m=+588.268203797"
Sep 09 14:20:28.730216 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:28.730183    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:31.515414 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:31.515378    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:31.515768 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:31.515450    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:31.527542 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:31.527520    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:31.574988 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:31.574965    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm"
Sep 09 14:20:35.731818 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:35.731784    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:20:35.732330 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:35.731953    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:20:39.726274 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:39.726233    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:39.822069 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:39.822029    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:51.534812 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:51.534774    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:20:59.717949 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:20:59.717868    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:21:07.737629 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:21:07.737581    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:21:18.802614 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:21:18.802581    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:21:32.936817 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:21:32.936771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:21:33.342299 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:21:33.342265    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:21:39.026437 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:21:39.026399    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:22:45.328086 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:22:45.328000    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:31.221080 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:31.221032    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56f77dbb54-2rzr4"]
Sep 09 14:23:31.225103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:31.225070    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56f77dbb54-2rzr4"
Sep 09 14:23:31.228710 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:31.228678    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 09 14:23:31.228886 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:31.228720    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2qvvt\""
Sep 09 14:23:31.243045 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:31.243002    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56f77dbb54-2rzr4"]
Sep 09 14:23:31.360983 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:31.360940    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd471663-9bbd-4225-9f6a-7112a569384e-tls-cert\") pod \"authorino-56f77dbb54-2rzr4\" (UID: \"bd471663-9bbd-4225-9f6a-7112a569384e\") " pod="kuadrant-system/authorino-56f77dbb54-2rzr4"
Sep 09 14:23:31.361229 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:31.361054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9ww8\" (UniqueName: \"kubernetes.io/projected/bd471663-9bbd-4225-9f6a-7112a569384e-kube-api-access-q9ww8\") pod \"authorino-56f77dbb54-2rzr4\" (UID: \"bd471663-9bbd-4225-9f6a-7112a569384e\") " pod="kuadrant-system/authorino-56f77dbb54-2rzr4"
Sep 09 14:23:31.462681 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:31.462627    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd471663-9bbd-4225-9f6a-7112a569384e-tls-cert\") pod \"authorino-56f77dbb54-2rzr4\" (UID: \"bd471663-9bbd-4225-9f6a-7112a569384e\") " pod="kuadrant-system/authorino-56f77dbb54-2rzr4"
Sep 09 14:23:31.462942 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:31.462729    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9ww8\" (UniqueName: \"kubernetes.io/projected/bd471663-9bbd-4225-9f6a-7112a569384e-kube-api-access-q9ww8\") pod \"authorino-56f77dbb54-2rzr4\" (UID: \"bd471663-9bbd-4225-9f6a-7112a569384e\") " pod="kuadrant-system/authorino-56f77dbb54-2rzr4"
Sep 09 14:23:31.465472 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:31.465446    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd471663-9bbd-4225-9f6a-7112a569384e-tls-cert\") pod \"authorino-56f77dbb54-2rzr4\" (UID: \"bd471663-9bbd-4225-9f6a-7112a569384e\") " pod="kuadrant-system/authorino-56f77dbb54-2rzr4"
Sep 09 14:23:31.470569 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:31.470540    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9ww8\" (UniqueName: \"kubernetes.io/projected/bd471663-9bbd-4225-9f6a-7112a569384e-kube-api-access-q9ww8\") pod \"authorino-56f77dbb54-2rzr4\" (UID: \"bd471663-9bbd-4225-9f6a-7112a569384e\") " pod="kuadrant-system/authorino-56f77dbb54-2rzr4"
Sep 09 14:23:31.535997 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:31.535885    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56f77dbb54-2rzr4"
Sep 09 14:23:31.817493 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:31.817461    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56f77dbb54-2rzr4"]
Sep 09 14:23:31.820209 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:23:31.820143    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd471663_9bbd_4225_9f6a_7112a569384e.slice/crio-af0bf48fec28363fee05e9df1d05b6fc7ebbe39d0abc596a0462460aee2343d5 WatchSource:0}: Error finding container af0bf48fec28363fee05e9df1d05b6fc7ebbe39d0abc596a0462460aee2343d5: Status 404 returned error can't find the container with id af0bf48fec28363fee05e9df1d05b6fc7ebbe39d0abc596a0462460aee2343d5
Sep 09 14:23:31.821578 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:31.821544    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 14:23:32.481936 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:32.481897    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56f77dbb54-2rzr4" event={"ID":"bd471663-9bbd-4225-9f6a-7112a569384e","Type":"ContainerStarted","Data":"af0bf48fec28363fee05e9df1d05b6fc7ebbe39d0abc596a0462460aee2343d5"}
Sep 09 14:23:33.491847 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:33.491729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56f77dbb54-2rzr4" event={"ID":"bd471663-9bbd-4225-9f6a-7112a569384e","Type":"ContainerStarted","Data":"b1681152e84df0f7c2203aba8ae1696e0ca1d9f6bd3f0226d42ed9827a6346c4"}
Sep 09 14:23:33.510840 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:33.510778    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56f77dbb54-2rzr4" podStartSLOduration=1.098216291 podStartE2EDuration="2.510757573s" totalImagesPullingTime="1.412541282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:23:33.509711879 +0000 UTC m=+778.236251982" watchObservedRunningTime="2026-09-09 14:23:33.510757573 +0000 UTC m=+778.237297674"
Sep 09 14:23:34.240512 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:34.240468    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:34.341292 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:34.341244    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:35.271603 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:35.271546    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:35.374868 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:35.374823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:51.965786 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:51.965747    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:52.112541 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.112496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:52.305242 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.305204    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"]
Sep 09 14:23:52.309363 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.309330    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.312586 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.312554    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a0fa5a-openshift-default-dockercfg-tsz76\""
Sep 09 14:23:52.320561 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.320521    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"]
Sep 09 14:23:52.364254 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.364213    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:52.470558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.470511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-workload-socket\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.470558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.470555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-token\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.470783 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.470586    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istiod-ca-cert\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.470783 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.470643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-workload-certs\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.470783 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.470686    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc24k\" (UniqueName: \"kubernetes.io/projected/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-kube-api-access-kc24k\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.470783 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.470729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-envoy\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.470911 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.470788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-credential-socket\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.470911 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.470821    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-data\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.470911 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.470847    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-podinfo\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.572231 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.572116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-workload-socket\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.572231 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.572161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-token\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.572439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.572307    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istiod-ca-cert\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.572439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.572364    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-workload-certs\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.572439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.572406    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc24k\" (UniqueName: \"kubernetes.io/projected/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-kube-api-access-kc24k\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.572572 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.572471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-envoy\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.572572 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.572503    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-credential-socket\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.572572 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.572528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-data\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.572572 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.572564    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-podinfo\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.572771 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.572661    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-workload-socket\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.572771 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.572760    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-workload-certs\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.572883 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.572871    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-credential-socket\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.572977 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.572955    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-data\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.573135 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.573120    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istiod-ca-cert\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.575029 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.574986    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-envoy\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.575269 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.575247    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-podinfo\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.581532 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.581500    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-token\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.581717 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.581582    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc24k\" (UniqueName: \"kubernetes.io/projected/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-kube-api-access-kc24k\") pod \"e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") " pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.623068 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.623017    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:52.723961 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.723925    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:52.908219 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.908113    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"]
Sep 09 14:23:52.911824 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:23:52.911796    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d2f33a_a93b_4818_8ba9_d9d1a55fd02e.slice/crio-1c87f4729aeb0a76714b2a63be9dfa60e794efe49f3a0b8f4b85312da6358624 WatchSource:0}: Error finding container 1c87f4729aeb0a76714b2a63be9dfa60e794efe49f3a0b8f4b85312da6358624: Status 404 returned error can't find the container with id 1c87f4729aeb0a76714b2a63be9dfa60e794efe49f3a0b8f4b85312da6358624
Sep 09 14:23:52.914314 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.914269    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:23:52.914392 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.914374    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:23:52.914434 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:52.914417    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:23:53.605668 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:53.605628    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d" event={"ID":"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e","Type":"ContainerStarted","Data":"3698419f9e5ec088251b187687617fce1d424f2c0354dfbb15681460798c9031"}
Sep 09 14:23:53.606094 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:53.605690    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d" event={"ID":"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e","Type":"ContainerStarted","Data":"1c87f4729aeb0a76714b2a63be9dfa60e794efe49f3a0b8f4b85312da6358624"}
Sep 09 14:23:53.624130 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:53.624096    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:53.628060 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:53.627997    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d" podStartSLOduration=1.627975065 podStartE2EDuration="1.627975065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:23:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:23:53.625786623 +0000 UTC m=+798.352326773" watchObservedRunningTime="2026-09-09 14:23:53.627975065 +0000 UTC m=+798.354515167"
Sep 09 14:23:53.629979 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:53.629947    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:54.016966 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:54.016867    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7393-140414908661552"]
Sep 09 14:23:54.020536 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:54.020509    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-140414908661552"
Sep 09 14:23:54.022797 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:54.022764    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-txzw7\""
Sep 09 14:23:54.028538 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:54.028499    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7393-140414908661552"]
Sep 09 14:23:54.087236 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:54.087146    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jscxp\" (UniqueName: \"kubernetes.io/projected/0b9628ba-db23-4cd9-913b-46009e8c7dd7-kube-api-access-jscxp\") pod \"test-curl-7393-140414908661552\" (UID: \"0b9628ba-db23-4cd9-913b-46009e8c7dd7\") " pod="opendatahub/test-curl-7393-140414908661552"
Sep 09 14:23:54.188483 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:54.188435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jscxp\" (UniqueName: \"kubernetes.io/projected/0b9628ba-db23-4cd9-913b-46009e8c7dd7-kube-api-access-jscxp\") pod \"test-curl-7393-140414908661552\" (UID: \"0b9628ba-db23-4cd9-913b-46009e8c7dd7\") " pod="opendatahub/test-curl-7393-140414908661552"
Sep 09 14:23:54.197047 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:54.197006    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jscxp\" (UniqueName: \"kubernetes.io/projected/0b9628ba-db23-4cd9-913b-46009e8c7dd7-kube-api-access-jscxp\") pod \"test-curl-7393-140414908661552\" (UID: \"0b9628ba-db23-4cd9-913b-46009e8c7dd7\") " pod="opendatahub/test-curl-7393-140414908661552"
Sep 09 14:23:54.333042 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:54.332999    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-140414908661552"
Sep 09 14:23:54.510136 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:54.510097    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:54.608880 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:54.608837    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7393-140414908661552"]
Sep 09 14:23:54.609644 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:54.609602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:54.611408 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:23:54.611368    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b9628ba_db23_4cd9_913b_46009e8c7dd7.slice/crio-9d6a6f7d232abdf9ad60d663479422a5d17eec30c051083de3b574f2e86264e6 WatchSource:0}: Error finding container 9d6a6f7d232abdf9ad60d663479422a5d17eec30c051083de3b574f2e86264e6: Status 404 returned error can't find the container with id 9d6a6f7d232abdf9ad60d663479422a5d17eec30c051083de3b574f2e86264e6
Sep 09 14:23:54.612753 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:54.612725    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:54.613986 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:54.613951    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:23:55.557062 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:55.557013    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:55.619863 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:55.619821    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-140414908661552" event={"ID":"0b9628ba-db23-4cd9-913b-46009e8c7dd7","Type":"ContainerStarted","Data":"9d6a6f7d232abdf9ad60d663479422a5d17eec30c051083de3b574f2e86264e6"}
Sep 09 14:23:55.659791 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:55.659750    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:56.628018 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:56.627974    2562 generic.go:356] "Generic (PLEG): container finished" podID="0b9628ba-db23-4cd9-913b-46009e8c7dd7" containerID="d78828988c667f2d16793d015f307dd24c82a639dcda322a873ef0674696a929" exitCode=0
Sep 09 14:23:56.628456 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:56.628061    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-140414908661552" event={"ID":"0b9628ba-db23-4cd9-913b-46009e8c7dd7","Type":"ContainerDied","Data":"d78828988c667f2d16793d015f307dd24c82a639dcda322a873ef0674696a929"}
Sep 09 14:23:56.941954 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:56.941855    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:57.054372 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.054325    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:57.220877 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.220768    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:57.570160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.570120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:57.732217 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.732131    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:57.821551 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.821443    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-140414908661552"
Sep 09 14:23:57.835992 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.835950    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"]
Sep 09 14:23:57.836410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.836395    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b9628ba-db23-4cd9-913b-46009e8c7dd7" containerName="test-curl-7393-140414908661552"
Sep 09 14:23:57.836480 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.836413    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b9628ba-db23-4cd9-913b-46009e8c7dd7" containerName="test-curl-7393-140414908661552"
Sep 09 14:23:57.836516 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.836485    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b9628ba-db23-4cd9-913b-46009e8c7dd7" containerName="test-curl-7393-140414908661552"
Sep 09 14:23:57.840103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.840055    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"
Sep 09 14:23:57.845029 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.844146    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-a0fa5a-dockercfg-chfwc\""
Sep 09 14:23:57.849021 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.848724    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-a0fa5a\""
Sep 09 14:23:57.851498 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.851293    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7393-140414908661552_0b9628ba-db23-4cd9-913b-46009e8c7dd7/test-curl-7393-140414908661552/0.log"
Sep 09 14:23:57.864204 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.864138    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"]
Sep 09 14:23:57.882698 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.882653    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7393-140414908661552"]
Sep 09 14:23:57.890748 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.890697    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7393-140414908661552"]
Sep 09 14:23:57.930009 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.929959    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jscxp\" (UniqueName: \"kubernetes.io/projected/0b9628ba-db23-4cd9-913b-46009e8c7dd7-kube-api-access-jscxp\") pod \"0b9628ba-db23-4cd9-913b-46009e8c7dd7\" (UID: \"0b9628ba-db23-4cd9-913b-46009e8c7dd7\") "
Sep 09 14:23:57.930238 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.930092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51ff6878-d559-4f48-945e-e0ba6db97bb8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q\" (UID: \"51ff6878-d559-4f48-945e-e0ba6db97bb8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"
Sep 09 14:23:57.930238 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.930156    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvqsk\" (UniqueName: \"kubernetes.io/projected/51ff6878-d559-4f48-945e-e0ba6db97bb8-kube-api-access-gvqsk\") pod \"payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q\" (UID: \"51ff6878-d559-4f48-945e-e0ba6db97bb8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"
Sep 09 14:23:57.932349 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:57.932313    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b9628ba-db23-4cd9-913b-46009e8c7dd7-kube-api-access-jscxp" (OuterVolumeSpecName: "kube-api-access-jscxp") pod "0b9628ba-db23-4cd9-913b-46009e8c7dd7" (UID: "0b9628ba-db23-4cd9-913b-46009e8c7dd7"). InnerVolumeSpecName "kube-api-access-jscxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:23:58.030995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.030942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51ff6878-d559-4f48-945e-e0ba6db97bb8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q\" (UID: \"51ff6878-d559-4f48-945e-e0ba6db97bb8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"
Sep 09 14:23:58.030995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.031007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvqsk\" (UniqueName: \"kubernetes.io/projected/51ff6878-d559-4f48-945e-e0ba6db97bb8-kube-api-access-gvqsk\") pod \"payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q\" (UID: \"51ff6878-d559-4f48-945e-e0ba6db97bb8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"
Sep 09 14:23:58.031428 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.031080    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jscxp\" (UniqueName: \"kubernetes.io/projected/0b9628ba-db23-4cd9-913b-46009e8c7dd7-kube-api-access-jscxp\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:23:58.032019 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.031988    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51ff6878-d559-4f48-945e-e0ba6db97bb8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q\" (UID: \"51ff6878-d559-4f48-945e-e0ba6db97bb8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"
Sep 09 14:23:58.033848 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.033816    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7393-140414908661552"]
Sep 09 14:23:58.037971 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.037934    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-140414908661552"
Sep 09 14:23:58.047069 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.047034    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvqsk\" (UniqueName: \"kubernetes.io/projected/51ff6878-d559-4f48-945e-e0ba6db97bb8-kube-api-access-gvqsk\") pod \"payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q\" (UID: \"51ff6878-d559-4f48-945e-e0ba6db97bb8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"
Sep 09 14:23:58.050563 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.050514    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7393-140414908661552"]
Sep 09 14:23:58.132003 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.131870    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwscf\" (UniqueName: \"kubernetes.io/projected/39e7ee8e-6623-434f-87e2-4a76478f6375-kube-api-access-cwscf\") pod \"test-curl-7393-140414908661552\" (UID: \"39e7ee8e-6623-434f-87e2-4a76478f6375\") " pod="opendatahub/test-curl-7393-140414908661552"
Sep 09 14:23:58.161582 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.161536    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"
Sep 09 14:23:58.234774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.233724    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwscf\" (UniqueName: \"kubernetes.io/projected/39e7ee8e-6623-434f-87e2-4a76478f6375-kube-api-access-cwscf\") pod \"test-curl-7393-140414908661552\" (UID: \"39e7ee8e-6623-434f-87e2-4a76478f6375\") " pod="opendatahub/test-curl-7393-140414908661552"
Sep 09 14:23:58.246230 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.246158    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwscf\" (UniqueName: \"kubernetes.io/projected/39e7ee8e-6623-434f-87e2-4a76478f6375-kube-api-access-cwscf\") pod \"test-curl-7393-140414908661552\" (UID: \"39e7ee8e-6623-434f-87e2-4a76478f6375\") " pod="opendatahub/test-curl-7393-140414908661552"
Sep 09 14:23:58.368317 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.368266    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-140414908661552"
Sep 09 14:23:58.451938 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:23:58.451760    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ff6878_d559_4f48_945e_e0ba6db97bb8.slice/crio-91edc0d74a2a55199ef981e79cd0850a0693716f6ba54a8d764f4991c0caaa02 WatchSource:0}: Error finding container 91edc0d74a2a55199ef981e79cd0850a0693716f6ba54a8d764f4991c0caaa02: Status 404 returned error can't find the container with id 91edc0d74a2a55199ef981e79cd0850a0693716f6ba54a8d764f4991c0caaa02
Sep 09 14:23:58.453785 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.453749    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"]
Sep 09 14:23:58.644201 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.644002    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q" event={"ID":"51ff6878-d559-4f48-945e-e0ba6db97bb8","Type":"ContainerStarted","Data":"88752478c17b9ddf1635a5c532354de1bb8984017a811efc463e473ac44a178f"}
Sep 09 14:23:58.644201 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.644051    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q" event={"ID":"51ff6878-d559-4f48-945e-e0ba6db97bb8","Type":"ContainerStarted","Data":"91edc0d74a2a55199ef981e79cd0850a0693716f6ba54a8d764f4991c0caaa02"}
Sep 09 14:23:58.644201 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.644085    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"
Sep 09 14:23:58.653889 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.650925    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d6a6f7d232abdf9ad60d663479422a5d17eec30c051083de3b574f2e86264e6"
Sep 09 14:23:58.653889 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.651019    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-140414908661552"
Sep 09 14:23:58.657273 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.657236    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7393-140414908661552"]
Sep 09 14:23:58.665926 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.665875    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q" podStartSLOduration=1.66586013 podStartE2EDuration="1.66586013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:23:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:23:58.664802812 +0000 UTC m=+803.391342916" watchObservedRunningTime="2026-09-09 14:23:58.66586013 +0000 UTC m=+803.392400231"
Sep 09 14:23:58.667748 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:58.667709    2562 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7393-140414908661552" oldPodUID="0b9628ba-db23-4cd9-913b-46009e8c7dd7" podUID="39e7ee8e-6623-434f-87e2-4a76478f6375"
Sep 09 14:23:59.658321 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:59.658283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-140414908661552" event={"ID":"39e7ee8e-6623-434f-87e2-4a76478f6375","Type":"ContainerStarted","Data":"0027e647879f606871bd98c9695b6a08b2071309c0cddf7a385e6b34165f0d91"}
Sep 09 14:23:59.801508 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:59.801462    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b9628ba-db23-4cd9-913b-46009e8c7dd7" path="/var/lib/kubelet/pods/0b9628ba-db23-4cd9-913b-46009e8c7dd7/volumes"
Sep 09 14:23:59.853198 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:59.853133    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:23:59.952242 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:23:59.952132    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:00.120765 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.120719    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:00.394507 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.394464    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"]
Sep 09 14:24:00.399851 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.399816    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.402327 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.402286    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ac63e256-openshift-default-dockercfg-ngjp6\""
Sep 09 14:24:00.409967 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.409936    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"]
Sep 09 14:24:00.425333 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.425295    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:00.458335 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.458283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-data\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.458535 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.458354    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-workload-certs\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.458535 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.458401    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-credential-socket\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.458535 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.458426    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-workload-socket\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.458535 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.458456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-podinfo\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.458535 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.458480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-token\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.458699 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.458539    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-envoy\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.458699 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.458588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istiod-ca-cert\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.458699 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.458654    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm4j9\" (UniqueName: \"kubernetes.io/projected/a4d82052-66ce-4caf-8eba-ae9cc402ff64-kube-api-access-zm4j9\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.559808 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.559758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-data\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.560036 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.559826    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-workload-certs\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.560036 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.559874    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-credential-socket\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.560036 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.559904    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-workload-socket\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.560036 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.559940    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-podinfo\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.560036 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.559973    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-token\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.560036 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.560003    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-envoy\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.560729 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.560263    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istiod-ca-cert\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.560729 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.560324    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-workload-certs\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.560729 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.560331    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm4j9\" (UniqueName: \"kubernetes.io/projected/a4d82052-66ce-4caf-8eba-ae9cc402ff64-kube-api-access-zm4j9\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.560729 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.560355    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-credential-socket\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.560729 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.560401    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-data\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.560729 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.560417    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-workload-socket\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.561097 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.561075    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istiod-ca-cert\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.562606 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.562580    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-envoy\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.562735 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.562715    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-podinfo\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.568859 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.568825    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-token\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.568956 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.568890    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm4j9\" (UniqueName: \"kubernetes.io/projected/a4d82052-66ce-4caf-8eba-ae9cc402ff64-kube-api-access-zm4j9\") pod \"e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") " pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.714145 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.714051    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:00.723805 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:00.723771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:01.008968 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:01.008938    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"]
Sep 09 14:24:01.011064 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:24:01.011026    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d82052_66ce_4caf_8eba_ae9cc402ff64.slice/crio-42ba23a67397eaa33d9b973960703925cceb4c3e849bbe10e00dc7f1f86fef76 WatchSource:0}: Error finding container 42ba23a67397eaa33d9b973960703925cceb4c3e849bbe10e00dc7f1f86fef76: Status 404 returned error can't find the container with id 42ba23a67397eaa33d9b973960703925cceb4c3e849bbe10e00dc7f1f86fef76
Sep 09 14:24:01.013754 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:01.013713    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:24:01.013869 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:01.013796    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:24:01.013869 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:01.013825    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:24:01.671366 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:01.671331    2562 generic.go:356] "Generic (PLEG): container finished" podID="39e7ee8e-6623-434f-87e2-4a76478f6375" containerID="d61a2bfda376f56c334b7f5d9c848c38fd68ac1bb5a780bd12cc15db127cad3c" exitCode=0
Sep 09 14:24:01.671541 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:01.671412    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7393-140414908661552" event={"ID":"39e7ee8e-6623-434f-87e2-4a76478f6375","Type":"ContainerDied","Data":"d61a2bfda376f56c334b7f5d9c848c38fd68ac1bb5a780bd12cc15db127cad3c"}
Sep 09 14:24:01.673095 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:01.673071    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h" event={"ID":"a4d82052-66ce-4caf-8eba-ae9cc402ff64","Type":"ContainerStarted","Data":"97bf6f5ad37c47579f64ea389849259afac7d4a6eb8b356756ff9c4e87534c0f"}
Sep 09 14:24:01.673197 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:01.673116    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h" event={"ID":"a4d82052-66ce-4caf-8eba-ae9cc402ff64","Type":"ContainerStarted","Data":"42ba23a67397eaa33d9b973960703925cceb4c3e849bbe10e00dc7f1f86fef76"}
Sep 09 14:24:01.703070 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:01.703011    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h" podStartSLOduration=1.702986514 podStartE2EDuration="1.702986514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:24:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:24:01.702335938 +0000 UTC m=+806.428876040" watchObservedRunningTime="2026-09-09 14:24:01.702986514 +0000 UTC m=+806.429526618"
Sep 09 14:24:01.715091 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:01.715044    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:02.721059 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:02.721021    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:02.829517 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:02.829483    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-140414908661552"
Sep 09 14:24:02.850442 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:02.850341    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7393-140414908661552_39e7ee8e-6623-434f-87e2-4a76478f6375/test-curl-7393-140414908661552/0.log"
Sep 09 14:24:02.877495 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:02.877440    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7393-140414908661552"]
Sep 09 14:24:02.880810 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:02.880770    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwscf\" (UniqueName: \"kubernetes.io/projected/39e7ee8e-6623-434f-87e2-4a76478f6375-kube-api-access-cwscf\") pod \"39e7ee8e-6623-434f-87e2-4a76478f6375\" (UID: \"39e7ee8e-6623-434f-87e2-4a76478f6375\") "
Sep 09 14:24:02.881276 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:02.881234    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7393-140414908661552"]
Sep 09 14:24:02.883055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:02.883027    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39e7ee8e-6623-434f-87e2-4a76478f6375-kube-api-access-cwscf" (OuterVolumeSpecName: "kube-api-access-cwscf") pod "39e7ee8e-6623-434f-87e2-4a76478f6375" (UID: "39e7ee8e-6623-434f-87e2-4a76478f6375"). InnerVolumeSpecName "kube-api-access-cwscf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:24:02.982409 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:02.982297    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwscf\" (UniqueName: \"kubernetes.io/projected/39e7ee8e-6623-434f-87e2-4a76478f6375-kube-api-access-cwscf\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:24:03.086257 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:03.086207    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:03.195720 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:03.195681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:03.427955 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:03.427917    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:03.686790 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:03.686703    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7393-140414908661552"
Sep 09 14:24:03.686790 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:03.686731    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0027e647879f606871bd98c9695b6a08b2071309c0cddf7a385e6b34165f0d91"
Sep 09 14:24:03.687028 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:03.687013    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:03.687942 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:03.687920    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:03.712513 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:24:03.712463    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7393-140414908661552\" is forbidden: User \"system:node:ip-10-0-140-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-6.ec2.internal' and this object" podUID="39e7ee8e-6623-434f-87e2-4a76478f6375" pod="opendatahub/test-curl-7393-140414908661552"
Sep 09 14:24:03.770603 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:03.770571    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:03.800557 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:03.800520    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39e7ee8e-6623-434f-87e2-4a76478f6375" path="/var/lib/kubelet/pods/39e7ee8e-6623-434f-87e2-4a76478f6375/volumes"
Sep 09 14:24:03.917457 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:03.917417    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:04.291182 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:04.291129    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:04.374246 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:04.374207    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:04.801114 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:04.801082    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:04.906473 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:04.906439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:04.929205 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:04.929161    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"]
Sep 09 14:24:04.929618 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:04.929604    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39e7ee8e-6623-434f-87e2-4a76478f6375" containerName="test-curl-7393-140414908661552"
Sep 09 14:24:04.929668 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:04.929619    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="39e7ee8e-6623-434f-87e2-4a76478f6375" containerName="test-curl-7393-140414908661552"
Sep 09 14:24:04.929704 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:04.929680    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="39e7ee8e-6623-434f-87e2-4a76478f6375" containerName="test-curl-7393-140414908661552"
Sep 09 14:24:04.932966 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:04.932944    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"
Sep 09 14:24:04.935740 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:04.935720    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ac63e256\""
Sep 09 14:24:04.935863 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:04.935721    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ac63e256-dockercfg-zqdp7\""
Sep 09 14:24:04.945103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:04.945065    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"]
Sep 09 14:24:04.998936 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:04.998898    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:05.002146 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:05.002111    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/361edb2e-ba55-49a7-b093-9c71fc0d8f78-plugins-config-volume\") pod \"payload-processing-e2e-ait-ac63e256-75768864fc-92vcc\" (UID: \"361edb2e-ba55-49a7-b093-9c71fc0d8f78\") " pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"
Sep 09 14:24:05.002318 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:05.002238    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-655pd\" (UniqueName: \"kubernetes.io/projected/361edb2e-ba55-49a7-b093-9c71fc0d8f78-kube-api-access-655pd\") pod \"payload-processing-e2e-ait-ac63e256-75768864fc-92vcc\" (UID: \"361edb2e-ba55-49a7-b093-9c71fc0d8f78\") " pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"
Sep 09 14:24:05.103748 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:05.103708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/361edb2e-ba55-49a7-b093-9c71fc0d8f78-plugins-config-volume\") pod \"payload-processing-e2e-ait-ac63e256-75768864fc-92vcc\" (UID: \"361edb2e-ba55-49a7-b093-9c71fc0d8f78\") " pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"
Sep 09 14:24:05.103925 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:05.103768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-655pd\" (UniqueName: \"kubernetes.io/projected/361edb2e-ba55-49a7-b093-9c71fc0d8f78-kube-api-access-655pd\") pod \"payload-processing-e2e-ait-ac63e256-75768864fc-92vcc\" (UID: \"361edb2e-ba55-49a7-b093-9c71fc0d8f78\") " pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"
Sep 09 14:24:05.104492 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:05.104470    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/361edb2e-ba55-49a7-b093-9c71fc0d8f78-plugins-config-volume\") pod \"payload-processing-e2e-ait-ac63e256-75768864fc-92vcc\" (UID: \"361edb2e-ba55-49a7-b093-9c71fc0d8f78\") " pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"
Sep 09 14:24:05.112273 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:05.112247    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-655pd\" (UniqueName: \"kubernetes.io/projected/361edb2e-ba55-49a7-b093-9c71fc0d8f78-kube-api-access-655pd\") pod \"payload-processing-e2e-ait-ac63e256-75768864fc-92vcc\" (UID: \"361edb2e-ba55-49a7-b093-9c71fc0d8f78\") " pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"
Sep 09 14:24:05.250894 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:05.250855    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"
Sep 09 14:24:05.530179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:05.530132    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"]
Sep 09 14:24:05.532403 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:24:05.532373    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361edb2e_ba55_49a7_b093_9c71fc0d8f78.slice/crio-6dfc03f562085554ce438a7cca7708cea71ec2c77cf1a5a15ae6fd1e49b65c76 WatchSource:0}: Error finding container 6dfc03f562085554ce438a7cca7708cea71ec2c77cf1a5a15ae6fd1e49b65c76: Status 404 returned error can't find the container with id 6dfc03f562085554ce438a7cca7708cea71ec2c77cf1a5a15ae6fd1e49b65c76
Sep 09 14:24:05.701468 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:05.701419    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc" event={"ID":"361edb2e-ba55-49a7-b093-9c71fc0d8f78","Type":"ContainerStarted","Data":"b6ef0307297ea631334b2a900a9553c082a757346d5ef1d899492c6edd2e2d27"}
Sep 09 14:24:05.701673 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:05.701484    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc" event={"ID":"361edb2e-ba55-49a7-b093-9c71fc0d8f78","Type":"ContainerStarted","Data":"6dfc03f562085554ce438a7cca7708cea71ec2c77cf1a5a15ae6fd1e49b65c76"}
Sep 09 14:24:05.701673 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:05.701604    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"
Sep 09 14:24:05.718550 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:05.718494    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc" podStartSLOduration=1.718473209 podStartE2EDuration="1.718473209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:24:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:24:05.71725327 +0000 UTC m=+810.443793389" watchObservedRunningTime="2026-09-09 14:24:05.718473209 +0000 UTC m=+810.445013314"
Sep 09 14:24:10.091376 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:10.091334    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:10.192302 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:10.192237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:10.667590 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:10.667547    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"
Sep 09 14:24:11.240598 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:11.240552    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:11.350907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:11.350869    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:11.460644 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:11.460536    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:11.731607 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:11.731422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:11.792598 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:11.792535    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:11.827705 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:11.827652    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"]
Sep 09 14:24:11.832645 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:11.832611    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"
Sep 09 14:24:11.835186 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:11.835141    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-a2ffe2-dockercfg-jckc4\""
Sep 09 14:24:11.835353 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:11.835194    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-a2ffe2\""
Sep 09 14:24:11.846203 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:11.846126    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"]
Sep 09 14:24:11.982676 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:11.982565    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjs5l\" (UniqueName: \"kubernetes.io/projected/22234843-96e8-46d6-9c25-a0b8abbf8659-kube-api-access-pjs5l\") pod \"payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2\" (UID: \"22234843-96e8-46d6-9c25-a0b8abbf8659\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"
Sep 09 14:24:11.982868 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:11.982711    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22234843-96e8-46d6-9c25-a0b8abbf8659-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2\" (UID: \"22234843-96e8-46d6-9c25-a0b8abbf8659\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"
Sep 09 14:24:12.084194 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:12.084135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22234843-96e8-46d6-9c25-a0b8abbf8659-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2\" (UID: \"22234843-96e8-46d6-9c25-a0b8abbf8659\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"
Sep 09 14:24:12.084391 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:12.084253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjs5l\" (UniqueName: \"kubernetes.io/projected/22234843-96e8-46d6-9c25-a0b8abbf8659-kube-api-access-pjs5l\") pod \"payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2\" (UID: \"22234843-96e8-46d6-9c25-a0b8abbf8659\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"
Sep 09 14:24:12.085022 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:12.084997    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22234843-96e8-46d6-9c25-a0b8abbf8659-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2\" (UID: \"22234843-96e8-46d6-9c25-a0b8abbf8659\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"
Sep 09 14:24:12.092605 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:12.092565    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjs5l\" (UniqueName: \"kubernetes.io/projected/22234843-96e8-46d6-9c25-a0b8abbf8659-kube-api-access-pjs5l\") pod \"payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2\" (UID: \"22234843-96e8-46d6-9c25-a0b8abbf8659\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"
Sep 09 14:24:12.149373 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:12.149333    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"
Sep 09 14:24:12.444542 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:12.444064    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"]
Sep 09 14:24:12.446851 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:24:12.446812    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22234843_96e8_46d6_9c25_a0b8abbf8659.slice/crio-fc63b6ec2e8a27999df390e5c1d53981f006a5f8f3a666db38aeeb14ed21f11f WatchSource:0}: Error finding container fc63b6ec2e8a27999df390e5c1d53981f006a5f8f3a666db38aeeb14ed21f11f: Status 404 returned error can't find the container with id fc63b6ec2e8a27999df390e5c1d53981f006a5f8f3a666db38aeeb14ed21f11f
Sep 09 14:24:12.753046 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:12.752933    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2" event={"ID":"22234843-96e8-46d6-9c25-a0b8abbf8659","Type":"ContainerStarted","Data":"7dbd40892e92c6d7ee2f2b6889c0dc44f6b2d8905ecef985e86f373cec65135b"}
Sep 09 14:24:12.753582 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:12.753537    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2" event={"ID":"22234843-96e8-46d6-9c25-a0b8abbf8659","Type":"ContainerStarted","Data":"fc63b6ec2e8a27999df390e5c1d53981f006a5f8f3a666db38aeeb14ed21f11f"}
Sep 09 14:24:12.761268 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:12.755226    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"
Sep 09 14:24:12.772409 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:12.772341    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2" podStartSLOduration=1.772321654 podStartE2EDuration="1.772321654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:24:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:24:12.771790346 +0000 UTC m=+817.498330460" watchObservedRunningTime="2026-09-09 14:24:12.772321654 +0000 UTC m=+817.498861755"
Sep 09 14:24:12.911075 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:12.911016    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:13.058244 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:13.058204    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:13.152769 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:13.152728    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:13.252366 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:13.252326    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:15.778630 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:15.778575    2562 generic.go:356] "Generic (PLEG): container finished" podID="59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" containerID="3698419f9e5ec088251b187687617fce1d424f2c0354dfbb15681460798c9031" exitCode=0
Sep 09 14:24:15.779081 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:15.778637    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d" event={"ID":"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e","Type":"ContainerDied","Data":"3698419f9e5ec088251b187687617fce1d424f2c0354dfbb15681460798c9031"}
Sep 09 14:24:15.779292 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:15.779271    2562 scope.go:117] "RemoveContainer" containerID="3698419f9e5ec088251b187687617fce1d424f2c0354dfbb15681460798c9031"
Sep 09 14:24:15.780536 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:15.780508    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:24:15.780594 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:15.780581    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:24:15.780631 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:15.780622    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:24:15.966122 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:15.966083    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:16.461595 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:16.461531    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:16.548337 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:16.548279    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:16.685114 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:16.685080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:16.709765 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:16.709732    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"
Sep 09 14:24:16.788545 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:16.788456    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d" event={"ID":"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e","Type":"ContainerStarted","Data":"f25556d688f38d3c03ebdd1f30a4edc7c1c9836bc03eda85614f7ff12bf255d5"}
Sep 09 14:24:17.623989 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:17.623938    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:24:17.624263 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:17.624059    2562 patch_prober.go:28] interesting pod/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 09 14:24:17.624263 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:17.624119    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d" podUID="59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 09 14:24:17.686722 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:17.686668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:18.088028 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:18.087964    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:18.623840 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:18.623795    2562 patch_prober.go:28] interesting pod/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 09 14:24:18.624032 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:18.623884    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d" podUID="59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 09 14:24:19.623784 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:19.623736    2562 patch_prober.go:28] interesting pod/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 09 14:24:19.624453 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:19.624409    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d" podUID="59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 09 14:24:20.597826 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:20.597781    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:20.624030 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:20.623992    2562 patch_prober.go:28] interesting pod/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 09 14:24:20.624464 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:20.624058    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d" podUID="59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 09 14:24:20.960523 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:20.960416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:21.219695 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.219525    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"]
Sep 09 14:24:21.225515 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.225484    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.227896 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.227865    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-d85f87-openshift-default-dockercfg-hswcj\""
Sep 09 14:24:21.275071 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.275022    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:21.276845 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.276770    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"]
Sep 09 14:24:21.306968 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.306930    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3402af9b-e789-4904-8ace-207f5e5a0bea-istiod-ca-cert\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.306968 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.306980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t76lx\" (UniqueName: \"kubernetes.io/projected/3402af9b-e789-4904-8ace-207f5e5a0bea-kube-api-access-t76lx\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.307299 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.307041    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-credential-socket\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.307299 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.307064    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-podinfo\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.307299 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.307095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-envoy\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.307299 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.307120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-token\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.307299 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.307149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-data\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.307299 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.307201    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-workload-certs\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.307299 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.307263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-workload-socket\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.408790 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.408751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3402af9b-e789-4904-8ace-207f5e5a0bea-istiod-ca-cert\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.409054 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.409035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t76lx\" (UniqueName: \"kubernetes.io/projected/3402af9b-e789-4904-8ace-207f5e5a0bea-kube-api-access-t76lx\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.409311 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.409283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-credential-socket\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.409639 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.409611    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3402af9b-e789-4904-8ace-207f5e5a0bea-istiod-ca-cert\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.409786 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.409744    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-credential-socket\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.409875 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.409853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-podinfo\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.409938 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.409916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-envoy\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.409992 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.409976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-token\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.410123 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.410104    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-data\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.410248 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.410232    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-workload-certs\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.410324 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.410310    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-workload-socket\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.410534 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.410493    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-data\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.410619 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.410567    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-workload-certs\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.410721 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.410696    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-workload-socket\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.412723 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.412692    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-podinfo\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.412839 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.412755    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-envoy\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.420691 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.420654    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-token\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.420977 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.420950    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t76lx\" (UniqueName: \"kubernetes.io/projected/3402af9b-e789-4904-8ace-207f5e5a0bea-kube-api-access-t76lx\") pod \"e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") " pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.509359 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.509258    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:21.558652 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.558598    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:21.623954 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.623911    2562 patch_prober.go:28] interesting pod/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 09 14:24:21.624217 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.624001    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d" podUID="59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 09 14:24:21.882874 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.882740    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"]
Sep 09 14:24:21.885562 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:24:21.885517    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3402af9b_e789_4904_8ace_207f5e5a0bea.slice/crio-5a99662e143a4e0039763f72f1d0c8903f30d749e635ed9acccb9ca8c0a45b2f WatchSource:0}: Error finding container 5a99662e143a4e0039763f72f1d0c8903f30d749e635ed9acccb9ca8c0a45b2f: Status 404 returned error can't find the container with id 5a99662e143a4e0039763f72f1d0c8903f30d749e635ed9acccb9ca8c0a45b2f
Sep 09 14:24:21.888231 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.888164    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:24:21.888361 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.888289    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:24:21.888361 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:21.888345    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:24:22.624341 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:22.624290    2562 patch_prober.go:28] interesting pod/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 09 14:24:22.624851 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:22.624375    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d" podUID="59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 09 14:24:22.697901 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:22.697859    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:22.832816 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:22.832775    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx" event={"ID":"3402af9b-e789-4904-8ace-207f5e5a0bea","Type":"ContainerStarted","Data":"4557e01d82c1ed4bd2e9c3a0c780faadd7b6835836c86184ca381e002b50bdac"}
Sep 09 14:24:22.833160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:22.832836    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx" event={"ID":"3402af9b-e789-4904-8ace-207f5e5a0bea","Type":"ContainerStarted","Data":"5a99662e143a4e0039763f72f1d0c8903f30d749e635ed9acccb9ca8c0a45b2f"}
Sep 09 14:24:22.854145 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:22.854074    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx" podStartSLOduration=1.854053301 podStartE2EDuration="1.854053301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:24:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:24:22.851495759 +0000 UTC m=+827.578035861" watchObservedRunningTime="2026-09-09 14:24:22.854053301 +0000 UTC m=+827.580593402"
Sep 09 14:24:22.971851 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:22.971727    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:23.068994 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:23.068945    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:23.170325 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:23.170286    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:23.347946 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:23.347904    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:23.559831 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:23.559786    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:23.566264 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:23.566228    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:23.628435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:23.628342    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:24:23.628928 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:23.628786    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:24:23.629719 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:23.629695    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:24:23.839244 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:23.839193    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:23.840354 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:23.840314    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:24.771984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:24.771951    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"
Sep 09 14:24:24.818257 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:24.818204    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:24.850272 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:24.850222    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h" event={"ID":"a4d82052-66ce-4caf-8eba-ae9cc402ff64","Type":"ContainerDied","Data":"97bf6f5ad37c47579f64ea389849259afac7d4a6eb8b356756ff9c4e87534c0f"}
Sep 09 14:24:24.850272 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:24.850259    2562 generic.go:356] "Generic (PLEG): container finished" podID="a4d82052-66ce-4caf-8eba-ae9cc402ff64" containerID="97bf6f5ad37c47579f64ea389849259afac7d4a6eb8b356756ff9c4e87534c0f" exitCode=0
Sep 09 14:24:24.850784 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:24.850760    2562 scope.go:117] "RemoveContainer" containerID="97bf6f5ad37c47579f64ea389849259afac7d4a6eb8b356756ff9c4e87534c0f"
Sep 09 14:24:24.852058 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:24.852022    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:24:24.852209 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:24.852123    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:24:24.852285 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:24.852210    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:24:24.948853 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:24.948812    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:25.289205 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:25.289149    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:25.863291 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:25.863236    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h" event={"ID":"a4d82052-66ce-4caf-8eba-ae9cc402ff64","Type":"ContainerStarted","Data":"5815e22da446757bd5b023dc8172eba76ae5413a5e6fd7da95f310d99ac0e8f5"}
Sep 09 14:24:26.579391 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:26.579351    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:26.715056 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:26.715012    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:26.715500 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:26.715470    2562 patch_prober.go:28] interesting pod/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 09 14:24:26.715624 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:26.715547    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h" podUID="a4d82052-66ce-4caf-8eba-ae9cc402ff64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 09 14:24:26.755551 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:26.755495    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:26.863455 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:26.863322    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:27.092789 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.092752    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:27.194020 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.193921    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:27.217293 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.217248    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"]
Sep 09 14:24:27.219951 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.219924    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"
Sep 09 14:24:27.222436 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.222404    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-d85f87\""
Sep 09 14:24:27.222614 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.222497    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-d85f87-dockercfg-jxvqz\""
Sep 09 14:24:27.236852 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.236813    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"]
Sep 09 14:24:27.286820 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.286771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b15530e-95b2-4a59-b04c-bab67c0c99c3-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9\" (UID: \"0b15530e-95b2-4a59-b04c-bab67c0c99c3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"
Sep 09 14:24:27.287069 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.286826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t9bw\" (UniqueName: \"kubernetes.io/projected/0b15530e-95b2-4a59-b04c-bab67c0c99c3-kube-api-access-4t9bw\") pod \"payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9\" (UID: \"0b15530e-95b2-4a59-b04c-bab67c0c99c3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"
Sep 09 14:24:27.388189 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.388136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b15530e-95b2-4a59-b04c-bab67c0c99c3-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9\" (UID: \"0b15530e-95b2-4a59-b04c-bab67c0c99c3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"
Sep 09 14:24:27.388396 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.388230    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t9bw\" (UniqueName: \"kubernetes.io/projected/0b15530e-95b2-4a59-b04c-bab67c0c99c3-kube-api-access-4t9bw\") pod \"payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9\" (UID: \"0b15530e-95b2-4a59-b04c-bab67c0c99c3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"
Sep 09 14:24:27.389057 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.389025    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b15530e-95b2-4a59-b04c-bab67c0c99c3-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9\" (UID: \"0b15530e-95b2-4a59-b04c-bab67c0c99c3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"
Sep 09 14:24:27.399616 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.399575    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t9bw\" (UniqueName: \"kubernetes.io/projected/0b15530e-95b2-4a59-b04c-bab67c0c99c3-kube-api-access-4t9bw\") pod \"payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9\" (UID: \"0b15530e-95b2-4a59-b04c-bab67c0c99c3\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"
Sep 09 14:24:27.531901 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.531787    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"
Sep 09 14:24:27.573131 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.573087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:27.715311 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.715272    2562 patch_prober.go:28] interesting pod/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 09 14:24:27.715534 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.715343    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h" podUID="a4d82052-66ce-4caf-8eba-ae9cc402ff64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 09 14:24:27.859058 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.858360    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"]
Sep 09 14:24:27.887474 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:27.887437    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9" event={"ID":"0b15530e-95b2-4a59-b04c-bab67c0c99c3","Type":"ContainerStarted","Data":"746a3598e98e97f0976b4b42696d3731abcb629248d8344d43e28779af7691b7"}
Sep 09 14:24:28.603070 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:28.603028    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr"]
Sep 09 14:24:28.605810 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:28.605783    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr"
Sep 09 14:24:28.608346 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:28.608316    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:24:28.608495 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:28.608381    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:24:28.614672 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:28.614589    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr"]
Sep 09 14:24:28.634240 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:28.634198    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:28.701113 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:28.701060    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/434d4df6-7caa-4e98-ad4d-c0faf0be5bd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr\" (UID: \"434d4df6-7caa-4e98-ad4d-c0faf0be5bd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr"
Sep 09 14:24:28.715356 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:28.715310    2562 patch_prober.go:28] interesting pod/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 09 14:24:28.715549 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:28.715388    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h" podUID="a4d82052-66ce-4caf-8eba-ae9cc402ff64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 09 14:24:28.802416 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:28.802375    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/434d4df6-7caa-4e98-ad4d-c0faf0be5bd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr\" (UID: \"434d4df6-7caa-4e98-ad4d-c0faf0be5bd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr"
Sep 09 14:24:28.803202 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:28.803150    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/434d4df6-7caa-4e98-ad4d-c0faf0be5bd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr\" (UID: \"434d4df6-7caa-4e98-ad4d-c0faf0be5bd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr"
Sep 09 14:24:28.901344 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:28.901244    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9" event={"ID":"0b15530e-95b2-4a59-b04c-bab67c0c99c3","Type":"ContainerStarted","Data":"af0209ba3451ce225eb818cf1fb96ae9287eae79b8f2109273e582baf072ac25"}
Sep 09 14:24:28.901807 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:28.901520    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"
Sep 09 14:24:28.921096 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:28.921053    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr"
Sep 09 14:24:29.235575 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:29.235518    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9" podStartSLOduration=2.235494534 podStartE2EDuration="2.235494534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:24:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:24:28.918983931 +0000 UTC m=+833.645524034" watchObservedRunningTime="2026-09-09 14:24:29.235494534 +0000 UTC m=+833.962034637"
Sep 09 14:24:29.236318 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:29.236288    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr"]
Sep 09 14:24:29.517940 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:29.517846    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:29.618389 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:29.618341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:29.715265 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:29.715216    2562 patch_prober.go:28] interesting pod/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 09 14:24:29.715478 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:29.715295    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h" podUID="a4d82052-66ce-4caf-8eba-ae9cc402ff64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 09 14:24:29.908548 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:29.908508    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr" event={"ID":"434d4df6-7caa-4e98-ad4d-c0faf0be5bd6","Type":"ContainerStarted","Data":"fcb9f644983b9e20780d1cbef905f2901774036f5199857c6e9961eccd48b505"}
Sep 09 14:24:30.715131 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:30.715083    2562 patch_prober.go:28] interesting pod/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 09 14:24:30.715341 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:30.715149    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h" podUID="a4d82052-66ce-4caf-8eba-ae9cc402ff64" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 09 14:24:31.719522 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:31.719478    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:31.720068 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:31.720009    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:31.720992 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:31.720966    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:32.357932 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:32.357884    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:33.937892 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:33.937789    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr" event={"ID":"434d4df6-7caa-4e98-ad4d-c0faf0be5bd6","Type":"ContainerStarted","Data":"537db90f5a4982691fb7a545947b0a4026e47996133dd78dcaeb1f307f03c1c3"}
Sep 09 14:24:33.955111 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:33.955047    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr" podStartSLOduration=1.884361475 podStartE2EDuration="5.955022465s" totalImagesPullingTime="4.07066099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:24:33.953142182 +0000 UTC m=+838.679682287" watchObservedRunningTime="2026-09-09 14:24:33.955022465 +0000 UTC m=+838.681562622"
Sep 09 14:24:34.946135 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:34.946092    2562 generic.go:356] "Generic (PLEG): container finished" podID="434d4df6-7caa-4e98-ad4d-c0faf0be5bd6" containerID="537db90f5a4982691fb7a545947b0a4026e47996133dd78dcaeb1f307f03c1c3" exitCode=0
Sep 09 14:24:34.946585 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:34.946192    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr" event={"ID":"434d4df6-7caa-4e98-ad4d-c0faf0be5bd6","Type":"ContainerDied","Data":"537db90f5a4982691fb7a545947b0a4026e47996133dd78dcaeb1f307f03c1c3"}
Sep 09 14:24:35.135220 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:35.135155    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:36.105440 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:36.105406    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr"
Sep 09 14:24:36.181889 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:36.181835    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/434d4df6-7caa-4e98-ad4d-c0faf0be5bd6-maas-api-service-ca\") pod \"434d4df6-7caa-4e98-ad4d-c0faf0be5bd6\" (UID: \"434d4df6-7caa-4e98-ad4d-c0faf0be5bd6\") "
Sep 09 14:24:36.182369 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:36.182339    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/434d4df6-7caa-4e98-ad4d-c0faf0be5bd6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "434d4df6-7caa-4e98-ad4d-c0faf0be5bd6" (UID: "434d4df6-7caa-4e98-ad4d-c0faf0be5bd6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:24:36.283573 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:36.283449    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/434d4df6-7caa-4e98-ad4d-c0faf0be5bd6-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:24:36.961199 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:36.961147    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr"
Sep 09 14:24:36.961419 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:36.961211    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr" event={"ID":"434d4df6-7caa-4e98-ad4d-c0faf0be5bd6","Type":"ContainerDied","Data":"fcb9f644983b9e20780d1cbef905f2901774036f5199857c6e9961eccd48b505"}
Sep 09 14:24:36.961419 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:36.961284    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fcb9f644983b9e20780d1cbef905f2901774036f5199857c6e9961eccd48b505"
Sep 09 14:24:39.910774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:39.910739    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"
Sep 09 14:24:44.528673 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:44.528624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:45.216512 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.216222    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"]
Sep 09 14:24:45.219125 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.218349    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc" podUID="361edb2e-ba55-49a7-b093-9c71fc0d8f78" containerName="payload-processing" containerID="cri-o://b6ef0307297ea631334b2a900a9553c082a757346d5ef1d899492c6edd2e2d27" gracePeriod=30
Sep 09 14:24:45.249900 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.249862    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:45.349999 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.349955    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:45.370782 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.370742    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr"]
Sep 09 14:24:45.374221 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.374162    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac63e256-dv9jr"]
Sep 09 14:24:45.414407 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.411224    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:45.537447 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.537412    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"
Sep 09 14:24:45.572735 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.572686    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"]
Sep 09 14:24:45.572974 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.572946    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h" podUID="a4d82052-66ce-4caf-8eba-ae9cc402ff64" containerName="istio-proxy" containerID="cri-o://5815e22da446757bd5b023dc8172eba76ae5413a5e6fd7da95f310d99ac0e8f5" gracePeriod=30
Sep 09 14:24:45.582463 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.582417    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:45.669906 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.669867    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:45.687878 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.687840    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-655pd\" (UniqueName: \"kubernetes.io/projected/361edb2e-ba55-49a7-b093-9c71fc0d8f78-kube-api-access-655pd\") pod \"361edb2e-ba55-49a7-b093-9c71fc0d8f78\" (UID: \"361edb2e-ba55-49a7-b093-9c71fc0d8f78\") "
Sep 09 14:24:45.688050 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.687908    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/361edb2e-ba55-49a7-b093-9c71fc0d8f78-plugins-config-volume\") pod \"361edb2e-ba55-49a7-b093-9c71fc0d8f78\" (UID: \"361edb2e-ba55-49a7-b093-9c71fc0d8f78\") "
Sep 09 14:24:45.688380 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.688351    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/361edb2e-ba55-49a7-b093-9c71fc0d8f78-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "361edb2e-ba55-49a7-b093-9c71fc0d8f78" (UID: "361edb2e-ba55-49a7-b093-9c71fc0d8f78"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:24:45.690461 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.690432    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/361edb2e-ba55-49a7-b093-9c71fc0d8f78-kube-api-access-655pd" (OuterVolumeSpecName: "kube-api-access-655pd") pod "361edb2e-ba55-49a7-b093-9c71fc0d8f78" (UID: "361edb2e-ba55-49a7-b093-9c71fc0d8f78"). InnerVolumeSpecName "kube-api-access-655pd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:24:45.789098 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.788992    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-655pd\" (UniqueName: \"kubernetes.io/projected/361edb2e-ba55-49a7-b093-9c71fc0d8f78-kube-api-access-655pd\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:24:45.789098 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.789035    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/361edb2e-ba55-49a7-b093-9c71fc0d8f78-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:24:45.801003 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:45.800961    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="434d4df6-7caa-4e98-ad4d-c0faf0be5bd6" path="/var/lib/kubelet/pods/434d4df6-7caa-4e98-ad4d-c0faf0be5bd6/volumes"
Sep 09 14:24:46.023020 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:46.022973    2562 generic.go:356] "Generic (PLEG): container finished" podID="361edb2e-ba55-49a7-b093-9c71fc0d8f78" containerID="b6ef0307297ea631334b2a900a9553c082a757346d5ef1d899492c6edd2e2d27" exitCode=0
Sep 09 14:24:46.023267 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:46.023047    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"
Sep 09 14:24:46.023267 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:46.023072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc" event={"ID":"361edb2e-ba55-49a7-b093-9c71fc0d8f78","Type":"ContainerDied","Data":"b6ef0307297ea631334b2a900a9553c082a757346d5ef1d899492c6edd2e2d27"}
Sep 09 14:24:46.023267 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:46.023148    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc" event={"ID":"361edb2e-ba55-49a7-b093-9c71fc0d8f78","Type":"ContainerDied","Data":"6dfc03f562085554ce438a7cca7708cea71ec2c77cf1a5a15ae6fd1e49b65c76"}
Sep 09 14:24:46.023267 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:46.023200    2562 scope.go:117] "RemoveContainer" containerID="b6ef0307297ea631334b2a900a9553c082a757346d5ef1d899492c6edd2e2d27"
Sep 09 14:24:46.033458 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:46.033424    2562 scope.go:117] "RemoveContainer" containerID="b6ef0307297ea631334b2a900a9553c082a757346d5ef1d899492c6edd2e2d27"
Sep 09 14:24:46.033929 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:24:46.033904    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6ef0307297ea631334b2a900a9553c082a757346d5ef1d899492c6edd2e2d27\": container with ID starting with b6ef0307297ea631334b2a900a9553c082a757346d5ef1d899492c6edd2e2d27 not found: ID does not exist" containerID="b6ef0307297ea631334b2a900a9553c082a757346d5ef1d899492c6edd2e2d27"
Sep 09 14:24:46.034004 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:46.033941    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ef0307297ea631334b2a900a9553c082a757346d5ef1d899492c6edd2e2d27"} err="failed to get container status \"b6ef0307297ea631334b2a900a9553c082a757346d5ef1d899492c6edd2e2d27\": rpc error: code = NotFound desc = could not find container \"b6ef0307297ea631334b2a900a9553c082a757346d5ef1d899492c6edd2e2d27\": container with ID starting with b6ef0307297ea631334b2a900a9553c082a757346d5ef1d899492c6edd2e2d27 not found: ID does not exist"
Sep 09 14:24:46.072550 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:46.072487    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:46.075919 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:46.075861    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"]
Sep 09 14:24:46.081741 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:46.081703    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ac63e256-75768864fc-92vcc"]
Sep 09 14:24:46.165463 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:46.165420    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:46.265684 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:46.265643    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:46.556936 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:46.556897    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:46.723246 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:46.723193    2562 patch_prober.go:28] interesting pod/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 14:24:46.723432 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:46.723285    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h" podUID="a4d82052-66ce-4caf-8eba-ae9cc402ff64" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 14:24:46.756140 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:46.756092    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:47.649257 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:47.649126    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:47.801691 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:47.801651    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="361edb2e-ba55-49a7-b093-9c71fc0d8f78" path="/var/lib/kubelet/pods/361edb2e-ba55-49a7-b093-9c71fc0d8f78/volumes"
Sep 09 14:24:48.037858 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:48.037755    2562 generic.go:356] "Generic (PLEG): container finished" podID="3402af9b-e789-4904-8ace-207f5e5a0bea" containerID="4557e01d82c1ed4bd2e9c3a0c780faadd7b6835836c86184ca381e002b50bdac" exitCode=0
Sep 09 14:24:48.037858 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:48.037827    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx" event={"ID":"3402af9b-e789-4904-8ace-207f5e5a0bea","Type":"ContainerDied","Data":"4557e01d82c1ed4bd2e9c3a0c780faadd7b6835836c86184ca381e002b50bdac"}
Sep 09 14:24:48.038338 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:48.038321    2562 scope.go:117] "RemoveContainer" containerID="4557e01d82c1ed4bd2e9c3a0c780faadd7b6835836c86184ca381e002b50bdac"
Sep 09 14:24:48.039676 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:48.039640    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:24:48.039811 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:48.039740    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:24:48.039811 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:48.039788    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:24:48.788088 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:48.788043    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:48.843043 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:48.842989    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:49.050904 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:49.050776    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx" event={"ID":"3402af9b-e789-4904-8ace-207f5e5a0bea","Type":"ContainerStarted","Data":"141393bfc97aa1e930866ba008a681c813a02694f92fd910b31134ba9ab60896"}
Sep 09 14:24:49.566194 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:49.562076    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:49.566412 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:49.566216    2562 patch_prober.go:28] interesting pod/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 09 14:24:49.566412 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:49.566323    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx" podUID="3402af9b-e789-4904-8ace-207f5e5a0bea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 09 14:24:50.220524 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.220477    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"]
Sep 09 14:24:50.220985 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.220969    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="361edb2e-ba55-49a7-b093-9c71fc0d8f78" containerName="payload-processing"
Sep 09 14:24:50.221032 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.220987    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="361edb2e-ba55-49a7-b093-9c71fc0d8f78" containerName="payload-processing"
Sep 09 14:24:50.221032 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.221017    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="434d4df6-7caa-4e98-ad4d-c0faf0be5bd6" containerName="revoke-keys"
Sep 09 14:24:50.221032 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.221023    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="434d4df6-7caa-4e98-ad4d-c0faf0be5bd6" containerName="revoke-keys"
Sep 09 14:24:50.221126 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.221083    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="361edb2e-ba55-49a7-b093-9c71fc0d8f78" containerName="payload-processing"
Sep 09 14:24:50.221126 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.221094    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="434d4df6-7caa-4e98-ad4d-c0faf0be5bd6" containerName="revoke-keys"
Sep 09 14:24:50.229040 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.228996    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"]
Sep 09 14:24:50.229277 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.229129    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"
Sep 09 14:24:50.233527 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.233498    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"
Sep 09 14:24:50.233771 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.233746    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-3e00fb33\""
Sep 09 14:24:50.235027 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.234982    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-3e00fb33-dockercfg-tx8nx\""
Sep 09 14:24:50.236217 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.236153    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"]
Sep 09 14:24:50.274462 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.274423    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"]
Sep 09 14:24:50.352837 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.352780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/210a52db-deb9-4f37-b7a6-1214a0635cea-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv\" (UID: \"210a52db-deb9-4f37-b7a6-1214a0635cea\") " pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"
Sep 09 14:24:50.353247 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.353222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e8eb538-916b-4300-8694-34fab55d210e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg\" (UID: \"0e8eb538-916b-4300-8694-34fab55d210e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"
Sep 09 14:24:50.353388 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.353374    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scjv7\" (UniqueName: \"kubernetes.io/projected/0e8eb538-916b-4300-8694-34fab55d210e-kube-api-access-scjv7\") pod \"payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg\" (UID: \"0e8eb538-916b-4300-8694-34fab55d210e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"
Sep 09 14:24:50.353512 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.353499    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcgkv\" (UniqueName: \"kubernetes.io/projected/210a52db-deb9-4f37-b7a6-1214a0635cea-kube-api-access-bcgkv\") pod \"payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv\" (UID: \"210a52db-deb9-4f37-b7a6-1214a0635cea\") " pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"
Sep 09 14:24:50.454622 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.454557    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e8eb538-916b-4300-8694-34fab55d210e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg\" (UID: \"0e8eb538-916b-4300-8694-34fab55d210e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"
Sep 09 14:24:50.454864 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.454633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scjv7\" (UniqueName: \"kubernetes.io/projected/0e8eb538-916b-4300-8694-34fab55d210e-kube-api-access-scjv7\") pod \"payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg\" (UID: \"0e8eb538-916b-4300-8694-34fab55d210e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"
Sep 09 14:24:50.454864 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.454695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcgkv\" (UniqueName: \"kubernetes.io/projected/210a52db-deb9-4f37-b7a6-1214a0635cea-kube-api-access-bcgkv\") pod \"payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv\" (UID: \"210a52db-deb9-4f37-b7a6-1214a0635cea\") " pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"
Sep 09 14:24:50.454864 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.454788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/210a52db-deb9-4f37-b7a6-1214a0635cea-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv\" (UID: \"210a52db-deb9-4f37-b7a6-1214a0635cea\") " pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"
Sep 09 14:24:50.455959 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.455913    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/210a52db-deb9-4f37-b7a6-1214a0635cea-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv\" (UID: \"210a52db-deb9-4f37-b7a6-1214a0635cea\") " pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"
Sep 09 14:24:50.456829 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.456797    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e8eb538-916b-4300-8694-34fab55d210e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg\" (UID: \"0e8eb538-916b-4300-8694-34fab55d210e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"
Sep 09 14:24:50.465357 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.465320    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scjv7\" (UniqueName: \"kubernetes.io/projected/0e8eb538-916b-4300-8694-34fab55d210e-kube-api-access-scjv7\") pod \"payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg\" (UID: \"0e8eb538-916b-4300-8694-34fab55d210e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"
Sep 09 14:24:50.466226 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.466199    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcgkv\" (UniqueName: \"kubernetes.io/projected/210a52db-deb9-4f37-b7a6-1214a0635cea-kube-api-access-bcgkv\") pod \"payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv\" (UID: \"210a52db-deb9-4f37-b7a6-1214a0635cea\") " pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"
Sep 09 14:24:50.560042 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.559997    2562 patch_prober.go:28] interesting pod/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 09 14:24:50.560442 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.560405    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx" podUID="3402af9b-e789-4904-8ace-207f5e5a0bea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 09 14:24:50.577611 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.577553    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"
Sep 09 14:24:50.588072 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.588040    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"
Sep 09 14:24:50.899620 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.899539    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"]
Sep 09 14:24:50.902280 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:24:50.902230    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8eb538_916b_4300_8694_34fab55d210e.slice/crio-138923e09cee69c4c32e7f6dc8de6c4e0bff2be1fcb33cb2ab0b58de74d21728 WatchSource:0}: Error finding container 138923e09cee69c4c32e7f6dc8de6c4e0bff2be1fcb33cb2ab0b58de74d21728: Status 404 returned error can't find the container with id 138923e09cee69c4c32e7f6dc8de6c4e0bff2be1fcb33cb2ab0b58de74d21728
Sep 09 14:24:50.920077 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.920032    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"]
Sep 09 14:24:50.923672 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:24:50.923632    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod210a52db_deb9_4f37_b7a6_1214a0635cea.slice/crio-d42783518fe3f701a6e68f40ddca5577b6478f02c9fadff6c5c0495ba25bda9c WatchSource:0}: Error finding container d42783518fe3f701a6e68f40ddca5577b6478f02c9fadff6c5c0495ba25bda9c: Status 404 returned error can't find the container with id d42783518fe3f701a6e68f40ddca5577b6478f02c9fadff6c5c0495ba25bda9c
Sep 09 14:24:50.933891 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.933854    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:50.956198 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:50.955378    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:51.026835 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.026786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:24:51.072766 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.072721    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-envoy\") pod \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") "
Sep 09 14:24:51.073030 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.072897    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm4j9\" (UniqueName: \"kubernetes.io/projected/a4d82052-66ce-4caf-8eba-ae9cc402ff64-kube-api-access-zm4j9\") pod \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") "
Sep 09 14:24:51.073030 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.072951    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istiod-ca-cert\") pod \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") "
Sep 09 14:24:51.073160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.073031    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-token\") pod \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") "
Sep 09 14:24:51.073160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.073063    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-workload-socket\") pod \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") "
Sep 09 14:24:51.073160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.073100    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-credential-socket\") pod \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") "
Sep 09 14:24:51.073160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.073139    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-data\") pod \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") "
Sep 09 14:24:51.073417 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.073223    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-workload-certs\") pod \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") "
Sep 09 14:24:51.073417 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.073277    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-podinfo\") pod \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\" (UID: \"a4d82052-66ce-4caf-8eba-ae9cc402ff64\") "
Sep 09 14:24:51.075095 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.074773    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a4d82052-66ce-4caf-8eba-ae9cc402ff64" (UID: "a4d82052-66ce-4caf-8eba-ae9cc402ff64"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:24:51.075095 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.074912    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a4d82052-66ce-4caf-8eba-ae9cc402ff64" (UID: "a4d82052-66ce-4caf-8eba-ae9cc402ff64"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:24:51.075095 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.074925    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-data" (OuterVolumeSpecName: "istio-data") pod "a4d82052-66ce-4caf-8eba-ae9cc402ff64" (UID: "a4d82052-66ce-4caf-8eba-ae9cc402ff64"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:24:51.075095 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.074961    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a4d82052-66ce-4caf-8eba-ae9cc402ff64" (UID: "a4d82052-66ce-4caf-8eba-ae9cc402ff64"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:24:51.075095 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.075098    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a4d82052-66ce-4caf-8eba-ae9cc402ff64" (UID: "a4d82052-66ce-4caf-8eba-ae9cc402ff64"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:24:51.076867 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.076734    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg" event={"ID":"0e8eb538-916b-4300-8694-34fab55d210e","Type":"ContainerStarted","Data":"a33c7c16e3f0db7947a96df56dc43dc6291bbf6138234a44e1f1bc564562226b"}
Sep 09 14:24:51.076867 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.076804    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg" event={"ID":"0e8eb538-916b-4300-8694-34fab55d210e","Type":"ContainerStarted","Data":"138923e09cee69c4c32e7f6dc8de6c4e0bff2be1fcb33cb2ab0b58de74d21728"}
Sep 09 14:24:51.077376 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.077121    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"
Sep 09 14:24:51.077376 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.077203    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a4d82052-66ce-4caf-8eba-ae9cc402ff64" (UID: "a4d82052-66ce-4caf-8eba-ae9cc402ff64"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:24:51.078312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.078264    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a4d82052-66ce-4caf-8eba-ae9cc402ff64" (UID: "a4d82052-66ce-4caf-8eba-ae9cc402ff64"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:24:51.078312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.078288    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-token" (OuterVolumeSpecName: "istio-token") pod "a4d82052-66ce-4caf-8eba-ae9cc402ff64" (UID: "a4d82052-66ce-4caf-8eba-ae9cc402ff64"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:24:51.078484 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.078321    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4d82052-66ce-4caf-8eba-ae9cc402ff64-kube-api-access-zm4j9" (OuterVolumeSpecName: "kube-api-access-zm4j9") pod "a4d82052-66ce-4caf-8eba-ae9cc402ff64" (UID: "a4d82052-66ce-4caf-8eba-ae9cc402ff64"). InnerVolumeSpecName "kube-api-access-zm4j9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:24:51.079876 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.079585    2562 generic.go:356] "Generic (PLEG): container finished" podID="a4d82052-66ce-4caf-8eba-ae9cc402ff64" containerID="5815e22da446757bd5b023dc8172eba76ae5413a5e6fd7da95f310d99ac0e8f5" exitCode=0
Sep 09 14:24:51.079876 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.079652    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"
Sep 09 14:24:51.079876 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.079671    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h" event={"ID":"a4d82052-66ce-4caf-8eba-ae9cc402ff64","Type":"ContainerDied","Data":"5815e22da446757bd5b023dc8172eba76ae5413a5e6fd7da95f310d99ac0e8f5"}
Sep 09 14:24:51.079876 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.079750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h" event={"ID":"a4d82052-66ce-4caf-8eba-ae9cc402ff64","Type":"ContainerDied","Data":"42ba23a67397eaa33d9b973960703925cceb4c3e849bbe10e00dc7f1f86fef76"}
Sep 09 14:24:51.079876 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.079785    2562 scope.go:117] "RemoveContainer" containerID="5815e22da446757bd5b023dc8172eba76ae5413a5e6fd7da95f310d99ac0e8f5"
Sep 09 14:24:51.083870 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.083722    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv" event={"ID":"210a52db-deb9-4f37-b7a6-1214a0635cea","Type":"ContainerStarted","Data":"b8f3985b42212c95ad76a497a6fdbf42355c0746941fa26d735e0467f1abdcf0"}
Sep 09 14:24:51.083870 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.083814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv" event={"ID":"210a52db-deb9-4f37-b7a6-1214a0635cea","Type":"ContainerStarted","Data":"d42783518fe3f701a6e68f40ddca5577b6478f02c9fadff6c5c0495ba25bda9c"}
Sep 09 14:24:51.084068 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.083883    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"
Sep 09 14:24:51.092877 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.092855    2562 scope.go:117] "RemoveContainer" containerID="97bf6f5ad37c47579f64ea389849259afac7d4a6eb8b356756ff9c4e87534c0f"
Sep 09 14:24:51.098026 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.097970    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg" podStartSLOduration=1.09794957 podStartE2EDuration="1.09794957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:24:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:24:51.0943104 +0000 UTC m=+855.820850503" watchObservedRunningTime="2026-09-09 14:24:51.09794957 +0000 UTC m=+855.824489672"
Sep 09 14:24:51.105949 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.105836    2562 scope.go:117] "RemoveContainer" containerID="5815e22da446757bd5b023dc8172eba76ae5413a5e6fd7da95f310d99ac0e8f5"
Sep 09 14:24:51.106412 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:24:51.106383    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5815e22da446757bd5b023dc8172eba76ae5413a5e6fd7da95f310d99ac0e8f5\": container with ID starting with 5815e22da446757bd5b023dc8172eba76ae5413a5e6fd7da95f310d99ac0e8f5 not found: ID does not exist" containerID="5815e22da446757bd5b023dc8172eba76ae5413a5e6fd7da95f310d99ac0e8f5"
Sep 09 14:24:51.106518 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.106435    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5815e22da446757bd5b023dc8172eba76ae5413a5e6fd7da95f310d99ac0e8f5"} err="failed to get container status \"5815e22da446757bd5b023dc8172eba76ae5413a5e6fd7da95f310d99ac0e8f5\": rpc error: code = NotFound desc = could not find container \"5815e22da446757bd5b023dc8172eba76ae5413a5e6fd7da95f310d99ac0e8f5\": container with ID starting with 5815e22da446757bd5b023dc8172eba76ae5413a5e6fd7da95f310d99ac0e8f5 not found: ID does not exist"
Sep 09 14:24:51.106518 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.106462    2562 scope.go:117] "RemoveContainer" containerID="97bf6f5ad37c47579f64ea389849259afac7d4a6eb8b356756ff9c4e87534c0f"
Sep 09 14:24:51.106862 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:24:51.106832    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97bf6f5ad37c47579f64ea389849259afac7d4a6eb8b356756ff9c4e87534c0f\": container with ID starting with 97bf6f5ad37c47579f64ea389849259afac7d4a6eb8b356756ff9c4e87534c0f not found: ID does not exist" containerID="97bf6f5ad37c47579f64ea389849259afac7d4a6eb8b356756ff9c4e87534c0f"
Sep 09 14:24:51.106970 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.106870    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97bf6f5ad37c47579f64ea389849259afac7d4a6eb8b356756ff9c4e87534c0f"} err="failed to get container status \"97bf6f5ad37c47579f64ea389849259afac7d4a6eb8b356756ff9c4e87534c0f\": rpc error: code = NotFound desc = could not find container \"97bf6f5ad37c47579f64ea389849259afac7d4a6eb8b356756ff9c4e87534c0f\": container with ID starting with 97bf6f5ad37c47579f64ea389849259afac7d4a6eb8b356756ff9c4e87534c0f not found: ID does not exist"
Sep 09 14:24:51.114821 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.114759    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv" podStartSLOduration=1.114740465 podStartE2EDuration="1.114740465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:24:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:24:51.11323722 +0000 UTC m=+855.839777322" watchObservedRunningTime="2026-09-09 14:24:51.114740465 +0000 UTC m=+855.841280608"
Sep 09 14:24:51.131355 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.131310    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"]
Sep 09 14:24:51.135247 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.135208    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ac63e256-openshift-default-c46db4c78-hpn9h"]
Sep 09 14:24:51.174998 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.174876    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm4j9\" (UniqueName: \"kubernetes.io/projected/a4d82052-66ce-4caf-8eba-ae9cc402ff64-kube-api-access-zm4j9\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:24:51.174998 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.174929    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istiod-ca-cert\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:24:51.174998 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.174948    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-token\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:24:51.174998 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.174962    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-workload-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:24:51.174998 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.174976    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-credential-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:24:51.174998 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.174990    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-data\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:24:51.174998 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.175004    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-workload-certs\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:24:51.175563 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.175017    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-podinfo\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:24:51.175563 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.175035    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4d82052-66ce-4caf-8eba-ae9cc402ff64-istio-envoy\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:24:51.560552 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.560503    2562 patch_prober.go:28] interesting pod/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 09 14:24:51.561032 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.560581    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx" podUID="3402af9b-e789-4904-8ace-207f5e5a0bea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 09 14:24:51.802560 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:51.802458    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4d82052-66ce-4caf-8eba-ae9cc402ff64" path="/var/lib/kubelet/pods/a4d82052-66ce-4caf-8eba-ae9cc402ff64/volumes"
Sep 09 14:24:52.559705 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:52.559650    2562 patch_prober.go:28] interesting pod/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 09 14:24:52.559954 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:52.559736    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx" podUID="3402af9b-e789-4904-8ace-207f5e5a0bea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 09 14:24:53.560091 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:53.560026    2562 patch_prober.go:28] interesting pod/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 09 14:24:53.560776 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:53.560120    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx" podUID="3402af9b-e789-4904-8ace-207f5e5a0bea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 09 14:24:53.839446 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:53.839309    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:54.560298 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:54.560237    2562 patch_prober.go:28] interesting pod/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 09 14:24:54.560805 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:54.560331    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx" podUID="3402af9b-e789-4904-8ace-207f5e5a0bea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 09 14:24:55.564269 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:55.564230    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:24:55.565715 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:24:55.565690    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:25:02.095750 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:02.095714    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"
Sep 09 14:25:02.096289 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:02.095792    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"
Sep 09 14:25:13.801977 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:13.801941    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8"]
Sep 09 14:25:13.802405 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:13.802388    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4d82052-66ce-4caf-8eba-ae9cc402ff64" containerName="istio-proxy"
Sep 09 14:25:13.802405 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:13.802401    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4d82052-66ce-4caf-8eba-ae9cc402ff64" containerName="istio-proxy"
Sep 09 14:25:13.802503 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:13.802489    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4d82052-66ce-4caf-8eba-ae9cc402ff64" containerName="istio-proxy"
Sep 09 14:25:13.802542 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:13.802505    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4d82052-66ce-4caf-8eba-ae9cc402ff64" containerName="istio-proxy"
Sep 09 14:25:13.806084 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:13.806061    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8"
Sep 09 14:25:13.808639 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:13.808607    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:25:13.809237 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:13.808761    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:25:13.810372 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:13.810347    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8"]
Sep 09 14:25:13.899645 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:13.899604    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e33d803-6f9a-48fe-84eb-1ee50e49e021-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8\" (UID: \"0e33d803-6f9a-48fe-84eb-1ee50e49e021\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8"
Sep 09 14:25:14.001337 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:14.001299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e33d803-6f9a-48fe-84eb-1ee50e49e021-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8\" (UID: \"0e33d803-6f9a-48fe-84eb-1ee50e49e021\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8"
Sep 09 14:25:14.002082 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:14.002057    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e33d803-6f9a-48fe-84eb-1ee50e49e021-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8\" (UID: \"0e33d803-6f9a-48fe-84eb-1ee50e49e021\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8"
Sep 09 14:25:14.120532 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:14.120477    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8"
Sep 09 14:25:14.400987 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:14.400956    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8"]
Sep 09 14:25:14.403216 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:25:14.403156    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e33d803_6f9a_48fe_84eb_1ee50e49e021.slice/crio-b85bbf188c2df0ca83432e41fe2d029c3ba4afc024dedbd38f740ebf40e5d1e6 WatchSource:0}: Error finding container b85bbf188c2df0ca83432e41fe2d029c3ba4afc024dedbd38f740ebf40e5d1e6: Status 404 returned error can't find the container with id b85bbf188c2df0ca83432e41fe2d029c3ba4afc024dedbd38f740ebf40e5d1e6
Sep 09 14:25:15.243769 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:15.243733    2562 generic.go:356] "Generic (PLEG): container finished" podID="0e33d803-6f9a-48fe-84eb-1ee50e49e021" containerID="05e1d2403b233991576dcc68f7365745fa6d31a9394a7b0f38f7afd523c313c1" exitCode=0
Sep 09 14:25:15.244248 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:15.243816    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8" event={"ID":"0e33d803-6f9a-48fe-84eb-1ee50e49e021","Type":"ContainerDied","Data":"05e1d2403b233991576dcc68f7365745fa6d31a9394a7b0f38f7afd523c313c1"}
Sep 09 14:25:15.244248 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:15.243888    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8" event={"ID":"0e33d803-6f9a-48fe-84eb-1ee50e49e021","Type":"ContainerStarted","Data":"b85bbf188c2df0ca83432e41fe2d029c3ba4afc024dedbd38f740ebf40e5d1e6"}
Sep 09 14:25:16.410575 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:16.410541    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8"
Sep 09 14:25:16.529106 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:16.528995    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e33d803-6f9a-48fe-84eb-1ee50e49e021-maas-api-service-ca\") pod \"0e33d803-6f9a-48fe-84eb-1ee50e49e021\" (UID: \"0e33d803-6f9a-48fe-84eb-1ee50e49e021\") "
Sep 09 14:25:16.529494 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:16.529471    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e33d803-6f9a-48fe-84eb-1ee50e49e021-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0e33d803-6f9a-48fe-84eb-1ee50e49e021" (UID: "0e33d803-6f9a-48fe-84eb-1ee50e49e021"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:25:16.630397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:16.630349    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e33d803-6f9a-48fe-84eb-1ee50e49e021-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:25:17.258402 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:17.258371    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8"
Sep 09 14:25:17.258598 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:17.258369    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8" event={"ID":"0e33d803-6f9a-48fe-84eb-1ee50e49e021","Type":"ContainerDied","Data":"b85bbf188c2df0ca83432e41fe2d029c3ba4afc024dedbd38f740ebf40e5d1e6"}
Sep 09 14:25:17.258598 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:17.258505    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b85bbf188c2df0ca83432e41fe2d029c3ba4afc024dedbd38f740ebf40e5d1e6"
Sep 09 14:25:20.428760 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.428714    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:20.449854 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.449806    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"]
Sep 09 14:25:20.450124 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.450090    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv" podUID="210a52db-deb9-4f37-b7a6-1214a0635cea" containerName="payload-processing" containerID="cri-o://b8f3985b42212c95ad76a497a6fdbf42355c0746941fa26d735e0467f1abdcf0" gracePeriod=30
Sep 09 14:25:20.462422 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.462385    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"]
Sep 09 14:25:20.462675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.462623    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg" podUID="0e8eb538-916b-4300-8694-34fab55d210e" containerName="payload-pre-processing" containerID="cri-o://a33c7c16e3f0db7947a96df56dc43dc6291bbf6138234a44e1f1bc564562226b" gracePeriod=30
Sep 09 14:25:20.528074 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.528035    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:20.627068 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.627036    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8"]
Sep 09 14:25:20.628084 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.628050    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:20.630013 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.629449    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3e00fb33-446b8"]
Sep 09 14:25:20.696692 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.696647    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:20.740785 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.740753    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"
Sep 09 14:25:20.779590 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.779560    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"
Sep 09 14:25:20.811306 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.811164    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:20.874357 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.874312    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/210a52db-deb9-4f37-b7a6-1214a0635cea-plugins-config-volume\") pod \"210a52db-deb9-4f37-b7a6-1214a0635cea\" (UID: \"210a52db-deb9-4f37-b7a6-1214a0635cea\") "
Sep 09 14:25:20.874357 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.874361    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e8eb538-916b-4300-8694-34fab55d210e-plugins-config-volume\") pod \"0e8eb538-916b-4300-8694-34fab55d210e\" (UID: \"0e8eb538-916b-4300-8694-34fab55d210e\") "
Sep 09 14:25:20.874621 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.874430    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scjv7\" (UniqueName: \"kubernetes.io/projected/0e8eb538-916b-4300-8694-34fab55d210e-kube-api-access-scjv7\") pod \"0e8eb538-916b-4300-8694-34fab55d210e\" (UID: \"0e8eb538-916b-4300-8694-34fab55d210e\") "
Sep 09 14:25:20.874621 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.874460    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcgkv\" (UniqueName: \"kubernetes.io/projected/210a52db-deb9-4f37-b7a6-1214a0635cea-kube-api-access-bcgkv\") pod \"210a52db-deb9-4f37-b7a6-1214a0635cea\" (UID: \"210a52db-deb9-4f37-b7a6-1214a0635cea\") "
Sep 09 14:25:20.874801 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.874776    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/210a52db-deb9-4f37-b7a6-1214a0635cea-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "210a52db-deb9-4f37-b7a6-1214a0635cea" (UID: "210a52db-deb9-4f37-b7a6-1214a0635cea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:25:20.874951 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.874914    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e8eb538-916b-4300-8694-34fab55d210e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0e8eb538-916b-4300-8694-34fab55d210e" (UID: "0e8eb538-916b-4300-8694-34fab55d210e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:25:20.876626 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.876597    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e8eb538-916b-4300-8694-34fab55d210e-kube-api-access-scjv7" (OuterVolumeSpecName: "kube-api-access-scjv7") pod "0e8eb538-916b-4300-8694-34fab55d210e" (UID: "0e8eb538-916b-4300-8694-34fab55d210e"). InnerVolumeSpecName "kube-api-access-scjv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:25:20.876715 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.876676    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/210a52db-deb9-4f37-b7a6-1214a0635cea-kube-api-access-bcgkv" (OuterVolumeSpecName: "kube-api-access-bcgkv") pod "210a52db-deb9-4f37-b7a6-1214a0635cea" (UID: "210a52db-deb9-4f37-b7a6-1214a0635cea"). InnerVolumeSpecName "kube-api-access-bcgkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:25:20.976055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.975926    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/210a52db-deb9-4f37-b7a6-1214a0635cea-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:25:20.976055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.975975    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e8eb538-916b-4300-8694-34fab55d210e-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:25:20.976055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.975988    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scjv7\" (UniqueName: \"kubernetes.io/projected/0e8eb538-916b-4300-8694-34fab55d210e-kube-api-access-scjv7\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:25:20.976055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:20.976001    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcgkv\" (UniqueName: \"kubernetes.io/projected/210a52db-deb9-4f37-b7a6-1214a0635cea-kube-api-access-bcgkv\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:25:21.272772 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.272656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:21.283389 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.283347    2562 generic.go:356] "Generic (PLEG): container finished" podID="210a52db-deb9-4f37-b7a6-1214a0635cea" containerID="b8f3985b42212c95ad76a497a6fdbf42355c0746941fa26d735e0467f1abdcf0" exitCode=0
Sep 09 14:25:21.283560 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.283412    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"
Sep 09 14:25:21.283560 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.283439    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv" event={"ID":"210a52db-deb9-4f37-b7a6-1214a0635cea","Type":"ContainerDied","Data":"b8f3985b42212c95ad76a497a6fdbf42355c0746941fa26d735e0467f1abdcf0"}
Sep 09 14:25:21.283560 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.283499    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv" event={"ID":"210a52db-deb9-4f37-b7a6-1214a0635cea","Type":"ContainerDied","Data":"d42783518fe3f701a6e68f40ddca5577b6478f02c9fadff6c5c0495ba25bda9c"}
Sep 09 14:25:21.283560 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.283527    2562 scope.go:117] "RemoveContainer" containerID="b8f3985b42212c95ad76a497a6fdbf42355c0746941fa26d735e0467f1abdcf0"
Sep 09 14:25:21.284977 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.284949    2562 generic.go:356] "Generic (PLEG): container finished" podID="0e8eb538-916b-4300-8694-34fab55d210e" containerID="a33c7c16e3f0db7947a96df56dc43dc6291bbf6138234a44e1f1bc564562226b" exitCode=0
Sep 09 14:25:21.285113 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.285005    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"
Sep 09 14:25:21.285113 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.285087    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg" event={"ID":"0e8eb538-916b-4300-8694-34fab55d210e","Type":"ContainerDied","Data":"a33c7c16e3f0db7947a96df56dc43dc6291bbf6138234a44e1f1bc564562226b"}
Sep 09 14:25:21.285241 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.285139    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg" event={"ID":"0e8eb538-916b-4300-8694-34fab55d210e","Type":"ContainerDied","Data":"138923e09cee69c4c32e7f6dc8de6c4e0bff2be1fcb33cb2ab0b58de74d21728"}
Sep 09 14:25:21.296061 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.296015    2562 scope.go:117] "RemoveContainer" containerID="b8f3985b42212c95ad76a497a6fdbf42355c0746941fa26d735e0467f1abdcf0"
Sep 09 14:25:21.296515 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:25:21.296490    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8f3985b42212c95ad76a497a6fdbf42355c0746941fa26d735e0467f1abdcf0\": container with ID starting with b8f3985b42212c95ad76a497a6fdbf42355c0746941fa26d735e0467f1abdcf0 not found: ID does not exist" containerID="b8f3985b42212c95ad76a497a6fdbf42355c0746941fa26d735e0467f1abdcf0"
Sep 09 14:25:21.296639 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.296526    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8f3985b42212c95ad76a497a6fdbf42355c0746941fa26d735e0467f1abdcf0"} err="failed to get container status \"b8f3985b42212c95ad76a497a6fdbf42355c0746941fa26d735e0467f1abdcf0\": rpc error: code = NotFound desc = could not find container \"b8f3985b42212c95ad76a497a6fdbf42355c0746941fa26d735e0467f1abdcf0\": container with ID starting with b8f3985b42212c95ad76a497a6fdbf42355c0746941fa26d735e0467f1abdcf0 not found: ID does not exist"
Sep 09 14:25:21.296639 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.296544    2562 scope.go:117] "RemoveContainer" containerID="a33c7c16e3f0db7947a96df56dc43dc6291bbf6138234a44e1f1bc564562226b"
Sep 09 14:25:21.306393 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.306372    2562 scope.go:117] "RemoveContainer" containerID="a33c7c16e3f0db7947a96df56dc43dc6291bbf6138234a44e1f1bc564562226b"
Sep 09 14:25:21.306794 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:25:21.306770    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a33c7c16e3f0db7947a96df56dc43dc6291bbf6138234a44e1f1bc564562226b\": container with ID starting with a33c7c16e3f0db7947a96df56dc43dc6291bbf6138234a44e1f1bc564562226b not found: ID does not exist" containerID="a33c7c16e3f0db7947a96df56dc43dc6291bbf6138234a44e1f1bc564562226b"
Sep 09 14:25:21.306885 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.306808    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a33c7c16e3f0db7947a96df56dc43dc6291bbf6138234a44e1f1bc564562226b"} err="failed to get container status \"a33c7c16e3f0db7947a96df56dc43dc6291bbf6138234a44e1f1bc564562226b\": rpc error: code = NotFound desc = could not find container \"a33c7c16e3f0db7947a96df56dc43dc6291bbf6138234a44e1f1bc564562226b\": container with ID starting with a33c7c16e3f0db7947a96df56dc43dc6291bbf6138234a44e1f1bc564562226b not found: ID does not exist"
Sep 09 14:25:21.313063 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.313020    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"]
Sep 09 14:25:21.315950 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.315912    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3e00fb33-769b45c7c4-rvffg"]
Sep 09 14:25:21.333273 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.332577    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"]
Sep 09 14:25:21.338375 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.337303    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3e00fb33-6cdffbc5c4-zc7bv"]
Sep 09 14:25:21.555912 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.555866    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"]
Sep 09 14:25:21.556978 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.556807    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8eb538-916b-4300-8694-34fab55d210e" containerName="payload-pre-processing"
Sep 09 14:25:21.556978 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.556839    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8eb538-916b-4300-8694-34fab55d210e" containerName="payload-pre-processing"
Sep 09 14:25:21.556978 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.556874    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="210a52db-deb9-4f37-b7a6-1214a0635cea" containerName="payload-processing"
Sep 09 14:25:21.556978 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.556885    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="210a52db-deb9-4f37-b7a6-1214a0635cea" containerName="payload-processing"
Sep 09 14:25:21.556978 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.556906    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4d82052-66ce-4caf-8eba-ae9cc402ff64" containerName="istio-proxy"
Sep 09 14:25:21.556978 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.556915    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4d82052-66ce-4caf-8eba-ae9cc402ff64" containerName="istio-proxy"
Sep 09 14:25:21.556978 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.556929    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e33d803-6f9a-48fe-84eb-1ee50e49e021" containerName="revoke-keys"
Sep 09 14:25:21.556978 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.556938    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e33d803-6f9a-48fe-84eb-1ee50e49e021" containerName="revoke-keys"
Sep 09 14:25:21.557512 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.557111    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e8eb538-916b-4300-8694-34fab55d210e" containerName="payload-pre-processing"
Sep 09 14:25:21.557512 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.557129    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e33d803-6f9a-48fe-84eb-1ee50e49e021" containerName="revoke-keys"
Sep 09 14:25:21.557512 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.557139    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="210a52db-deb9-4f37-b7a6-1214a0635cea" containerName="payload-processing"
Sep 09 14:25:21.562215 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.562187    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.565510 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.565472    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-701ccc59-openshift-default-dockercfg-wlgm9\""
Sep 09 14:25:21.588919 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.588469    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"]
Sep 09 14:25:21.589855 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.589817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:21.684573 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.684533    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-workload-certs\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.684573 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.684586    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istiod-ca-cert\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.684856 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.684620    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-envoy\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.684856 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.684698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-data\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.684856 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.684752    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-token\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.684856 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.684787    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsvvd\" (UniqueName: \"kubernetes.io/projected/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-kube-api-access-gsvvd\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.684856 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.684824    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-podinfo\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.684856 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.684855    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-workload-socket\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.685268 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.684901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-credential-socket\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.787142 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.786553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-workload-certs\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.787142 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.786643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istiod-ca-cert\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.787142 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.786680    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-envoy\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.787142 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.786736    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-data\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.787142 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.786776    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-token\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.787142 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.786812    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsvvd\" (UniqueName: \"kubernetes.io/projected/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-kube-api-access-gsvvd\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.787142 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.786844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-podinfo\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.787142 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.786886    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-workload-socket\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.787142 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.786950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-credential-socket\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.787142 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.787067    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-workload-certs\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.787907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.787363    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-credential-socket\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.787907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.787665    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-workload-socket\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.787907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.787726    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-data\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.788078 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.788048    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istiod-ca-cert\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.790117 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.790082    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-podinfo\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.790117 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.790110    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-envoy\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.796663 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.796622    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-token\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.796846 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.796780    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsvvd\" (UniqueName: \"kubernetes.io/projected/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-kube-api-access-gsvvd\") pod \"e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") " pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:21.803005 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.802968    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e33d803-6f9a-48fe-84eb-1ee50e49e021" path="/var/lib/kubelet/pods/0e33d803-6f9a-48fe-84eb-1ee50e49e021/volumes"
Sep 09 14:25:21.803440 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.803420    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e8eb538-916b-4300-8694-34fab55d210e" path="/var/lib/kubelet/pods/0e8eb538-916b-4300-8694-34fab55d210e/volumes"
Sep 09 14:25:21.803934 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.803913    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="210a52db-deb9-4f37-b7a6-1214a0635cea" path="/var/lib/kubelet/pods/210a52db-deb9-4f37-b7a6-1214a0635cea/volumes"
Sep 09 14:25:21.889055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:21.888922    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:22.175440 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:22.175409    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"]
Sep 09 14:25:22.177541 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:25:22.177512    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a06b40_2127_4b41_b6ab_a51c29f7cdf9.slice/crio-ea18da5bf51bc49aadd84d1aff0aadc413d663fa1f2633d718a555e9dee397dc WatchSource:0}: Error finding container ea18da5bf51bc49aadd84d1aff0aadc413d663fa1f2633d718a555e9dee397dc: Status 404 returned error can't find the container with id ea18da5bf51bc49aadd84d1aff0aadc413d663fa1f2633d718a555e9dee397dc
Sep 09 14:25:22.179934 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:22.179900    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:25:22.180050 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:22.179976    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:25:22.180050 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:22.180007    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:25:22.296099 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:22.296055    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4" event={"ID":"76a06b40-2127-4b41-b6ab-a51c29f7cdf9","Type":"ContainerStarted","Data":"852f5ba139a1aaa7598a420e580f20f6b9471b37d3f415f93f50f87ca42a75bf"}
Sep 09 14:25:22.296342 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:22.296126    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4" event={"ID":"76a06b40-2127-4b41-b6ab-a51c29f7cdf9","Type":"ContainerStarted","Data":"ea18da5bf51bc49aadd84d1aff0aadc413d663fa1f2633d718a555e9dee397dc"}
Sep 09 14:25:22.316562 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:22.316471    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4" podStartSLOduration=1.316445743 podStartE2EDuration="1.316445743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:25:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:25:22.315586723 +0000 UTC m=+887.042126825" watchObservedRunningTime="2026-09-09 14:25:22.316445743 +0000 UTC m=+887.042985846"
Sep 09 14:25:22.381966 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:22.381923    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:22.890097 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:22.890056    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:23.763148 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:23.763109    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:23.848515 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:23.848477    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:23.896152 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:23.896124    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:24.192619 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:24.192568    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:24.308913 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:24.308865    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:24.310237 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:24.310213    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:24.936802 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:24.936762    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:25.033399 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.033361    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:25.132910 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.132872    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:25.392817 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.392780    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:25.488919 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.488868    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:25.496874 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.496838    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"]
Sep 09 14:25:25.500809 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.500785    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"
Sep 09 14:25:25.503010 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.502978    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-701ccc59\""
Sep 09 14:25:25.503195 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.503071    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-701ccc59-dockercfg-54r8s\""
Sep 09 14:25:25.515271 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.514014    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"]
Sep 09 14:25:25.531094 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.531052    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"]
Sep 09 14:25:25.534921 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.534897    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"
Sep 09 14:25:25.546218 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.546098    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"]
Sep 09 14:25:25.629564 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.629515    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8mqp\" (UniqueName: \"kubernetes.io/projected/647c434a-f0c2-4d3f-b18d-9995ba66a836-kube-api-access-m8mqp\") pod \"payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8\" (UID: \"647c434a-f0c2-4d3f-b18d-9995ba66a836\") " pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"
Sep 09 14:25:25.629782 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.629694    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e22ff3dd-57eb-4ef5-9b84-2f032331f001-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6\" (UID: \"e22ff3dd-57eb-4ef5-9b84-2f032331f001\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"
Sep 09 14:25:25.629782 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.629729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb2gl\" (UniqueName: \"kubernetes.io/projected/e22ff3dd-57eb-4ef5-9b84-2f032331f001-kube-api-access-pb2gl\") pod \"payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6\" (UID: \"e22ff3dd-57eb-4ef5-9b84-2f032331f001\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"
Sep 09 14:25:25.629872 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.629790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/647c434a-f0c2-4d3f-b18d-9995ba66a836-plugins-config-volume\") pod \"payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8\" (UID: \"647c434a-f0c2-4d3f-b18d-9995ba66a836\") " pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"
Sep 09 14:25:25.731108 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.730978    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e22ff3dd-57eb-4ef5-9b84-2f032331f001-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6\" (UID: \"e22ff3dd-57eb-4ef5-9b84-2f032331f001\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"
Sep 09 14:25:25.731108 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.731043    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb2gl\" (UniqueName: \"kubernetes.io/projected/e22ff3dd-57eb-4ef5-9b84-2f032331f001-kube-api-access-pb2gl\") pod \"payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6\" (UID: \"e22ff3dd-57eb-4ef5-9b84-2f032331f001\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"
Sep 09 14:25:25.731108 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.731103    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/647c434a-f0c2-4d3f-b18d-9995ba66a836-plugins-config-volume\") pod \"payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8\" (UID: \"647c434a-f0c2-4d3f-b18d-9995ba66a836\") " pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"
Sep 09 14:25:25.731455 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.731218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8mqp\" (UniqueName: \"kubernetes.io/projected/647c434a-f0c2-4d3f-b18d-9995ba66a836-kube-api-access-m8mqp\") pod \"payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8\" (UID: \"647c434a-f0c2-4d3f-b18d-9995ba66a836\") " pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"
Sep 09 14:25:25.731791 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.731768    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e22ff3dd-57eb-4ef5-9b84-2f032331f001-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6\" (UID: \"e22ff3dd-57eb-4ef5-9b84-2f032331f001\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"
Sep 09 14:25:25.731935 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.731915    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/647c434a-f0c2-4d3f-b18d-9995ba66a836-plugins-config-volume\") pod \"payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8\" (UID: \"647c434a-f0c2-4d3f-b18d-9995ba66a836\") " pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"
Sep 09 14:25:25.739755 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.739707    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb2gl\" (UniqueName: \"kubernetes.io/projected/e22ff3dd-57eb-4ef5-9b84-2f032331f001-kube-api-access-pb2gl\") pod \"payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6\" (UID: \"e22ff3dd-57eb-4ef5-9b84-2f032331f001\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"
Sep 09 14:25:25.740095 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.740067    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8mqp\" (UniqueName: \"kubernetes.io/projected/647c434a-f0c2-4d3f-b18d-9995ba66a836-kube-api-access-m8mqp\") pod \"payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8\" (UID: \"647c434a-f0c2-4d3f-b18d-9995ba66a836\") " pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"
Sep 09 14:25:25.822734 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.822688    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"
Sep 09 14:25:25.852151 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:25.852110    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"
Sep 09 14:25:26.110289 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:26.110254    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"]
Sep 09 14:25:26.112285 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:25:26.112245    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22ff3dd_57eb_4ef5_9b84_2f032331f001.slice/crio-f10513919759e821a260602e8872e1d9ce81aed8eaa5aa0fc8f31d7d78197f7c WatchSource:0}: Error finding container f10513919759e821a260602e8872e1d9ce81aed8eaa5aa0fc8f31d7d78197f7c: Status 404 returned error can't find the container with id f10513919759e821a260602e8872e1d9ce81aed8eaa5aa0fc8f31d7d78197f7c
Sep 09 14:25:26.151471 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:26.151440    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"]
Sep 09 14:25:26.154104 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:25:26.154073    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647c434a_f0c2_4d3f_b18d_9995ba66a836.slice/crio-d617948547b4c211ee5ad2709326ed4f42ea6950fe3e773ee57b2eda5e9be38d WatchSource:0}: Error finding container d617948547b4c211ee5ad2709326ed4f42ea6950fe3e773ee57b2eda5e9be38d: Status 404 returned error can't find the container with id d617948547b4c211ee5ad2709326ed4f42ea6950fe3e773ee57b2eda5e9be38d
Sep 09 14:25:26.324227 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:26.324139    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8" event={"ID":"647c434a-f0c2-4d3f-b18d-9995ba66a836","Type":"ContainerStarted","Data":"1c5764cc629062200591de807136d39a42cb19c62b3cce05d6fa33e3d4bdf59c"}
Sep 09 14:25:26.324474 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:26.324259    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8" event={"ID":"647c434a-f0c2-4d3f-b18d-9995ba66a836","Type":"ContainerStarted","Data":"d617948547b4c211ee5ad2709326ed4f42ea6950fe3e773ee57b2eda5e9be38d"}
Sep 09 14:25:26.324474 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:26.324395    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"
Sep 09 14:25:26.326410 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:26.326371    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6" event={"ID":"e22ff3dd-57eb-4ef5-9b84-2f032331f001","Type":"ContainerStarted","Data":"fd41ff034dd1c288d3d80101de0822962f90d780ea3b8981ee78514addbf2121"}
Sep 09 14:25:26.326604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:26.326430    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6" event={"ID":"e22ff3dd-57eb-4ef5-9b84-2f032331f001","Type":"ContainerStarted","Data":"f10513919759e821a260602e8872e1d9ce81aed8eaa5aa0fc8f31d7d78197f7c"}
Sep 09 14:25:26.347227 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:26.344896    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8" podStartSLOduration=1.344873647 podStartE2EDuration="1.344873647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:25:26.342416263 +0000 UTC m=+891.068956366" watchObservedRunningTime="2026-09-09 14:25:26.344873647 +0000 UTC m=+891.071413749"
Sep 09 14:25:26.358480 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:26.358404    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6" podStartSLOduration=1.358380529 podStartE2EDuration="1.358380529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:25:26.357462391 +0000 UTC m=+891.084002494" watchObservedRunningTime="2026-09-09 14:25:26.358380529 +0000 UTC m=+891.084920632"
Sep 09 14:25:26.457973 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:26.457868    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:27.303129 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:27.303063    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:27.333202 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:27.333155    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"
Sep 09 14:25:35.798105 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:35.797954    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:25:35.804640 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:35.804602    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:25:37.335423 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:37.335389    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"
Sep 09 14:25:38.342935 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:38.342885    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"
Sep 09 14:25:40.351454 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:40.351391    2562 patch_prober.go:28] interesting pod/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 14:25:40.351888 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:40.351497    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4" podUID="76a06b40-2127-4b41-b6ab-a51c29f7cdf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 14:25:41.435162 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:41.435121    2562 generic.go:356] "Generic (PLEG): container finished" podID="76a06b40-2127-4b41-b6ab-a51c29f7cdf9" containerID="852f5ba139a1aaa7598a420e580f20f6b9471b37d3f415f93f50f87ca42a75bf" exitCode=0
Sep 09 14:25:41.435649 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:41.435195    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4" event={"ID":"76a06b40-2127-4b41-b6ab-a51c29f7cdf9","Type":"ContainerDied","Data":"852f5ba139a1aaa7598a420e580f20f6b9471b37d3f415f93f50f87ca42a75bf"}
Sep 09 14:25:41.435694 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:41.435654    2562 scope.go:117] "RemoveContainer" containerID="852f5ba139a1aaa7598a420e580f20f6b9471b37d3f415f93f50f87ca42a75bf"
Sep 09 14:25:41.436952 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:41.436915    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:25:41.437018 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:41.437005    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:25:41.437054 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:41.437042    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:25:42.448216 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:42.448149    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4" event={"ID":"76a06b40-2127-4b41-b6ab-a51c29f7cdf9","Type":"ContainerStarted","Data":"c967fc48667f21b52e2063357149ded08369067c97fbbc422cde1496984f02bd"}
Sep 09 14:25:42.889425 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:42.889369    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:42.889867 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:42.889834    2562 patch_prober.go:28] interesting pod/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 09 14:25:42.889993 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:42.889903    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4" podUID="76a06b40-2127-4b41-b6ab-a51c29f7cdf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 09 14:25:43.890324 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:43.890288    2562 patch_prober.go:28] interesting pod/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 09 14:25:43.890743 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:43.890351    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4" podUID="76a06b40-2127-4b41-b6ab-a51c29f7cdf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 09 14:25:44.889823 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:44.889774    2562 patch_prober.go:28] interesting pod/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 09 14:25:44.890060 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:44.889848    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4" podUID="76a06b40-2127-4b41-b6ab-a51c29f7cdf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 09 14:25:45.890383 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:45.890339    2562 patch_prober.go:28] interesting pod/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 09 14:25:45.890839 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:45.890406    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4" podUID="76a06b40-2127-4b41-b6ab-a51c29f7cdf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 09 14:25:46.889770 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:46.889726    2562 patch_prober.go:28] interesting pod/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 09 14:25:46.889990 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:46.889815    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4" podUID="76a06b40-2127-4b41-b6ab-a51c29f7cdf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 09 14:25:47.980785 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:47.980736    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:47.981481 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:47.981451    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:47.982682 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:47.982657    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:25:49.534308 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:49.534258    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r"]
Sep 09 14:25:49.539591 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:49.539546    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r"
Sep 09 14:25:49.544081 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:49.541925    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:25:49.544081 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:49.542261    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:25:49.544441 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:49.544410    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r"]
Sep 09 14:25:49.613401 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:49.613352    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed8bcae4-e007-44f1-b47f-79f05e31803f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-701ccc59-9692r\" (UID: \"ed8bcae4-e007-44f1-b47f-79f05e31803f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r"
Sep 09 14:25:49.714992 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:49.714946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed8bcae4-e007-44f1-b47f-79f05e31803f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-701ccc59-9692r\" (UID: \"ed8bcae4-e007-44f1-b47f-79f05e31803f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r"
Sep 09 14:25:49.715663 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:49.715639    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed8bcae4-e007-44f1-b47f-79f05e31803f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-701ccc59-9692r\" (UID: \"ed8bcae4-e007-44f1-b47f-79f05e31803f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r"
Sep 09 14:25:49.857055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:49.857009    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r"
Sep 09 14:25:50.145805 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:50.145711    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r"]
Sep 09 14:25:50.151995 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:25:50.151920    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded8bcae4_e007_44f1_b47f_79f05e31803f.slice/crio-fc90f900b4bc9be7edb4643f63397e45cfea9a0de5fc1639f2deefe54a33a308 WatchSource:0}: Error finding container fc90f900b4bc9be7edb4643f63397e45cfea9a0de5fc1639f2deefe54a33a308: Status 404 returned error can't find the container with id fc90f900b4bc9be7edb4643f63397e45cfea9a0de5fc1639f2deefe54a33a308
Sep 09 14:25:50.515429 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:50.515391    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r" event={"ID":"ed8bcae4-e007-44f1-b47f-79f05e31803f","Type":"ContainerStarted","Data":"fe6af7af0123f89bd0aa4b4a01b71b4299a1427a546e0ab449a89621a4edf729"}
Sep 09 14:25:50.515661 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:50.515456    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r" event={"ID":"ed8bcae4-e007-44f1-b47f-79f05e31803f","Type":"ContainerStarted","Data":"fc90f900b4bc9be7edb4643f63397e45cfea9a0de5fc1639f2deefe54a33a308"}
Sep 09 14:25:50.530569 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:50.530498    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r" podStartSLOduration=1.530472418 podStartE2EDuration="1.530472418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:25:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:25:50.529855708 +0000 UTC m=+915.256395811" watchObservedRunningTime="2026-09-09 14:25:50.530472418 +0000 UTC m=+915.257012521"
Sep 09 14:25:51.524183 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:51.524140    2562 generic.go:356] "Generic (PLEG): container finished" podID="ed8bcae4-e007-44f1-b47f-79f05e31803f" containerID="fe6af7af0123f89bd0aa4b4a01b71b4299a1427a546e0ab449a89621a4edf729" exitCode=0
Sep 09 14:25:51.524644 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:51.524234    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r" event={"ID":"ed8bcae4-e007-44f1-b47f-79f05e31803f","Type":"ContainerDied","Data":"fe6af7af0123f89bd0aa4b4a01b71b4299a1427a546e0ab449a89621a4edf729"}
Sep 09 14:25:52.684509 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:52.684470    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r"
Sep 09 14:25:52.747102 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:52.747048    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed8bcae4-e007-44f1-b47f-79f05e31803f-maas-api-service-ca\") pod \"ed8bcae4-e007-44f1-b47f-79f05e31803f\" (UID: \"ed8bcae4-e007-44f1-b47f-79f05e31803f\") "
Sep 09 14:25:52.747443 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:52.747419    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed8bcae4-e007-44f1-b47f-79f05e31803f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ed8bcae4-e007-44f1-b47f-79f05e31803f" (UID: "ed8bcae4-e007-44f1-b47f-79f05e31803f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:25:52.848336 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:52.848293    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed8bcae4-e007-44f1-b47f-79f05e31803f-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:25:53.540076 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:53.540038    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r" event={"ID":"ed8bcae4-e007-44f1-b47f-79f05e31803f","Type":"ContainerDied","Data":"fc90f900b4bc9be7edb4643f63397e45cfea9a0de5fc1639f2deefe54a33a308"}
Sep 09 14:25:53.540076 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:53.540073    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r"
Sep 09 14:25:53.540399 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:53.540098    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc90f900b4bc9be7edb4643f63397e45cfea9a0de5fc1639f2deefe54a33a308"
Sep 09 14:25:55.611226 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:55.611158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:25:55.641429 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:55.641388    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"]
Sep 09 14:25:55.642013 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:55.641981    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8" podUID="647c434a-f0c2-4d3f-b18d-9995ba66a836" containerName="payload-processing" containerID="cri-o://1c5764cc629062200591de807136d39a42cb19c62b3cce05d6fa33e3d4bdf59c" gracePeriod=30
Sep 09 14:25:55.653930 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:55.653062    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"]
Sep 09 14:25:55.653930 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:55.653327    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6" podUID="e22ff3dd-57eb-4ef5-9b84-2f032331f001" containerName="payload-pre-processing" containerID="cri-o://fd41ff034dd1c288d3d80101de0822962f90d780ea3b8981ee78514addbf2121" gracePeriod=30
Sep 09 14:25:55.804852 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:55.804812    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r"]
Sep 09 14:25:55.805125 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:55.805100    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-701ccc59-9692r"]
Sep 09 14:25:55.983647 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:55.983613    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"
Sep 09 14:25:55.988748 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:55.988720    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"
Sep 09 14:25:56.084518 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.084480    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb2gl\" (UniqueName: \"kubernetes.io/projected/e22ff3dd-57eb-4ef5-9b84-2f032331f001-kube-api-access-pb2gl\") pod \"e22ff3dd-57eb-4ef5-9b84-2f032331f001\" (UID: \"e22ff3dd-57eb-4ef5-9b84-2f032331f001\") "
Sep 09 14:25:56.084712 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.084580    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e22ff3dd-57eb-4ef5-9b84-2f032331f001-plugins-config-volume\") pod \"e22ff3dd-57eb-4ef5-9b84-2f032331f001\" (UID: \"e22ff3dd-57eb-4ef5-9b84-2f032331f001\") "
Sep 09 14:25:56.084712 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.084689    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8mqp\" (UniqueName: \"kubernetes.io/projected/647c434a-f0c2-4d3f-b18d-9995ba66a836-kube-api-access-m8mqp\") pod \"647c434a-f0c2-4d3f-b18d-9995ba66a836\" (UID: \"647c434a-f0c2-4d3f-b18d-9995ba66a836\") "
Sep 09 14:25:56.084816 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.084755    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/647c434a-f0c2-4d3f-b18d-9995ba66a836-plugins-config-volume\") pod \"647c434a-f0c2-4d3f-b18d-9995ba66a836\" (UID: \"647c434a-f0c2-4d3f-b18d-9995ba66a836\") "
Sep 09 14:25:56.085054 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.085023    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e22ff3dd-57eb-4ef5-9b84-2f032331f001-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e22ff3dd-57eb-4ef5-9b84-2f032331f001" (UID: "e22ff3dd-57eb-4ef5-9b84-2f032331f001"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:25:56.085150 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.085084    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/647c434a-f0c2-4d3f-b18d-9995ba66a836-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "647c434a-f0c2-4d3f-b18d-9995ba66a836" (UID: "647c434a-f0c2-4d3f-b18d-9995ba66a836"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:25:56.086916 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.086885    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e22ff3dd-57eb-4ef5-9b84-2f032331f001-kube-api-access-pb2gl" (OuterVolumeSpecName: "kube-api-access-pb2gl") pod "e22ff3dd-57eb-4ef5-9b84-2f032331f001" (UID: "e22ff3dd-57eb-4ef5-9b84-2f032331f001"). InnerVolumeSpecName "kube-api-access-pb2gl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:25:56.087023 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.086918    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/647c434a-f0c2-4d3f-b18d-9995ba66a836-kube-api-access-m8mqp" (OuterVolumeSpecName: "kube-api-access-m8mqp") pod "647c434a-f0c2-4d3f-b18d-9995ba66a836" (UID: "647c434a-f0c2-4d3f-b18d-9995ba66a836"). InnerVolumeSpecName "kube-api-access-m8mqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:25:56.186211 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.186064    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/647c434a-f0c2-4d3f-b18d-9995ba66a836-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:25:56.186211 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.186104    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb2gl\" (UniqueName: \"kubernetes.io/projected/e22ff3dd-57eb-4ef5-9b84-2f032331f001-kube-api-access-pb2gl\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:25:56.186211 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.186117    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e22ff3dd-57eb-4ef5-9b84-2f032331f001-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:25:56.186211 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.186127    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8mqp\" (UniqueName: \"kubernetes.io/projected/647c434a-f0c2-4d3f-b18d-9995ba66a836-kube-api-access-m8mqp\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:25:56.562301 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.562264    2562 generic.go:356] "Generic (PLEG): container finished" podID="e22ff3dd-57eb-4ef5-9b84-2f032331f001" containerID="fd41ff034dd1c288d3d80101de0822962f90d780ea3b8981ee78514addbf2121" exitCode=0
Sep 09 14:25:56.562508 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.562311    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"
Sep 09 14:25:56.562508 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.562351    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6" event={"ID":"e22ff3dd-57eb-4ef5-9b84-2f032331f001","Type":"ContainerDied","Data":"fd41ff034dd1c288d3d80101de0822962f90d780ea3b8981ee78514addbf2121"}
Sep 09 14:25:56.562508 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.562410    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6" event={"ID":"e22ff3dd-57eb-4ef5-9b84-2f032331f001","Type":"ContainerDied","Data":"f10513919759e821a260602e8872e1d9ce81aed8eaa5aa0fc8f31d7d78197f7c"}
Sep 09 14:25:56.562508 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.562437    2562 scope.go:117] "RemoveContainer" containerID="fd41ff034dd1c288d3d80101de0822962f90d780ea3b8981ee78514addbf2121"
Sep 09 14:25:56.563897 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.563873    2562 generic.go:356] "Generic (PLEG): container finished" podID="647c434a-f0c2-4d3f-b18d-9995ba66a836" containerID="1c5764cc629062200591de807136d39a42cb19c62b3cce05d6fa33e3d4bdf59c" exitCode=0
Sep 09 14:25:56.564015 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.563928    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"
Sep 09 14:25:56.564015 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.563958    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8" event={"ID":"647c434a-f0c2-4d3f-b18d-9995ba66a836","Type":"ContainerDied","Data":"1c5764cc629062200591de807136d39a42cb19c62b3cce05d6fa33e3d4bdf59c"}
Sep 09 14:25:56.564100 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.564014    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8" event={"ID":"647c434a-f0c2-4d3f-b18d-9995ba66a836","Type":"ContainerDied","Data":"d617948547b4c211ee5ad2709326ed4f42ea6950fe3e773ee57b2eda5e9be38d"}
Sep 09 14:25:56.575547 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.575519    2562 scope.go:117] "RemoveContainer" containerID="fd41ff034dd1c288d3d80101de0822962f90d780ea3b8981ee78514addbf2121"
Sep 09 14:25:56.576041 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:25:56.575942    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd41ff034dd1c288d3d80101de0822962f90d780ea3b8981ee78514addbf2121\": container with ID starting with fd41ff034dd1c288d3d80101de0822962f90d780ea3b8981ee78514addbf2121 not found: ID does not exist" containerID="fd41ff034dd1c288d3d80101de0822962f90d780ea3b8981ee78514addbf2121"
Sep 09 14:25:56.576041 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.575982    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd41ff034dd1c288d3d80101de0822962f90d780ea3b8981ee78514addbf2121"} err="failed to get container status \"fd41ff034dd1c288d3d80101de0822962f90d780ea3b8981ee78514addbf2121\": rpc error: code = NotFound desc = could not find container \"fd41ff034dd1c288d3d80101de0822962f90d780ea3b8981ee78514addbf2121\": container with ID starting with fd41ff034dd1c288d3d80101de0822962f90d780ea3b8981ee78514addbf2121 not found: ID does not exist"
Sep 09 14:25:56.576041 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.576011    2562 scope.go:117] "RemoveContainer" containerID="1c5764cc629062200591de807136d39a42cb19c62b3cce05d6fa33e3d4bdf59c"
Sep 09 14:25:56.586065 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.586043    2562 scope.go:117] "RemoveContainer" containerID="1c5764cc629062200591de807136d39a42cb19c62b3cce05d6fa33e3d4bdf59c"
Sep 09 14:25:56.586474 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:25:56.586451    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c5764cc629062200591de807136d39a42cb19c62b3cce05d6fa33e3d4bdf59c\": container with ID starting with 1c5764cc629062200591de807136d39a42cb19c62b3cce05d6fa33e3d4bdf59c not found: ID does not exist" containerID="1c5764cc629062200591de807136d39a42cb19c62b3cce05d6fa33e3d4bdf59c"
Sep 09 14:25:56.586548 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.586483    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c5764cc629062200591de807136d39a42cb19c62b3cce05d6fa33e3d4bdf59c"} err="failed to get container status \"1c5764cc629062200591de807136d39a42cb19c62b3cce05d6fa33e3d4bdf59c\": rpc error: code = NotFound desc = could not find container \"1c5764cc629062200591de807136d39a42cb19c62b3cce05d6fa33e3d4bdf59c\": container with ID starting with 1c5764cc629062200591de807136d39a42cb19c62b3cce05d6fa33e3d4bdf59c not found: ID does not exist"
Sep 09 14:25:56.586591 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.586576    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"]
Sep 09 14:25:56.592060 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.592021    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-701ccc59-b8789b886-cs8s6"]
Sep 09 14:25:56.604328 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.604290    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"]
Sep 09 14:25:56.606660 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:56.606634    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-701ccc59-7f478774f-zbrp8"]
Sep 09 14:25:57.105157 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:57.105113    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"]
Sep 09 14:25:57.105684 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:57.105447    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4" podUID="76a06b40-2127-4b41-b6ab-a51c29f7cdf9" containerName="istio-proxy" containerID="cri-o://c967fc48667f21b52e2063357149ded08369067c97fbbc422cde1496984f02bd" gracePeriod=30
Sep 09 14:25:57.801189 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:57.801139    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="647c434a-f0c2-4d3f-b18d-9995ba66a836" path="/var/lib/kubelet/pods/647c434a-f0c2-4d3f-b18d-9995ba66a836/volumes"
Sep 09 14:25:57.801637 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:57.801619    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e22ff3dd-57eb-4ef5-9b84-2f032331f001" path="/var/lib/kubelet/pods/e22ff3dd-57eb-4ef5-9b84-2f032331f001/volumes"
Sep 09 14:25:57.801946 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:25:57.801933    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed8bcae4-e007-44f1-b47f-79f05e31803f" path="/var/lib/kubelet/pods/ed8bcae4-e007-44f1-b47f-79f05e31803f/volumes"
Sep 09 14:26:00.216994 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:00.216950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:01.440418 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:01.440370    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:01.543041 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:01.542996    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:01.685857 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:01.685816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:01.895656 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:01.895614    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:02.123021 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.122979    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"]
Sep 09 14:26:02.123695 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.123659    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e22ff3dd-57eb-4ef5-9b84-2f032331f001" containerName="payload-pre-processing"
Sep 09 14:26:02.123695 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.123694    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e22ff3dd-57eb-4ef5-9b84-2f032331f001" containerName="payload-pre-processing"
Sep 09 14:26:02.123894 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.123727    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="647c434a-f0c2-4d3f-b18d-9995ba66a836" containerName="payload-processing"
Sep 09 14:26:02.123894 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.123763    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="647c434a-f0c2-4d3f-b18d-9995ba66a836" containerName="payload-processing"
Sep 09 14:26:02.123894 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.123776    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed8bcae4-e007-44f1-b47f-79f05e31803f" containerName="revoke-keys"
Sep 09 14:26:02.123894 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.123787    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed8bcae4-e007-44f1-b47f-79f05e31803f" containerName="revoke-keys"
Sep 09 14:26:02.124073 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.123948    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed8bcae4-e007-44f1-b47f-79f05e31803f" containerName="revoke-keys"
Sep 09 14:26:02.124073 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.123968    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e22ff3dd-57eb-4ef5-9b84-2f032331f001" containerName="payload-pre-processing"
Sep 09 14:26:02.124073 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.123985    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="647c434a-f0c2-4d3f-b18d-9995ba66a836" containerName="payload-processing"
Sep 09 14:26:02.127475 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.127452    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"
Sep 09 14:26:02.129992 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.129964    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-a80b9686-dockercfg-2hzhb\""
Sep 09 14:26:02.130113 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.129993    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-a80b9686\""
Sep 09 14:26:02.138640 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.138525    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"]
Sep 09 14:26:02.183091 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.182985    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"]
Sep 09 14:26:02.186821 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.186794    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"
Sep 09 14:26:02.198576 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.198537    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"]
Sep 09 14:26:02.249433 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.249389    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0544579-644c-4967-b406-73e3fd727197-plugins-config-volume\") pod \"payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc\" (UID: \"e0544579-644c-4967-b406-73e3fd727197\") " pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"
Sep 09 14:26:02.249685 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.249494    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk5kw\" (UniqueName: \"kubernetes.io/projected/e0544579-644c-4967-b406-73e3fd727197-kube-api-access-bk5kw\") pod \"payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc\" (UID: \"e0544579-644c-4967-b406-73e3fd727197\") " pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"
Sep 09 14:26:02.350250 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.350211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f81de396-5f5a-4fb2-9200-d5f861c0790b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p\" (UID: \"f81de396-5f5a-4fb2-9200-d5f861c0790b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"
Sep 09 14:26:02.350420 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.350293    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8rqx\" (UniqueName: \"kubernetes.io/projected/f81de396-5f5a-4fb2-9200-d5f861c0790b-kube-api-access-z8rqx\") pod \"payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p\" (UID: \"f81de396-5f5a-4fb2-9200-d5f861c0790b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"
Sep 09 14:26:02.350420 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.350326    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0544579-644c-4967-b406-73e3fd727197-plugins-config-volume\") pod \"payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc\" (UID: \"e0544579-644c-4967-b406-73e3fd727197\") " pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"
Sep 09 14:26:02.350420 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.350389    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk5kw\" (UniqueName: \"kubernetes.io/projected/e0544579-644c-4967-b406-73e3fd727197-kube-api-access-bk5kw\") pod \"payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc\" (UID: \"e0544579-644c-4967-b406-73e3fd727197\") " pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"
Sep 09 14:26:02.351351 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.351317    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0544579-644c-4967-b406-73e3fd727197-plugins-config-volume\") pod \"payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc\" (UID: \"e0544579-644c-4967-b406-73e3fd727197\") " pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"
Sep 09 14:26:02.359318 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.359280    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk5kw\" (UniqueName: \"kubernetes.io/projected/e0544579-644c-4967-b406-73e3fd727197-kube-api-access-bk5kw\") pod \"payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc\" (UID: \"e0544579-644c-4967-b406-73e3fd727197\") " pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"
Sep 09 14:26:02.430820 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.430782    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:26:02.453293 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.452456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f81de396-5f5a-4fb2-9200-d5f861c0790b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p\" (UID: \"f81de396-5f5a-4fb2-9200-d5f861c0790b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"
Sep 09 14:26:02.453293 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.452575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8rqx\" (UniqueName: \"kubernetes.io/projected/f81de396-5f5a-4fb2-9200-d5f861c0790b-kube-api-access-z8rqx\") pod \"payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p\" (UID: \"f81de396-5f5a-4fb2-9200-d5f861c0790b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"
Sep 09 14:26:02.454077 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.454043    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f81de396-5f5a-4fb2-9200-d5f861c0790b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p\" (UID: \"f81de396-5f5a-4fb2-9200-d5f861c0790b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"
Sep 09 14:26:02.465706 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.465062    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8rqx\" (UniqueName: \"kubernetes.io/projected/f81de396-5f5a-4fb2-9200-d5f861c0790b-kube-api-access-z8rqx\") pod \"payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p\" (UID: \"f81de396-5f5a-4fb2-9200-d5f861c0790b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"
Sep 09 14:26:02.498758 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.498722    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"
Sep 09 14:26:02.506980 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.506933    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"
Sep 09 14:26:02.517935 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.517900    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:02.553824 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.553768    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-credential-socket\") pod \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") "
Sep 09 14:26:02.554046 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.553854    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-envoy\") pod \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") "
Sep 09 14:26:02.554046 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.553882    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsvvd\" (UniqueName: \"kubernetes.io/projected/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-kube-api-access-gsvvd\") pod \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") "
Sep 09 14:26:02.554046 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.553917    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-workload-socket\") pod \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") "
Sep 09 14:26:02.554046 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.553942    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-data\") pod \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") "
Sep 09 14:26:02.554326 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.554079    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istiod-ca-cert\") pod \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") "
Sep 09 14:26:02.554326 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.554088    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "76a06b40-2127-4b41-b6ab-a51c29f7cdf9" (UID: "76a06b40-2127-4b41-b6ab-a51c29f7cdf9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:02.554326 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.554195    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-workload-certs\") pod \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") "
Sep 09 14:26:02.554326 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.554243    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-token\") pod \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") "
Sep 09 14:26:02.554326 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.554305    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-podinfo\") pod \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\" (UID: \"76a06b40-2127-4b41-b6ab-a51c29f7cdf9\") "
Sep 09 14:26:02.554976 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.554670    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-credential-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:02.554976 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.554894    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "76a06b40-2127-4b41-b6ab-a51c29f7cdf9" (UID: "76a06b40-2127-4b41-b6ab-a51c29f7cdf9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:02.555608 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.555567    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "76a06b40-2127-4b41-b6ab-a51c29f7cdf9" (UID: "76a06b40-2127-4b41-b6ab-a51c29f7cdf9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:02.556085 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.555923    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-data" (OuterVolumeSpecName: "istio-data") pod "76a06b40-2127-4b41-b6ab-a51c29f7cdf9" (UID: "76a06b40-2127-4b41-b6ab-a51c29f7cdf9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:02.556085 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.556044    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "76a06b40-2127-4b41-b6ab-a51c29f7cdf9" (UID: "76a06b40-2127-4b41-b6ab-a51c29f7cdf9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:26:02.558589 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.558296    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "76a06b40-2127-4b41-b6ab-a51c29f7cdf9" (UID: "76a06b40-2127-4b41-b6ab-a51c29f7cdf9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:26:02.559380 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.558915    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-kube-api-access-gsvvd" (OuterVolumeSpecName: "kube-api-access-gsvvd") pod "76a06b40-2127-4b41-b6ab-a51c29f7cdf9" (UID: "76a06b40-2127-4b41-b6ab-a51c29f7cdf9"). InnerVolumeSpecName "kube-api-access-gsvvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:26:02.559477 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.559406    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "76a06b40-2127-4b41-b6ab-a51c29f7cdf9" (UID: "76a06b40-2127-4b41-b6ab-a51c29f7cdf9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:26:02.560537 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.560470    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-token" (OuterVolumeSpecName: "istio-token") pod "76a06b40-2127-4b41-b6ab-a51c29f7cdf9" (UID: "76a06b40-2127-4b41-b6ab-a51c29f7cdf9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:26:02.611617 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.611581    2562 generic.go:356] "Generic (PLEG): container finished" podID="76a06b40-2127-4b41-b6ab-a51c29f7cdf9" containerID="c967fc48667f21b52e2063357149ded08369067c97fbbc422cde1496984f02bd" exitCode=0
Sep 09 14:26:02.611777 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.611648    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4" event={"ID":"76a06b40-2127-4b41-b6ab-a51c29f7cdf9","Type":"ContainerDied","Data":"c967fc48667f21b52e2063357149ded08369067c97fbbc422cde1496984f02bd"}
Sep 09 14:26:02.611777 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.611665    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"
Sep 09 14:26:02.611777 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.611714    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4" event={"ID":"76a06b40-2127-4b41-b6ab-a51c29f7cdf9","Type":"ContainerDied","Data":"ea18da5bf51bc49aadd84d1aff0aadc413d663fa1f2633d718a555e9dee397dc"}
Sep 09 14:26:02.611777 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.611743    2562 scope.go:117] "RemoveContainer" containerID="c967fc48667f21b52e2063357149ded08369067c97fbbc422cde1496984f02bd"
Sep 09 14:26:02.625867 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.625843    2562 scope.go:117] "RemoveContainer" containerID="852f5ba139a1aaa7598a420e580f20f6b9471b37d3f415f93f50f87ca42a75bf"
Sep 09 14:26:02.638128 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.638007    2562 scope.go:117] "RemoveContainer" containerID="c967fc48667f21b52e2063357149ded08369067c97fbbc422cde1496984f02bd"
Sep 09 14:26:02.638611 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:26:02.638575    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c967fc48667f21b52e2063357149ded08369067c97fbbc422cde1496984f02bd\": container with ID starting with c967fc48667f21b52e2063357149ded08369067c97fbbc422cde1496984f02bd not found: ID does not exist" containerID="c967fc48667f21b52e2063357149ded08369067c97fbbc422cde1496984f02bd"
Sep 09 14:26:02.640274 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.638625    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c967fc48667f21b52e2063357149ded08369067c97fbbc422cde1496984f02bd"} err="failed to get container status \"c967fc48667f21b52e2063357149ded08369067c97fbbc422cde1496984f02bd\": rpc error: code = NotFound desc = could not find container \"c967fc48667f21b52e2063357149ded08369067c97fbbc422cde1496984f02bd\": container with ID starting with c967fc48667f21b52e2063357149ded08369067c97fbbc422cde1496984f02bd not found: ID does not exist"
Sep 09 14:26:02.640408 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.640289    2562 scope.go:117] "RemoveContainer" containerID="852f5ba139a1aaa7598a420e580f20f6b9471b37d3f415f93f50f87ca42a75bf"
Sep 09 14:26:02.640885 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:26:02.640819    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"852f5ba139a1aaa7598a420e580f20f6b9471b37d3f415f93f50f87ca42a75bf\": container with ID starting with 852f5ba139a1aaa7598a420e580f20f6b9471b37d3f415f93f50f87ca42a75bf not found: ID does not exist" containerID="852f5ba139a1aaa7598a420e580f20f6b9471b37d3f415f93f50f87ca42a75bf"
Sep 09 14:26:02.640885 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.640856    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"852f5ba139a1aaa7598a420e580f20f6b9471b37d3f415f93f50f87ca42a75bf"} err="failed to get container status \"852f5ba139a1aaa7598a420e580f20f6b9471b37d3f415f93f50f87ca42a75bf\": rpc error: code = NotFound desc = could not find container \"852f5ba139a1aaa7598a420e580f20f6b9471b37d3f415f93f50f87ca42a75bf\": container with ID starting with 852f5ba139a1aaa7598a420e580f20f6b9471b37d3f415f93f50f87ca42a75bf not found: ID does not exist"
Sep 09 14:26:02.642906 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.642873    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"]
Sep 09 14:26:02.649015 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.648957    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-701ccc59-openshift-default-6dfd98b5bb-k6hz4"]
Sep 09 14:26:02.656256 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.656214    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-envoy\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:02.656256 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.656252    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsvvd\" (UniqueName: \"kubernetes.io/projected/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-kube-api-access-gsvvd\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:02.656256 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.656266    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-workload-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:02.656613 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.656281    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-data\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:02.656613 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.656290    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istiod-ca-cert\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:02.656613 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.656298    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-workload-certs\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:02.656613 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.656306    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-token\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:02.656613 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.656315    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76a06b40-2127-4b41-b6ab-a51c29f7cdf9-istio-podinfo\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:02.786525 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.786494    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"]
Sep 09 14:26:02.788130 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:26:02.788097    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0544579_644c_4967_b406_73e3fd727197.slice/crio-6634822a8ac9431f77d8a735a996c30e3b76e3ca9fb1524c4567d8176f1f40bf WatchSource:0}: Error finding container 6634822a8ac9431f77d8a735a996c30e3b76e3ca9fb1524c4567d8176f1f40bf: Status 404 returned error can't find the container with id 6634822a8ac9431f77d8a735a996c30e3b76e3ca9fb1524c4567d8176f1f40bf
Sep 09 14:26:02.797791 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:02.797764    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"]
Sep 09 14:26:03.619795 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:03.619744    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p" event={"ID":"f81de396-5f5a-4fb2-9200-d5f861c0790b","Type":"ContainerStarted","Data":"716ff28fad6cb873d43cf48ead6fb856f516b37143c5cf7ebdc4e8d4512ee834"}
Sep 09 14:26:03.620344 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:03.619972    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"
Sep 09 14:26:03.620344 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:03.620028    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p" event={"ID":"f81de396-5f5a-4fb2-9200-d5f861c0790b","Type":"ContainerStarted","Data":"d5019fd309a23efc21fb65eba4c6d444d1fb1b351ad135f672fd7645632f0ce8"}
Sep 09 14:26:03.621502 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:03.621473    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc" event={"ID":"e0544579-644c-4967-b406-73e3fd727197","Type":"ContainerStarted","Data":"af1f79a5b67d9380f10fe050d4e273a7311e7a56b24c0751fa25e3b96047f4ea"}
Sep 09 14:26:03.621645 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:03.621523    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc" event={"ID":"e0544579-644c-4967-b406-73e3fd727197","Type":"ContainerStarted","Data":"6634822a8ac9431f77d8a735a996c30e3b76e3ca9fb1524c4567d8176f1f40bf"}
Sep 09 14:26:03.621645 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:03.621586    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"
Sep 09 14:26:03.636857 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:03.636778    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p" podStartSLOduration=1.636758049 podStartE2EDuration="1.636758049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:26:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:26:03.635898917 +0000 UTC m=+928.362439020" watchObservedRunningTime="2026-09-09 14:26:03.636758049 +0000 UTC m=+928.363298150"
Sep 09 14:26:03.656822 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:03.656752    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc" podStartSLOduration=1.656732785 podStartE2EDuration="1.656732785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:26:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:26:03.653817237 +0000 UTC m=+928.380357340" watchObservedRunningTime="2026-09-09 14:26:03.656732785 +0000 UTC m=+928.383272886"
Sep 09 14:26:03.685398 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:03.685355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:03.800730 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:03.800692    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76a06b40-2127-4b41-b6ab-a51c29f7cdf9" path="/var/lib/kubelet/pods/76a06b40-2127-4b41-b6ab-a51c29f7cdf9/volumes"
Sep 09 14:26:14.631666 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:14.631627    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"
Sep 09 14:26:14.632115 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:14.631719    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"
Sep 09 14:26:19.332198 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:19.332122    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:21.928796 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:21.928756    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:22.514485 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:22.514439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:23.793805 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:23.793766    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:23.907950 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:23.907904    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g"]
Sep 09 14:26:23.908502 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:23.908480    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a06b40-2127-4b41-b6ab-a51c29f7cdf9" containerName="istio-proxy"
Sep 09 14:26:23.908502 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:23.908503    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a06b40-2127-4b41-b6ab-a51c29f7cdf9" containerName="istio-proxy"
Sep 09 14:26:23.908669 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:23.908626    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="76a06b40-2127-4b41-b6ab-a51c29f7cdf9" containerName="istio-proxy"
Sep 09 14:26:23.912794 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:23.912763    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g"
Sep 09 14:26:23.916110 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:23.915732    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:26:23.916110 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:23.915766    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:26:23.918837 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:23.918784    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g"]
Sep 09 14:26:23.994327 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:23.994285    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70c2589e-1e14-4749-bc79-cdee64519337-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g\" (UID: \"70c2589e-1e14-4749-bc79-cdee64519337\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g"
Sep 09 14:26:24.095804 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:24.095763    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70c2589e-1e14-4749-bc79-cdee64519337-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g\" (UID: \"70c2589e-1e14-4749-bc79-cdee64519337\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g"
Sep 09 14:26:24.096527 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:24.096505    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70c2589e-1e14-4749-bc79-cdee64519337-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g\" (UID: \"70c2589e-1e14-4749-bc79-cdee64519337\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g"
Sep 09 14:26:24.143075 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:24.143034    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:24.228453 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:24.228408    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g"
Sep 09 14:26:24.515090 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:24.515051    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g"]
Sep 09 14:26:24.517465 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:26:24.517428    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70c2589e_1e14_4749_bc79_cdee64519337.slice/crio-fb142744f369adb1b2469ef3667e440d26b9f4c7131adeab07a48b12f02666c5 WatchSource:0}: Error finding container fb142744f369adb1b2469ef3667e440d26b9f4c7131adeab07a48b12f02666c5: Status 404 returned error can't find the container with id fb142744f369adb1b2469ef3667e440d26b9f4c7131adeab07a48b12f02666c5
Sep 09 14:26:24.772675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:24.772586    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g" event={"ID":"70c2589e-1e14-4749-bc79-cdee64519337","Type":"ContainerStarted","Data":"fb142744f369adb1b2469ef3667e440d26b9f4c7131adeab07a48b12f02666c5"}
Sep 09 14:26:24.892803 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:24.892762    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj"]
Sep 09 14:26:24.893525 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:24.893501    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a06b40-2127-4b41-b6ab-a51c29f7cdf9" containerName="istio-proxy"
Sep 09 14:26:24.893649 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:24.893528    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a06b40-2127-4b41-b6ab-a51c29f7cdf9" containerName="istio-proxy"
Sep 09 14:26:24.893705 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:24.893691    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="76a06b40-2127-4b41-b6ab-a51c29f7cdf9" containerName="istio-proxy"
Sep 09 14:26:24.897043 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:24.897014    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj"
Sep 09 14:26:24.903843 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:24.903806    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj"]
Sep 09 14:26:25.008508 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:25.008456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74ceee3f-81b1-4015-bad9-104223393fe7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj\" (UID: \"74ceee3f-81b1-4015-bad9-104223393fe7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj"
Sep 09 14:26:25.109130 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:25.109081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74ceee3f-81b1-4015-bad9-104223393fe7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj\" (UID: \"74ceee3f-81b1-4015-bad9-104223393fe7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj"
Sep 09 14:26:25.109860 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:25.109836    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74ceee3f-81b1-4015-bad9-104223393fe7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj\" (UID: \"74ceee3f-81b1-4015-bad9-104223393fe7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj"
Sep 09 14:26:25.130773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:25.130731    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:25.212453 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:25.212404    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj"
Sep 09 14:26:25.493242 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:25.493212    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj"]
Sep 09 14:26:25.496516 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:26:25.496479    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74ceee3f_81b1_4015_bad9_104223393fe7.slice/crio-ff21ad2e6aa7c9c87a9cf929cd78ea162b3b87d24e0d2e1a042610f079e85373 WatchSource:0}: Error finding container ff21ad2e6aa7c9c87a9cf929cd78ea162b3b87d24e0d2e1a042610f079e85373: Status 404 returned error can't find the container with id ff21ad2e6aa7c9c87a9cf929cd78ea162b3b87d24e0d2e1a042610f079e85373
Sep 09 14:26:25.781114 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:25.781002    2562 generic.go:356] "Generic (PLEG): container finished" podID="70c2589e-1e14-4749-bc79-cdee64519337" containerID="40313c50f8e548fcdfebfd6bbcfff6b19a1ee9751c07514ec1771a2d1f738ba5" exitCode=0
Sep 09 14:26:25.781114 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:25.781096    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g" event={"ID":"70c2589e-1e14-4749-bc79-cdee64519337","Type":"ContainerDied","Data":"40313c50f8e548fcdfebfd6bbcfff6b19a1ee9751c07514ec1771a2d1f738ba5"}
Sep 09 14:26:25.782670 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:25.782641    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj" event={"ID":"74ceee3f-81b1-4015-bad9-104223393fe7","Type":"ContainerStarted","Data":"ff21ad2e6aa7c9c87a9cf929cd78ea162b3b87d24e0d2e1a042610f079e85373"}
Sep 09 14:26:26.791252 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:26.791215    2562 generic.go:356] "Generic (PLEG): container finished" podID="74ceee3f-81b1-4015-bad9-104223393fe7" containerID="3dc39cc414f987da179825f3c52c5ad193ad2d33a7da2cc2e4002edff7628622" exitCode=0
Sep 09 14:26:26.791761 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:26.791283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj" event={"ID":"74ceee3f-81b1-4015-bad9-104223393fe7","Type":"ContainerDied","Data":"3dc39cc414f987da179825f3c52c5ad193ad2d33a7da2cc2e4002edff7628622"}
Sep 09 14:26:26.951091 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:26.951051    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g"
Sep 09 14:26:27.032816 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:27.032772    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70c2589e-1e14-4749-bc79-cdee64519337-maas-api-service-ca\") pod \"70c2589e-1e14-4749-bc79-cdee64519337\" (UID: \"70c2589e-1e14-4749-bc79-cdee64519337\") "
Sep 09 14:26:27.033239 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:27.033210    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70c2589e-1e14-4749-bc79-cdee64519337-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "70c2589e-1e14-4749-bc79-cdee64519337" (UID: "70c2589e-1e14-4749-bc79-cdee64519337"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:26:27.133795 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:27.133690    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70c2589e-1e14-4749-bc79-cdee64519337-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:27.799444 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:27.799405    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g"
Sep 09 14:26:27.801939 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:27.801887    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g" event={"ID":"70c2589e-1e14-4749-bc79-cdee64519337","Type":"ContainerDied","Data":"fb142744f369adb1b2469ef3667e440d26b9f4c7131adeab07a48b12f02666c5"}
Sep 09 14:26:27.802127 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:27.801964    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb142744f369adb1b2469ef3667e440d26b9f4c7131adeab07a48b12f02666c5"
Sep 09 14:26:27.961424 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:27.961389    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj"
Sep 09 14:26:28.045650 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:28.045597    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74ceee3f-81b1-4015-bad9-104223393fe7-maas-api-service-ca\") pod \"74ceee3f-81b1-4015-bad9-104223393fe7\" (UID: \"74ceee3f-81b1-4015-bad9-104223393fe7\") "
Sep 09 14:26:28.046160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:28.046123    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74ceee3f-81b1-4015-bad9-104223393fe7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "74ceee3f-81b1-4015-bad9-104223393fe7" (UID: "74ceee3f-81b1-4015-bad9-104223393fe7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:26:28.146933 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:28.146880    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74ceee3f-81b1-4015-bad9-104223393fe7-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:28.808253 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:28.808209    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj" event={"ID":"74ceee3f-81b1-4015-bad9-104223393fe7","Type":"ContainerDied","Data":"ff21ad2e6aa7c9c87a9cf929cd78ea162b3b87d24e0d2e1a042610f079e85373"}
Sep 09 14:26:28.808253 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:28.808243    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj"
Sep 09 14:26:28.808744 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:28.808273    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff21ad2e6aa7c9c87a9cf929cd78ea162b3b87d24e0d2e1a042610f079e85373"
Sep 09 14:26:31.858767 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:31.858719    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:31.888319 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:31.888268    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"]
Sep 09 14:26:31.888684 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:31.888624    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc" podUID="e0544579-644c-4967-b406-73e3fd727197" containerName="payload-processing" containerID="cri-o://af1f79a5b67d9380f10fe050d4e273a7311e7a56b24c0751fa25e3b96047f4ea" gracePeriod=30
Sep 09 14:26:31.892319 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:31.892262    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"]
Sep 09 14:26:31.896622 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:31.893393    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p" podUID="f81de396-5f5a-4fb2-9200-d5f861c0790b" containerName="payload-pre-processing" containerID="cri-o://716ff28fad6cb873d43cf48ead6fb856f516b37143c5cf7ebdc4e8d4512ee834" gracePeriod=30
Sep 09 14:26:31.978067 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:31.978025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:32.151470 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.151424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:32.168869 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.168798    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj"]
Sep 09 14:26:32.171580 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.171543    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a80b9686-x9lkj"]
Sep 09 14:26:32.190154 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.190106    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"
Sep 09 14:26:32.199650 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.199609    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0544579-644c-4967-b406-73e3fd727197-plugins-config-volume\") pod \"e0544579-644c-4967-b406-73e3fd727197\" (UID: \"e0544579-644c-4967-b406-73e3fd727197\") "
Sep 09 14:26:32.199835 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.199722    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bk5kw\" (UniqueName: \"kubernetes.io/projected/e0544579-644c-4967-b406-73e3fd727197-kube-api-access-bk5kw\") pod \"e0544579-644c-4967-b406-73e3fd727197\" (UID: \"e0544579-644c-4967-b406-73e3fd727197\") "
Sep 09 14:26:32.200185 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.200139    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0544579-644c-4967-b406-73e3fd727197-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e0544579-644c-4967-b406-73e3fd727197" (UID: "e0544579-644c-4967-b406-73e3fd727197"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:26:32.202345 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.202309    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0544579-644c-4967-b406-73e3fd727197-kube-api-access-bk5kw" (OuterVolumeSpecName: "kube-api-access-bk5kw") pod "e0544579-644c-4967-b406-73e3fd727197" (UID: "e0544579-644c-4967-b406-73e3fd727197"). InnerVolumeSpecName "kube-api-access-bk5kw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:26:32.223491 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.223443    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"
Sep 09 14:26:32.300607 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.300570    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8rqx\" (UniqueName: \"kubernetes.io/projected/f81de396-5f5a-4fb2-9200-d5f861c0790b-kube-api-access-z8rqx\") pod \"f81de396-5f5a-4fb2-9200-d5f861c0790b\" (UID: \"f81de396-5f5a-4fb2-9200-d5f861c0790b\") "
Sep 09 14:26:32.300833 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.300655    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f81de396-5f5a-4fb2-9200-d5f861c0790b-plugins-config-volume\") pod \"f81de396-5f5a-4fb2-9200-d5f861c0790b\" (UID: \"f81de396-5f5a-4fb2-9200-d5f861c0790b\") "
Sep 09 14:26:32.300969 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.300955    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0544579-644c-4967-b406-73e3fd727197-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:32.301031 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.300971    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk5kw\" (UniqueName: \"kubernetes.io/projected/e0544579-644c-4967-b406-73e3fd727197-kube-api-access-bk5kw\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:32.301031 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.301007    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f81de396-5f5a-4fb2-9200-d5f861c0790b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f81de396-5f5a-4fb2-9200-d5f861c0790b" (UID: "f81de396-5f5a-4fb2-9200-d5f861c0790b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:26:32.303003 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.302960    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f81de396-5f5a-4fb2-9200-d5f861c0790b-kube-api-access-z8rqx" (OuterVolumeSpecName: "kube-api-access-z8rqx") pod "f81de396-5f5a-4fb2-9200-d5f861c0790b" (UID: "f81de396-5f5a-4fb2-9200-d5f861c0790b"). InnerVolumeSpecName "kube-api-access-z8rqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:26:32.402392 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.402284    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f81de396-5f5a-4fb2-9200-d5f861c0790b-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:32.402392 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.402328    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8rqx\" (UniqueName: \"kubernetes.io/projected/f81de396-5f5a-4fb2-9200-d5f861c0790b-kube-api-access-z8rqx\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:32.839257 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.839210    2562 generic.go:356] "Generic (PLEG): container finished" podID="f81de396-5f5a-4fb2-9200-d5f861c0790b" containerID="716ff28fad6cb873d43cf48ead6fb856f516b37143c5cf7ebdc4e8d4512ee834" exitCode=0
Sep 09 14:26:32.839499 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.839274    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"
Sep 09 14:26:32.839499 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.839306    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p" event={"ID":"f81de396-5f5a-4fb2-9200-d5f861c0790b","Type":"ContainerDied","Data":"716ff28fad6cb873d43cf48ead6fb856f516b37143c5cf7ebdc4e8d4512ee834"}
Sep 09 14:26:32.839499 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.839374    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p" event={"ID":"f81de396-5f5a-4fb2-9200-d5f861c0790b","Type":"ContainerDied","Data":"d5019fd309a23efc21fb65eba4c6d444d1fb1b351ad135f672fd7645632f0ce8"}
Sep 09 14:26:32.839499 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.839428    2562 scope.go:117] "RemoveContainer" containerID="716ff28fad6cb873d43cf48ead6fb856f516b37143c5cf7ebdc4e8d4512ee834"
Sep 09 14:26:32.841773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.841683    2562 generic.go:356] "Generic (PLEG): container finished" podID="e0544579-644c-4967-b406-73e3fd727197" containerID="af1f79a5b67d9380f10fe050d4e273a7311e7a56b24c0751fa25e3b96047f4ea" exitCode=0
Sep 09 14:26:32.841773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.841773    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc" event={"ID":"e0544579-644c-4967-b406-73e3fd727197","Type":"ContainerDied","Data":"af1f79a5b67d9380f10fe050d4e273a7311e7a56b24c0751fa25e3b96047f4ea"}
Sep 09 14:26:32.841947 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.841839    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc" event={"ID":"e0544579-644c-4967-b406-73e3fd727197","Type":"ContainerDied","Data":"6634822a8ac9431f77d8a735a996c30e3b76e3ca9fb1524c4567d8176f1f40bf"}
Sep 09 14:26:32.841947 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.841750    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"
Sep 09 14:26:32.853540 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.853510    2562 scope.go:117] "RemoveContainer" containerID="716ff28fad6cb873d43cf48ead6fb856f516b37143c5cf7ebdc4e8d4512ee834"
Sep 09 14:26:32.854023 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:26:32.853985    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"716ff28fad6cb873d43cf48ead6fb856f516b37143c5cf7ebdc4e8d4512ee834\": container with ID starting with 716ff28fad6cb873d43cf48ead6fb856f516b37143c5cf7ebdc4e8d4512ee834 not found: ID does not exist" containerID="716ff28fad6cb873d43cf48ead6fb856f516b37143c5cf7ebdc4e8d4512ee834"
Sep 09 14:26:32.854128 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.854033    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716ff28fad6cb873d43cf48ead6fb856f516b37143c5cf7ebdc4e8d4512ee834"} err="failed to get container status \"716ff28fad6cb873d43cf48ead6fb856f516b37143c5cf7ebdc4e8d4512ee834\": rpc error: code = NotFound desc = could not find container \"716ff28fad6cb873d43cf48ead6fb856f516b37143c5cf7ebdc4e8d4512ee834\": container with ID starting with 716ff28fad6cb873d43cf48ead6fb856f516b37143c5cf7ebdc4e8d4512ee834 not found: ID does not exist"
Sep 09 14:26:32.854128 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.854057    2562 scope.go:117] "RemoveContainer" containerID="af1f79a5b67d9380f10fe050d4e273a7311e7a56b24c0751fa25e3b96047f4ea"
Sep 09 14:26:32.865705 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.865671    2562 scope.go:117] "RemoveContainer" containerID="af1f79a5b67d9380f10fe050d4e273a7311e7a56b24c0751fa25e3b96047f4ea"
Sep 09 14:26:32.866128 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.866092    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"]
Sep 09 14:26:32.866298 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:26:32.866197    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af1f79a5b67d9380f10fe050d4e273a7311e7a56b24c0751fa25e3b96047f4ea\": container with ID starting with af1f79a5b67d9380f10fe050d4e273a7311e7a56b24c0751fa25e3b96047f4ea not found: ID does not exist" containerID="af1f79a5b67d9380f10fe050d4e273a7311e7a56b24c0751fa25e3b96047f4ea"
Sep 09 14:26:32.866298 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.866237    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af1f79a5b67d9380f10fe050d4e273a7311e7a56b24c0751fa25e3b96047f4ea"} err="failed to get container status \"af1f79a5b67d9380f10fe050d4e273a7311e7a56b24c0751fa25e3b96047f4ea\": rpc error: code = NotFound desc = could not find container \"af1f79a5b67d9380f10fe050d4e273a7311e7a56b24c0751fa25e3b96047f4ea\": container with ID starting with af1f79a5b67d9380f10fe050d4e273a7311e7a56b24c0751fa25e3b96047f4ea not found: ID does not exist"
Sep 09 14:26:32.873065 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.873029    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a80b9686-5dd456d5db-lst2p"]
Sep 09 14:26:32.883310 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.883269    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"]
Sep 09 14:26:32.886954 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:32.886914    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a80b9686-594d87cfcc-rj2vc"]
Sep 09 14:26:33.090485 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:33.090374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:33.191045 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:33.191000    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:33.290673 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:33.290632    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:33.800868 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:33.800819    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74ceee3f-81b1-4015-bad9-104223393fe7" path="/var/lib/kubelet/pods/74ceee3f-81b1-4015-bad9-104223393fe7/volumes"
Sep 09 14:26:33.801307 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:33.801290    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0544579-644c-4967-b406-73e3fd727197" path="/var/lib/kubelet/pods/e0544579-644c-4967-b406-73e3fd727197/volumes"
Sep 09 14:26:33.801677 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:33.801662    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f81de396-5f5a-4fb2-9200-d5f861c0790b" path="/var/lib/kubelet/pods/f81de396-5f5a-4fb2-9200-d5f861c0790b/volumes"
Sep 09 14:26:34.055370 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:34.055324    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:34.614863 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:34.614827    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:34.656414 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:34.656369    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"]
Sep 09 14:26:34.657060 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:34.656710    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2" podUID="22234843-96e8-46d6-9c25-a0b8abbf8659" containerName="payload-pre-processing" containerID="cri-o://7dbd40892e92c6d7ee2f2b6889c0dc44f6b2d8905ecef985e86f373cec65135b" gracePeriod=30
Sep 09 14:26:34.685754 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:34.685706    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:34.770960 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:34.770864    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2" podUID="22234843-96e8-46d6-9c25-a0b8abbf8659" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.51:9004: connect: connection refused"
Sep 09 14:26:34.785846 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:34.785792    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:34.802373 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:34.802337    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g"]
Sep 09 14:26:34.804839 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:34.804804    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-a2ffe2-l6h5g"]
Sep 09 14:26:34.866805 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:34.866705    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:34.868672 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:34.868622    2562 generic.go:356] "Generic (PLEG): container finished" podID="22234843-96e8-46d6-9c25-a0b8abbf8659" containerID="7dbd40892e92c6d7ee2f2b6889c0dc44f6b2d8905ecef985e86f373cec65135b" exitCode=0
Sep 09 14:26:34.868865 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:34.868705    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2" event={"ID":"22234843-96e8-46d6-9c25-a0b8abbf8659","Type":"ContainerDied","Data":"7dbd40892e92c6d7ee2f2b6889c0dc44f6b2d8905ecef985e86f373cec65135b"}
Sep 09 14:26:34.939589 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:34.939541    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"
Sep 09 14:26:35.029816 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:35.029766    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22234843-96e8-46d6-9c25-a0b8abbf8659-plugins-config-volume\") pod \"22234843-96e8-46d6-9c25-a0b8abbf8659\" (UID: \"22234843-96e8-46d6-9c25-a0b8abbf8659\") "
Sep 09 14:26:35.030039 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:35.029850    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjs5l\" (UniqueName: \"kubernetes.io/projected/22234843-96e8-46d6-9c25-a0b8abbf8659-kube-api-access-pjs5l\") pod \"22234843-96e8-46d6-9c25-a0b8abbf8659\" (UID: \"22234843-96e8-46d6-9c25-a0b8abbf8659\") "
Sep 09 14:26:35.030254 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:35.030228    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22234843-96e8-46d6-9c25-a0b8abbf8659-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "22234843-96e8-46d6-9c25-a0b8abbf8659" (UID: "22234843-96e8-46d6-9c25-a0b8abbf8659"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:26:35.032208 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:35.032178    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22234843-96e8-46d6-9c25-a0b8abbf8659-kube-api-access-pjs5l" (OuterVolumeSpecName: "kube-api-access-pjs5l") pod "22234843-96e8-46d6-9c25-a0b8abbf8659" (UID: "22234843-96e8-46d6-9c25-a0b8abbf8659"). InnerVolumeSpecName "kube-api-access-pjs5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:26:35.131630 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:35.131520    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22234843-96e8-46d6-9c25-a0b8abbf8659-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:35.131630 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:35.131558    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjs5l\" (UniqueName: \"kubernetes.io/projected/22234843-96e8-46d6-9c25-a0b8abbf8659-kube-api-access-pjs5l\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:26:35.190736 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:35.190694    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:35.800316 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:35.800277    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70c2589e-1e14-4749-bc79-cdee64519337" path="/var/lib/kubelet/pods/70c2589e-1e14-4749-bc79-cdee64519337/volumes"
Sep 09 14:26:35.876916 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:35.876874    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2" event={"ID":"22234843-96e8-46d6-9c25-a0b8abbf8659","Type":"ContainerDied","Data":"fc63b6ec2e8a27999df390e5c1d53981f006a5f8f3a666db38aeeb14ed21f11f"}
Sep 09 14:26:35.876916 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:35.876901    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"
Sep 09 14:26:35.877116 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:35.876959    2562 scope.go:117] "RemoveContainer" containerID="7dbd40892e92c6d7ee2f2b6889c0dc44f6b2d8905ecef985e86f373cec65135b"
Sep 09 14:26:35.895188 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:35.895129    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"]
Sep 09 14:26:35.899901 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:35.899869    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-a2ffe2-7f6d9f8dd6-2cgf2"]
Sep 09 14:26:37.801452 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:37.801409    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22234843-96e8-46d6-9c25-a0b8abbf8659" path="/var/lib/kubelet/pods/22234843-96e8-46d6-9c25-a0b8abbf8659/volumes"
Sep 09 14:26:40.090491 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:40.090441    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:40.191269 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:40.191228    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:40.982073 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:40.982009    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:41.040721 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:41.040680    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:41.115485 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:41.115447    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:41.215899 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:41.215836    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:41.316034 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:41.315988    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:41.728227 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:41.728091    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:42.843572 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:42.843531    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:42.940038 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:42.939968    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:43.380444 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.380406    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:43.658808 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.658707    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"]
Sep 09 14:26:43.659282 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.659258    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74ceee3f-81b1-4015-bad9-104223393fe7" containerName="revoke-keys"
Sep 09 14:26:43.659397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.659285    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="74ceee3f-81b1-4015-bad9-104223393fe7" containerName="revoke-keys"
Sep 09 14:26:43.659397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.659313    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0544579-644c-4967-b406-73e3fd727197" containerName="payload-processing"
Sep 09 14:26:43.659397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.659323    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0544579-644c-4967-b406-73e3fd727197" containerName="payload-processing"
Sep 09 14:26:43.659397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.659340    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f81de396-5f5a-4fb2-9200-d5f861c0790b" containerName="payload-pre-processing"
Sep 09 14:26:43.659397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.659350    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f81de396-5f5a-4fb2-9200-d5f861c0790b" containerName="payload-pre-processing"
Sep 09 14:26:43.659397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.659364    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70c2589e-1e14-4749-bc79-cdee64519337" containerName="revoke-keys"
Sep 09 14:26:43.659397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.659372    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="70c2589e-1e14-4749-bc79-cdee64519337" containerName="revoke-keys"
Sep 09 14:26:43.659397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.659385    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22234843-96e8-46d6-9c25-a0b8abbf8659" containerName="payload-pre-processing"
Sep 09 14:26:43.659397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.659393    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="22234843-96e8-46d6-9c25-a0b8abbf8659" containerName="payload-pre-processing"
Sep 09 14:26:43.659862 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.659523    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="22234843-96e8-46d6-9c25-a0b8abbf8659" containerName="payload-pre-processing"
Sep 09 14:26:43.659862 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.659536    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0544579-644c-4967-b406-73e3fd727197" containerName="payload-processing"
Sep 09 14:26:43.659862 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.659546    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="74ceee3f-81b1-4015-bad9-104223393fe7" containerName="revoke-keys"
Sep 09 14:26:43.659862 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.659555    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f81de396-5f5a-4fb2-9200-d5f861c0790b" containerName="payload-pre-processing"
Sep 09 14:26:43.659862 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.659566    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="70c2589e-1e14-4749-bc79-cdee64519337" containerName="revoke-keys"
Sep 09 14:26:43.664951 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.664917    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.667546 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.667516    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-0da694-openshift-default-dockercfg-4fmzt\""
Sep 09 14:26:43.677722 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.677679    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"]
Sep 09 14:26:43.693858 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.693808    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:43.725319 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.725267    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-credential-socket\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.725511 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.725325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbts7\" (UniqueName: \"kubernetes.io/projected/fc1cc06f-42eb-437c-ad94-4993a82136bb-kube-api-access-dbts7\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.725511 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.725389    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-data\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.725511 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.725441    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-token\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.725663 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.725524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1cc06f-42eb-437c-ad94-4993a82136bb-istiod-ca-cert\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.725663 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.725552    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-podinfo\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.725663 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.725598    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-workload-certs\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.725663 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.725617    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-workload-socket\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.725663 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.725639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-envoy\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.820124 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.820073    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:43.826236 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.826198    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1cc06f-42eb-437c-ad94-4993a82136bb-istiod-ca-cert\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.826371 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.826259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-podinfo\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.826371 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.826302    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-workload-certs\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.826371 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.826329    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-workload-socket\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.826371 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.826361    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-envoy\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.826556 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.826426    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-credential-socket\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.826556 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.826452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbts7\" (UniqueName: \"kubernetes.io/projected/fc1cc06f-42eb-437c-ad94-4993a82136bb-kube-api-access-dbts7\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.826556 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.826481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-data\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.826556 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.826522    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-token\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.827129 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.827088    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1cc06f-42eb-437c-ad94-4993a82136bb-istiod-ca-cert\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.827129 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.827119    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-workload-certs\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.827337 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.827161    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-workload-socket\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.827337 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.827252    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-credential-socket\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.827337 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.827320    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-data\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.829348 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.829320    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-envoy\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.829572 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.829539    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-podinfo\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.835513 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.835464    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-token\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.835639 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.835580    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbts7\" (UniqueName: \"kubernetes.io/projected/fc1cc06f-42eb-437c-ad94-4993a82136bb-kube-api-access-dbts7\") pod \"e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") " pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:43.978152 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:43.978051    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:44.264116 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:44.264085    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"]
Sep 09 14:26:44.266690 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:26:44.266649    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1cc06f_42eb_437c_ad94_4993a82136bb.slice/crio-8c35d077319de38c4fe81b0db1a43387523de49f6470f52a4df78211d5f7f982 WatchSource:0}: Error finding container 8c35d077319de38c4fe81b0db1a43387523de49f6470f52a4df78211d5f7f982: Status 404 returned error can't find the container with id 8c35d077319de38c4fe81b0db1a43387523de49f6470f52a4df78211d5f7f982
Sep 09 14:26:44.269287 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:44.269240    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:26:44.269420 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:44.269346    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:26:44.269420 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:44.269405    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:26:44.948356 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:44.948314    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw" event={"ID":"fc1cc06f-42eb-437c-ad94-4993a82136bb","Type":"ContainerStarted","Data":"9907a3e38795179ab186fd8bbd0e8571debfcd4e4b5b83cba23fcf1f2dcc3bae"}
Sep 09 14:26:44.948549 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:44.948386    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw" event={"ID":"fc1cc06f-42eb-437c-ad94-4993a82136bb","Type":"ContainerStarted","Data":"8c35d077319de38c4fe81b0db1a43387523de49f6470f52a4df78211d5f7f982"}
Sep 09 14:26:44.971018 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:44.970951    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw" podStartSLOduration=1.970930592 podStartE2EDuration="1.970930592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:26:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:26:44.968794107 +0000 UTC m=+969.695334209" watchObservedRunningTime="2026-09-09 14:26:44.970930592 +0000 UTC m=+969.697470694"
Sep 09 14:26:44.978912 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:44.978867    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:45.984127 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:45.984090    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:46.914396 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:46.914350    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:46.961433 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:46.961395    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:46.962656 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:46.962627    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:26:46.986044 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:46.986002    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:48.056513 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:48.056471    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:48.165711 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:48.165662    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:48.235210 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:48.235159    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:48.636862 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:48.636816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:48.734163 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:48.734123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:26:49.252336 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:49.252296    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"]
Sep 09 14:26:49.256466 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:49.256435    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"
Sep 09 14:26:49.259081 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:49.259015    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-0da694\""
Sep 09 14:26:49.259288 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:49.259145    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-0da694-dockercfg-6r2lx\""
Sep 09 14:26:49.265343 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:49.265312    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"]
Sep 09 14:26:49.387405 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:49.387359    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt6hn\" (UniqueName: \"kubernetes.io/projected/b6a60f87-c5d6-420f-89a8-77334684712a-kube-api-access-zt6hn\") pod \"payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf\" (UID: \"b6a60f87-c5d6-420f-89a8-77334684712a\") " pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"
Sep 09 14:26:49.387595 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:49.387423    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6a60f87-c5d6-420f-89a8-77334684712a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf\" (UID: \"b6a60f87-c5d6-420f-89a8-77334684712a\") " pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"
Sep 09 14:26:49.488756 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:49.488706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt6hn\" (UniqueName: \"kubernetes.io/projected/b6a60f87-c5d6-420f-89a8-77334684712a-kube-api-access-zt6hn\") pod \"payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf\" (UID: \"b6a60f87-c5d6-420f-89a8-77334684712a\") " pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"
Sep 09 14:26:49.488961 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:49.488779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6a60f87-c5d6-420f-89a8-77334684712a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf\" (UID: \"b6a60f87-c5d6-420f-89a8-77334684712a\") " pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"
Sep 09 14:26:49.489582 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:49.489545    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6a60f87-c5d6-420f-89a8-77334684712a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf\" (UID: \"b6a60f87-c5d6-420f-89a8-77334684712a\") " pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"
Sep 09 14:26:49.502022 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:49.501984    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt6hn\" (UniqueName: \"kubernetes.io/projected/b6a60f87-c5d6-420f-89a8-77334684712a-kube-api-access-zt6hn\") pod \"payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf\" (UID: \"b6a60f87-c5d6-420f-89a8-77334684712a\") " pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"
Sep 09 14:26:49.571822 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:49.571773    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"
Sep 09 14:26:49.853906 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:49.853865    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"]
Sep 09 14:26:49.855980 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:26:49.855948    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a60f87_c5d6_420f_89a8_77334684712a.slice/crio-9705a8c1afc78977028a8f70d9cc222d086fcac61de00abcd9d404d047cf3c4e WatchSource:0}: Error finding container 9705a8c1afc78977028a8f70d9cc222d086fcac61de00abcd9d404d047cf3c4e: Status 404 returned error can't find the container with id 9705a8c1afc78977028a8f70d9cc222d086fcac61de00abcd9d404d047cf3c4e
Sep 09 14:26:49.983587 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:49.983544    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf" event={"ID":"b6a60f87-c5d6-420f-89a8-77334684712a","Type":"ContainerStarted","Data":"53c72b45ac579e92a0045f31f7a706ee5bcb9d1d62abb7b208927402b270a9fd"}
Sep 09 14:26:49.983789 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:49.983626    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"
Sep 09 14:26:49.983789 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:49.983653    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf" event={"ID":"b6a60f87-c5d6-420f-89a8-77334684712a","Type":"ContainerStarted","Data":"9705a8c1afc78977028a8f70d9cc222d086fcac61de00abcd9d404d047cf3c4e"}
Sep 09 14:26:50.002149 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:26:50.002075    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf" podStartSLOduration=1.002052422 podStartE2EDuration="1.002052422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:26:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:26:49.999692138 +0000 UTC m=+974.726232241" watchObservedRunningTime="2026-09-09 14:26:50.002052422 +0000 UTC m=+974.728592524"
Sep 09 14:27:00.992424 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:00.992332    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"
Sep 09 14:27:07.671341 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:07.671295    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:08.122998 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:08.122955    2562 generic.go:356] "Generic (PLEG): container finished" podID="fc1cc06f-42eb-437c-ad94-4993a82136bb" containerID="9907a3e38795179ab186fd8bbd0e8571debfcd4e4b5b83cba23fcf1f2dcc3bae" exitCode=0
Sep 09 14:27:08.123232 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:08.123051    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw" event={"ID":"fc1cc06f-42eb-437c-ad94-4993a82136bb","Type":"ContainerDied","Data":"9907a3e38795179ab186fd8bbd0e8571debfcd4e4b5b83cba23fcf1f2dcc3bae"}
Sep 09 14:27:08.123710 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:08.123690    2562 scope.go:117] "RemoveContainer" containerID="9907a3e38795179ab186fd8bbd0e8571debfcd4e4b5b83cba23fcf1f2dcc3bae"
Sep 09 14:27:08.125112 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:08.125077    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:27:08.125221 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:08.125201    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:27:08.125278 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:08.125260    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:27:09.134054 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:09.134005    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw" event={"ID":"fc1cc06f-42eb-437c-ad94-4993a82136bb","Type":"ContainerStarted","Data":"3cd151827e9d9be6e0c59c7fc0a620c98235718d39c59b6135ed232526a246dc"}
Sep 09 14:27:09.978570 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:09.978523    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:27:09.978801 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:09.978774    2562 patch_prober.go:28] interesting pod/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 09 14:27:09.978853 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:09.978831    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw" podUID="fc1cc06f-42eb-437c-ad94-4993a82136bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 09 14:27:10.978684 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:10.978628    2562 patch_prober.go:28] interesting pod/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 09 14:27:10.979161 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:10.978706    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw" podUID="fc1cc06f-42eb-437c-ad94-4993a82136bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 09 14:27:11.906026 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:11.905981    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:11.978829 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:11.978778    2562 patch_prober.go:28] interesting pod/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 09 14:27:11.979397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:11.978861    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw" podUID="fc1cc06f-42eb-437c-ad94-4993a82136bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 09 14:27:12.979363 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:12.979316    2562 patch_prober.go:28] interesting pod/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 09 14:27:12.979839 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:12.979397    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw" podUID="fc1cc06f-42eb-437c-ad94-4993a82136bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 09 14:27:13.568140 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:13.568087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:13.630687 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:13.630645    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:13.742960 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:13.742916    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:13.847300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:13.847159    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:13.978832 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:13.978793    2562 patch_prober.go:28] interesting pod/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 09 14:27:13.979036 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:13.978856    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw" podUID="fc1cc06f-42eb-437c-ad94-4993a82136bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 09 14:27:14.983900 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:14.983862    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:27:14.984431 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:14.984163    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:27:14.985160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:14.985141    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:27:16.518953 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:16.518910    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:23.550745 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:23.550705    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:23.653420 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:23.653376    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:24.563649 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:24.563603    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:24.662143 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:24.662098    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:27.110055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:27.109986    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:29.620267 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:29.620223    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:34.529006 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:34.528965    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:34.641796 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:34.641717    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0da694-j28qw"]
Sep 09 14:27:34.646365 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:34.646331    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0da694-j28qw"
Sep 09 14:27:34.649077 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:34.649044    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:27:34.649377 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:34.649137    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:27:34.658345 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:34.656775    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0da694-j28qw"]
Sep 09 14:27:34.779883 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:34.779760    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/305a0e6a-89f4-4a09-b64a-0000261438af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-0da694-j28qw\" (UID: \"305a0e6a-89f4-4a09-b64a-0000261438af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0da694-j28qw"
Sep 09 14:27:34.881317 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:34.881233    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/305a0e6a-89f4-4a09-b64a-0000261438af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-0da694-j28qw\" (UID: \"305a0e6a-89f4-4a09-b64a-0000261438af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0da694-j28qw"
Sep 09 14:27:34.882827 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:34.882772    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/305a0e6a-89f4-4a09-b64a-0000261438af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-0da694-j28qw\" (UID: \"305a0e6a-89f4-4a09-b64a-0000261438af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0da694-j28qw"
Sep 09 14:27:34.962800 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:34.962755    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0da694-j28qw"
Sep 09 14:27:35.261590 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:35.261533    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0da694-j28qw"]
Sep 09 14:27:35.264230 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:27:35.264194    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod305a0e6a_89f4_4a09_b64a_0000261438af.slice/crio-9beb29e852e7d536ecb3497f11059140e52addf2658eaacf840ff26f060f3366 WatchSource:0}: Error finding container 9beb29e852e7d536ecb3497f11059140e52addf2658eaacf840ff26f060f3366: Status 404 returned error can't find the container with id 9beb29e852e7d536ecb3497f11059140e52addf2658eaacf840ff26f060f3366
Sep 09 14:27:35.315249 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:35.315214    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0da694-j28qw" event={"ID":"305a0e6a-89f4-4a09-b64a-0000261438af","Type":"ContainerStarted","Data":"9beb29e852e7d536ecb3497f11059140e52addf2658eaacf840ff26f060f3366"}
Sep 09 14:27:36.246784 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:36.246746    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:36.324044 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:36.324000    2562 generic.go:356] "Generic (PLEG): container finished" podID="305a0e6a-89f4-4a09-b64a-0000261438af" containerID="275fc5e47d872c5b177311256990864f09312e557401e9d9e8bc365f0cc6fd7d" exitCode=0
Sep 09 14:27:36.324247 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:36.324056    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0da694-j28qw" event={"ID":"305a0e6a-89f4-4a09-b64a-0000261438af","Type":"ContainerDied","Data":"275fc5e47d872c5b177311256990864f09312e557401e9d9e8bc365f0cc6fd7d"}
Sep 09 14:27:36.387238 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:36.387199    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:36.487616 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:36.487575    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:37.501627 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:37.501587    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0da694-j28qw"
Sep 09 14:27:37.609885 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:37.609782    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/305a0e6a-89f4-4a09-b64a-0000261438af-maas-api-service-ca\") pod \"305a0e6a-89f4-4a09-b64a-0000261438af\" (UID: \"305a0e6a-89f4-4a09-b64a-0000261438af\") "
Sep 09 14:27:37.610224 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:37.610158    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/305a0e6a-89f4-4a09-b64a-0000261438af-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "305a0e6a-89f4-4a09-b64a-0000261438af" (UID: "305a0e6a-89f4-4a09-b64a-0000261438af"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:27:37.711656 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:37.711602    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/305a0e6a-89f4-4a09-b64a-0000261438af-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:27:38.337751 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:38.337713    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0da694-j28qw"
Sep 09 14:27:38.337751 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:38.337729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0da694-j28qw" event={"ID":"305a0e6a-89f4-4a09-b64a-0000261438af","Type":"ContainerDied","Data":"9beb29e852e7d536ecb3497f11059140e52addf2658eaacf840ff26f060f3366"}
Sep 09 14:27:38.337974 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:38.337787    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9beb29e852e7d536ecb3497f11059140e52addf2658eaacf840ff26f060f3366"
Sep 09 14:27:45.375831 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.375791    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:45.399158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.399107    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"]
Sep 09 14:27:45.399485 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.399447    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf" podUID="b6a60f87-c5d6-420f-89a8-77334684712a" containerName="payload-processing" containerID="cri-o://53c72b45ac579e92a0045f31f7a706ee5bcb9d1d62abb7b208927402b270a9fd" gracePeriod=30
Sep 09 14:27:45.475069 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.475017    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:45.563558 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.563513    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0da694-j28qw"]
Sep 09 14:27:45.566101 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.566058    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0da694-j28qw"]
Sep 09 14:27:45.621264 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.621182    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:45.705925 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.705894    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"
Sep 09 14:27:45.749478 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.749437    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:45.790694 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.790657    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6a60f87-c5d6-420f-89a8-77334684712a-plugins-config-volume\") pod \"b6a60f87-c5d6-420f-89a8-77334684712a\" (UID: \"b6a60f87-c5d6-420f-89a8-77334684712a\") "
Sep 09 14:27:45.790918 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.790744    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt6hn\" (UniqueName: \"kubernetes.io/projected/b6a60f87-c5d6-420f-89a8-77334684712a-kube-api-access-zt6hn\") pod \"b6a60f87-c5d6-420f-89a8-77334684712a\" (UID: \"b6a60f87-c5d6-420f-89a8-77334684712a\") "
Sep 09 14:27:45.791110 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.791076    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6a60f87-c5d6-420f-89a8-77334684712a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b6a60f87-c5d6-420f-89a8-77334684712a" (UID: "b6a60f87-c5d6-420f-89a8-77334684712a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:27:45.792984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.792943    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6a60f87-c5d6-420f-89a8-77334684712a-kube-api-access-zt6hn" (OuterVolumeSpecName: "kube-api-access-zt6hn") pod "b6a60f87-c5d6-420f-89a8-77334684712a" (UID: "b6a60f87-c5d6-420f-89a8-77334684712a"). InnerVolumeSpecName "kube-api-access-zt6hn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:27:45.802571 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.802525    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="305a0e6a-89f4-4a09-b64a-0000261438af" path="/var/lib/kubelet/pods/305a0e6a-89f4-4a09-b64a-0000261438af/volumes"
Sep 09 14:27:45.892033 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.891988    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6a60f87-c5d6-420f-89a8-77334684712a-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:27:45.892033 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.892033    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt6hn\" (UniqueName: \"kubernetes.io/projected/b6a60f87-c5d6-420f-89a8-77334684712a-kube-api-access-zt6hn\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:27:45.973483 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:45.973388    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:46.400398 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:46.400357    2562 generic.go:356] "Generic (PLEG): container finished" podID="b6a60f87-c5d6-420f-89a8-77334684712a" containerID="53c72b45ac579e92a0045f31f7a706ee5bcb9d1d62abb7b208927402b270a9fd" exitCode=0
Sep 09 14:27:46.400868 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:46.400409    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"
Sep 09 14:27:46.400868 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:46.400420    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf" event={"ID":"b6a60f87-c5d6-420f-89a8-77334684712a","Type":"ContainerDied","Data":"53c72b45ac579e92a0045f31f7a706ee5bcb9d1d62abb7b208927402b270a9fd"}
Sep 09 14:27:46.400868 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:46.400470    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf" event={"ID":"b6a60f87-c5d6-420f-89a8-77334684712a","Type":"ContainerDied","Data":"9705a8c1afc78977028a8f70d9cc222d086fcac61de00abcd9d404d047cf3c4e"}
Sep 09 14:27:46.400868 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:46.400494    2562 scope.go:117] "RemoveContainer" containerID="53c72b45ac579e92a0045f31f7a706ee5bcb9d1d62abb7b208927402b270a9fd"
Sep 09 14:27:46.419434 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:46.419406    2562 scope.go:117] "RemoveContainer" containerID="53c72b45ac579e92a0045f31f7a706ee5bcb9d1d62abb7b208927402b270a9fd"
Sep 09 14:27:46.419896 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:27:46.419871    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53c72b45ac579e92a0045f31f7a706ee5bcb9d1d62abb7b208927402b270a9fd\": container with ID starting with 53c72b45ac579e92a0045f31f7a706ee5bcb9d1d62abb7b208927402b270a9fd not found: ID does not exist" containerID="53c72b45ac579e92a0045f31f7a706ee5bcb9d1d62abb7b208927402b270a9fd"
Sep 09 14:27:46.419964 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:46.419908    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53c72b45ac579e92a0045f31f7a706ee5bcb9d1d62abb7b208927402b270a9fd"} err="failed to get container status \"53c72b45ac579e92a0045f31f7a706ee5bcb9d1d62abb7b208927402b270a9fd\": rpc error: code = NotFound desc = could not find container \"53c72b45ac579e92a0045f31f7a706ee5bcb9d1d62abb7b208927402b270a9fd\": container with ID starting with 53c72b45ac579e92a0045f31f7a706ee5bcb9d1d62abb7b208927402b270a9fd not found: ID does not exist"
Sep 09 14:27:46.421193 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:46.421154    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"]
Sep 09 14:27:46.425108 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:46.425074    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-0da694-679f48dd65-h7rpf"]
Sep 09 14:27:47.090109 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:47.090065    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:47.801075 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:47.801029    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6a60f87-c5d6-420f-89a8-77334684712a" path="/var/lib/kubelet/pods/b6a60f87-c5d6-420f-89a8-77334684712a/volumes"
Sep 09 14:27:47.828283 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:47.828243    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:52.012466 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:52.012419    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:52.113607 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:52.113549    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:52.248506 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:52.248454    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"]
Sep 09 14:27:52.248775 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:52.248742    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw" podUID="fc1cc06f-42eb-437c-ad94-4993a82136bb" containerName="istio-proxy" containerID="cri-o://3cd151827e9d9be6e0c59c7fc0a620c98235718d39c59b6135ed232526a246dc" gracePeriod=30
Sep 09 14:27:52.276044 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:52.275950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:52.710803 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:52.710763    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:53.015924 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:53.015810    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:53.112439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:53.112402    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:54.041896 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:54.041841    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:54.145155 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:54.145115    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:54.243114 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:54.243072    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:55.857838 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:55.857794    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:55.959547 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:55.959508    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:56.610827 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:56.610781    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:27:57.481107 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.481071    2562 generic.go:356] "Generic (PLEG): container finished" podID="fc1cc06f-42eb-437c-ad94-4993a82136bb" containerID="3cd151827e9d9be6e0c59c7fc0a620c98235718d39c59b6135ed232526a246dc" exitCode=0
Sep 09 14:27:57.481644 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.481144    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw" event={"ID":"fc1cc06f-42eb-437c-ad94-4993a82136bb","Type":"ContainerDied","Data":"3cd151827e9d9be6e0c59c7fc0a620c98235718d39c59b6135ed232526a246dc"}
Sep 09 14:27:57.481644 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.481237    2562 scope.go:117] "RemoveContainer" containerID="9907a3e38795179ab186fd8bbd0e8571debfcd4e4b5b83cba23fcf1f2dcc3bae"
Sep 09 14:27:57.528307 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.528221    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:27:57.614183 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614134    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1cc06f-42eb-437c-ad94-4993a82136bb-istiod-ca-cert\") pod \"fc1cc06f-42eb-437c-ad94-4993a82136bb\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") "
Sep 09 14:27:57.614416 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614240    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-data\") pod \"fc1cc06f-42eb-437c-ad94-4993a82136bb\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") "
Sep 09 14:27:57.614416 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614263    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-credential-socket\") pod \"fc1cc06f-42eb-437c-ad94-4993a82136bb\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") "
Sep 09 14:27:57.614416 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614313    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-workload-certs\") pod \"fc1cc06f-42eb-437c-ad94-4993a82136bb\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") "
Sep 09 14:27:57.614416 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614349    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-workload-socket\") pod \"fc1cc06f-42eb-437c-ad94-4993a82136bb\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") "
Sep 09 14:27:57.614416 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614377    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-podinfo\") pod \"fc1cc06f-42eb-437c-ad94-4993a82136bb\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") "
Sep 09 14:27:57.614709 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614429    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-token\") pod \"fc1cc06f-42eb-437c-ad94-4993a82136bb\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") "
Sep 09 14:27:57.614709 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614459    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-envoy\") pod \"fc1cc06f-42eb-437c-ad94-4993a82136bb\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") "
Sep 09 14:27:57.614709 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614520    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbts7\" (UniqueName: \"kubernetes.io/projected/fc1cc06f-42eb-437c-ad94-4993a82136bb-kube-api-access-dbts7\") pod \"fc1cc06f-42eb-437c-ad94-4993a82136bb\" (UID: \"fc1cc06f-42eb-437c-ad94-4993a82136bb\") "
Sep 09 14:27:57.614709 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614547    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc1cc06f-42eb-437c-ad94-4993a82136bb" (UID: "fc1cc06f-42eb-437c-ad94-4993a82136bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:27:57.614709 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614625    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc1cc06f-42eb-437c-ad94-4993a82136bb" (UID: "fc1cc06f-42eb-437c-ad94-4993a82136bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:27:57.615009 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614704    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc1cc06f-42eb-437c-ad94-4993a82136bb" (UID: "fc1cc06f-42eb-437c-ad94-4993a82136bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:27:57.615009 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614735    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1cc06f-42eb-437c-ad94-4993a82136bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc1cc06f-42eb-437c-ad94-4993a82136bb" (UID: "fc1cc06f-42eb-437c-ad94-4993a82136bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:27:57.615009 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614889    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc1cc06f-42eb-437c-ad94-4993a82136bb-istiod-ca-cert\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:27:57.615009 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614909    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-data\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:27:57.615009 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614924    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-workload-certs\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:27:57.615009 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614938    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-workload-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:27:57.615009 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.614994    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc1cc06f-42eb-437c-ad94-4993a82136bb" (UID: "fc1cc06f-42eb-437c-ad94-4993a82136bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:27:57.616874 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.616847    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc1cc06f-42eb-437c-ad94-4993a82136bb-kube-api-access-dbts7" (OuterVolumeSpecName: "kube-api-access-dbts7") pod "fc1cc06f-42eb-437c-ad94-4993a82136bb" (UID: "fc1cc06f-42eb-437c-ad94-4993a82136bb"). InnerVolumeSpecName "kube-api-access-dbts7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:27:57.617015 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.616907    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc1cc06f-42eb-437c-ad94-4993a82136bb" (UID: "fc1cc06f-42eb-437c-ad94-4993a82136bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:27:57.617124 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.617107    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc1cc06f-42eb-437c-ad94-4993a82136bb" (UID: "fc1cc06f-42eb-437c-ad94-4993a82136bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:27:57.617213 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.617193    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc1cc06f-42eb-437c-ad94-4993a82136bb" (UID: "fc1cc06f-42eb-437c-ad94-4993a82136bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:27:57.716455 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.716399    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbts7\" (UniqueName: \"kubernetes.io/projected/fc1cc06f-42eb-437c-ad94-4993a82136bb-kube-api-access-dbts7\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:27:57.716455 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.716443    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-credential-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:27:57.716455 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.716460    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-podinfo\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:27:57.716728 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.716472    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-token\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:27:57.716728 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:57.716483    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc1cc06f-42eb-437c-ad94-4993a82136bb-istio-envoy\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:27:58.489028 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:58.488985    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw" event={"ID":"fc1cc06f-42eb-437c-ad94-4993a82136bb","Type":"ContainerDied","Data":"8c35d077319de38c4fe81b0db1a43387523de49f6470f52a4df78211d5f7f982"}
Sep 09 14:27:58.489028 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:58.489021    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"
Sep 09 14:27:58.489624 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:58.489054    2562 scope.go:117] "RemoveContainer" containerID="3cd151827e9d9be6e0c59c7fc0a620c98235718d39c59b6135ed232526a246dc"
Sep 09 14:27:58.506153 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:58.506115    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"]
Sep 09 14:27:58.509533 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:58.509489    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-0da694-openshift-default-7f7db87656-bq9cw"]
Sep 09 14:27:59.800282 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:27:59.800242    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc1cc06f-42eb-437c-ad94-4993a82136bb" path="/var/lib/kubelet/pods/fc1cc06f-42eb-437c-ad94-4993a82136bb/volumes"
Sep 09 14:28:01.128535 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:01.128492    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:02.816208 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:02.816145    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:02.918086 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:02.918046    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:03.491822 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:03.491741    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:09.760856 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:09.760815    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:09.827879 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:09.827839    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:09.982690 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:09.982631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:10.305236 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:10.305195    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:10.616732 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:10.616603    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:13.310005 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:13.309964    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:13.408800 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:13.408759    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:14.436715 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:14.436664    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:14.537538 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:14.537492    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:14.692433 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:14.692326    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:14.917554 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:14.917518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:14.994456 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:14.994335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:15.030718 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.030674    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"]
Sep 09 14:28:15.031201 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.031155    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1cc06f-42eb-437c-ad94-4993a82136bb" containerName="istio-proxy"
Sep 09 14:28:15.031201 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.031184    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1cc06f-42eb-437c-ad94-4993a82136bb" containerName="istio-proxy"
Sep 09 14:28:15.031201 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.031195    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a60f87-c5d6-420f-89a8-77334684712a" containerName="payload-processing"
Sep 09 14:28:15.031201 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.031201    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a60f87-c5d6-420f-89a8-77334684712a" containerName="payload-processing"
Sep 09 14:28:15.031351 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.031228    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="305a0e6a-89f4-4a09-b64a-0000261438af" containerName="revoke-keys"
Sep 09 14:28:15.031351 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.031234    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="305a0e6a-89f4-4a09-b64a-0000261438af" containerName="revoke-keys"
Sep 09 14:28:15.031351 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.031295    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="305a0e6a-89f4-4a09-b64a-0000261438af" containerName="revoke-keys"
Sep 09 14:28:15.031351 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.031303    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6a60f87-c5d6-420f-89a8-77334684712a" containerName="payload-processing"
Sep 09 14:28:15.031351 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.031311    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc1cc06f-42eb-437c-ad94-4993a82136bb" containerName="istio-proxy"
Sep 09 14:28:15.034422 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.034397    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"
Sep 09 14:28:15.036826 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.036794    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-d94c06b6-dockercfg-4sq5w\""
Sep 09 14:28:15.036985 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.036810    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-d94c06b6\""
Sep 09 14:28:15.047582 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.047541    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"]
Sep 09 14:28:15.087721 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.087671    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b5db717-7cae-49e1-8785-d5618f93881b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5\" (UID: \"3b5db717-7cae-49e1-8785-d5618f93881b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"
Sep 09 14:28:15.087721 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.087726    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdbrr\" (UniqueName: \"kubernetes.io/projected/3b5db717-7cae-49e1-8785-d5618f93881b-kube-api-access-mdbrr\") pod \"payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5\" (UID: \"3b5db717-7cae-49e1-8785-d5618f93881b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"
Sep 09 14:28:15.188384 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.188337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b5db717-7cae-49e1-8785-d5618f93881b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5\" (UID: \"3b5db717-7cae-49e1-8785-d5618f93881b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"
Sep 09 14:28:15.188622 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.188399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdbrr\" (UniqueName: \"kubernetes.io/projected/3b5db717-7cae-49e1-8785-d5618f93881b-kube-api-access-mdbrr\") pod \"payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5\" (UID: \"3b5db717-7cae-49e1-8785-d5618f93881b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"
Sep 09 14:28:15.189287 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.189261    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b5db717-7cae-49e1-8785-d5618f93881b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5\" (UID: \"3b5db717-7cae-49e1-8785-d5618f93881b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"
Sep 09 14:28:15.198320 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.198270    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdbrr\" (UniqueName: \"kubernetes.io/projected/3b5db717-7cae-49e1-8785-d5618f93881b-kube-api-access-mdbrr\") pod \"payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5\" (UID: \"3b5db717-7cae-49e1-8785-d5618f93881b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"
Sep 09 14:28:15.300146 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.300042    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:15.348455 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.348405    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"
Sep 09 14:28:15.422092 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.421863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:15.636314 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.636276    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:15.647124 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.647036    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"]
Sep 09 14:28:15.650637 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:28:15.650601    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b5db717_7cae_49e1_8785_d5618f93881b.slice/crio-49fc05693b4413b5147b77f5defc3d2f00c2cf16cb52e1496a2b3ae1ec7ef028 WatchSource:0}: Error finding container 49fc05693b4413b5147b77f5defc3d2f00c2cf16cb52e1496a2b3ae1ec7ef028: Status 404 returned error can't find the container with id 49fc05693b4413b5147b77f5defc3d2f00c2cf16cb52e1496a2b3ae1ec7ef028
Sep 09 14:28:15.749063 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:15.749018    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:16.610917 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:16.610874    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5" event={"ID":"3b5db717-7cae-49e1-8785-d5618f93881b","Type":"ContainerStarted","Data":"18ff0461535a41e6fded8f4c3877a34f3e4de2dd8f87a5a44fc58c9cdff55407"}
Sep 09 14:28:16.611129 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:16.610938    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5" event={"ID":"3b5db717-7cae-49e1-8785-d5618f93881b","Type":"ContainerStarted","Data":"49fc05693b4413b5147b77f5defc3d2f00c2cf16cb52e1496a2b3ae1ec7ef028"}
Sep 09 14:28:16.611129 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:16.610963    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"
Sep 09 14:28:16.630336 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:16.630262    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5" podStartSLOduration=1.6302410969999999 podStartE2EDuration="1.630241097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:28:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:28:16.627700048 +0000 UTC m=+1061.354240165" watchObservedRunningTime="2026-09-09 14:28:16.630241097 +0000 UTC m=+1061.356781200"
Sep 09 14:28:20.828789 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:20.828749    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:27.619727 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:27.619693    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"
Sep 09 14:28:27.659339 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:27.659295    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:28.851673 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:28.851567    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:28.940738 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:28.940694    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk"]
Sep 09 14:28:28.941355 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:28.941318    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1cc06f-42eb-437c-ad94-4993a82136bb" containerName="istio-proxy"
Sep 09 14:28:28.941355 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:28.941343    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1cc06f-42eb-437c-ad94-4993a82136bb" containerName="istio-proxy"
Sep 09 14:28:28.941574 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:28.941480    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc1cc06f-42eb-437c-ad94-4993a82136bb" containerName="istio-proxy"
Sep 09 14:28:28.945583 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:28.945542    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk"
Sep 09 14:28:28.948052 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:28.948017    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:28:28.948238 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:28.948026    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:28:28.953525 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:28.953485    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk"]
Sep 09 14:28:29.025584 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:29.025532    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8eaaf93-b766-48e9-9cee-8c48bbe1876f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk\" (UID: \"f8eaaf93-b766-48e9-9cee-8c48bbe1876f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk"
Sep 09 14:28:29.104899 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:29.104801    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:29.126418 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:29.126371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8eaaf93-b766-48e9-9cee-8c48bbe1876f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk\" (UID: \"f8eaaf93-b766-48e9-9cee-8c48bbe1876f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk"
Sep 09 14:28:29.127066 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:29.127043    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8eaaf93-b766-48e9-9cee-8c48bbe1876f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk\" (UID: \"f8eaaf93-b766-48e9-9cee-8c48bbe1876f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk"
Sep 09 14:28:29.259520 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:29.259475    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk"
Sep 09 14:28:29.538044 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:29.538004    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk"]
Sep 09 14:28:29.540958 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:28:29.540923    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8eaaf93_b766_48e9_9cee_8c48bbe1876f.slice/crio-cf89ded3541c73d2304fb6bfeff607fc31d64c753342af08d80fd80a846f20af WatchSource:0}: Error finding container cf89ded3541c73d2304fb6bfeff607fc31d64c753342af08d80fd80a846f20af: Status 404 returned error can't find the container with id cf89ded3541c73d2304fb6bfeff607fc31d64c753342af08d80fd80a846f20af
Sep 09 14:28:29.693666 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:29.693603    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk" event={"ID":"f8eaaf93-b766-48e9-9cee-8c48bbe1876f","Type":"ContainerStarted","Data":"cf89ded3541c73d2304fb6bfeff607fc31d64c753342af08d80fd80a846f20af"}
Sep 09 14:28:30.706184 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:30.706070    2562 generic.go:356] "Generic (PLEG): container finished" podID="f8eaaf93-b766-48e9-9cee-8c48bbe1876f" containerID="74dd5e01ad0f3345c18c886b2df893be53ec62cebcd21020055890b63f9fa48b" exitCode=0
Sep 09 14:28:30.706568 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:30.706155    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk" event={"ID":"f8eaaf93-b766-48e9-9cee-8c48bbe1876f","Type":"ContainerDied","Data":"74dd5e01ad0f3345c18c886b2df893be53ec62cebcd21020055890b63f9fa48b"}
Sep 09 14:28:31.863093 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:31.863067    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk"
Sep 09 14:28:31.957259 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:31.957195    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8eaaf93-b766-48e9-9cee-8c48bbe1876f-maas-api-service-ca\") pod \"f8eaaf93-b766-48e9-9cee-8c48bbe1876f\" (UID: \"f8eaaf93-b766-48e9-9cee-8c48bbe1876f\") "
Sep 09 14:28:31.957608 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:31.957583    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8eaaf93-b766-48e9-9cee-8c48bbe1876f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f8eaaf93-b766-48e9-9cee-8c48bbe1876f" (UID: "f8eaaf93-b766-48e9-9cee-8c48bbe1876f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:28:32.058264 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:32.058230    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8eaaf93-b766-48e9-9cee-8c48bbe1876f-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:32.721344 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:32.721311    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk"
Sep 09 14:28:32.721344 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:32.721337    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk" event={"ID":"f8eaaf93-b766-48e9-9cee-8c48bbe1876f","Type":"ContainerDied","Data":"cf89ded3541c73d2304fb6bfeff607fc31d64c753342af08d80fd80a846f20af"}
Sep 09 14:28:32.721655 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:32.721390    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf89ded3541c73d2304fb6bfeff607fc31d64c753342af08d80fd80a846f20af"
Sep 09 14:28:35.389745 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:35.389702    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:38.215957 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:38.215891    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:38.870628 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:38.870585    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:38.967031 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:38.966983    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:39.149019 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:39.148909    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:39.388591 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:39.388546    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:39.767325 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:39.767283    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:39.787049 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:39.786992    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"]
Sep 09 14:28:39.787370 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:39.787312    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q" podUID="51ff6878-d559-4f48-945e-e0ba6db97bb8" containerName="payload-processing" containerID="cri-o://88752478c17b9ddf1635a5c532354de1bb8984017a811efc463e473ac44a178f" gracePeriod=30
Sep 09 14:28:39.868196 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:39.868147    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:39.944094 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:39.944053    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk"]
Sep 09 14:28:39.948966 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:39.948926    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:39.949475 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:39.949453    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a0fa5a-f4lgk"]
Sep 09 14:28:40.022237 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.022095    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:40.091282 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.091245    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"
Sep 09 14:28:40.247436 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.247382    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvqsk\" (UniqueName: \"kubernetes.io/projected/51ff6878-d559-4f48-945e-e0ba6db97bb8-kube-api-access-gvqsk\") pod \"51ff6878-d559-4f48-945e-e0ba6db97bb8\" (UID: \"51ff6878-d559-4f48-945e-e0ba6db97bb8\") "
Sep 09 14:28:40.247673 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.247457    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51ff6878-d559-4f48-945e-e0ba6db97bb8-plugins-config-volume\") pod \"51ff6878-d559-4f48-945e-e0ba6db97bb8\" (UID: \"51ff6878-d559-4f48-945e-e0ba6db97bb8\") "
Sep 09 14:28:40.247836 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.247807    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ff6878-d559-4f48-945e-e0ba6db97bb8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "51ff6878-d559-4f48-945e-e0ba6db97bb8" (UID: "51ff6878-d559-4f48-945e-e0ba6db97bb8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:28:40.249745 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.249715    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ff6878-d559-4f48-945e-e0ba6db97bb8-kube-api-access-gvqsk" (OuterVolumeSpecName: "kube-api-access-gvqsk") pod "51ff6878-d559-4f48-945e-e0ba6db97bb8" (UID: "51ff6878-d559-4f48-945e-e0ba6db97bb8"). InnerVolumeSpecName "kube-api-access-gvqsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:28:40.318845 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.318798    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:40.348989 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.348944    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvqsk\" (UniqueName: \"kubernetes.io/projected/51ff6878-d559-4f48-945e-e0ba6db97bb8-kube-api-access-gvqsk\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:40.348989 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.348979    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/51ff6878-d559-4f48-945e-e0ba6db97bb8-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:40.773546 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.773453    2562 generic.go:356] "Generic (PLEG): container finished" podID="51ff6878-d559-4f48-945e-e0ba6db97bb8" containerID="88752478c17b9ddf1635a5c532354de1bb8984017a811efc463e473ac44a178f" exitCode=0
Sep 09 14:28:40.773546 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.773506    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"
Sep 09 14:28:40.773546 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.773532    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q" event={"ID":"51ff6878-d559-4f48-945e-e0ba6db97bb8","Type":"ContainerDied","Data":"88752478c17b9ddf1635a5c532354de1bb8984017a811efc463e473ac44a178f"}
Sep 09 14:28:40.774158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.773616    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q" event={"ID":"51ff6878-d559-4f48-945e-e0ba6db97bb8","Type":"ContainerDied","Data":"91edc0d74a2a55199ef981e79cd0850a0693716f6ba54a8d764f4991c0caaa02"}
Sep 09 14:28:40.774158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.773658    2562 scope.go:117] "RemoveContainer" containerID="88752478c17b9ddf1635a5c532354de1bb8984017a811efc463e473ac44a178f"
Sep 09 14:28:40.784040 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.784017    2562 scope.go:117] "RemoveContainer" containerID="88752478c17b9ddf1635a5c532354de1bb8984017a811efc463e473ac44a178f"
Sep 09 14:28:40.784432 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:28:40.784412    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88752478c17b9ddf1635a5c532354de1bb8984017a811efc463e473ac44a178f\": container with ID starting with 88752478c17b9ddf1635a5c532354de1bb8984017a811efc463e473ac44a178f not found: ID does not exist" containerID="88752478c17b9ddf1635a5c532354de1bb8984017a811efc463e473ac44a178f"
Sep 09 14:28:40.784494 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.784453    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88752478c17b9ddf1635a5c532354de1bb8984017a811efc463e473ac44a178f"} err="failed to get container status \"88752478c17b9ddf1635a5c532354de1bb8984017a811efc463e473ac44a178f\": rpc error: code = NotFound desc = could not find container \"88752478c17b9ddf1635a5c532354de1bb8984017a811efc463e473ac44a178f\": container with ID starting with 88752478c17b9ddf1635a5c532354de1bb8984017a811efc463e473ac44a178f not found: ID does not exist"
Sep 09 14:28:40.796580 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.796538    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"]
Sep 09 14:28:40.800682 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:40.800638    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a0fa5a-77bbcdd869-5hh8q"]
Sep 09 14:28:41.801188 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:41.801123    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51ff6878-d559-4f48-945e-e0ba6db97bb8" path="/var/lib/kubelet/pods/51ff6878-d559-4f48-945e-e0ba6db97bb8/volumes"
Sep 09 14:28:41.801710 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:41.801533    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8eaaf93-b766-48e9-9cee-8c48bbe1876f" path="/var/lib/kubelet/pods/f8eaaf93-b766-48e9-9cee-8c48bbe1876f/volumes"
Sep 09 14:28:42.685373 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:42.685310    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:45.386805 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:45.386742    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:45.486840 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:45.486797    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:45.715124 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:45.714998    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl"]
Sep 09 14:28:45.715591 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:45.715568    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ff6878-d559-4f48-945e-e0ba6db97bb8" containerName="payload-processing"
Sep 09 14:28:45.715693 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:45.715593    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ff6878-d559-4f48-945e-e0ba6db97bb8" containerName="payload-processing"
Sep 09 14:28:45.715693 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:45.715605    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8eaaf93-b766-48e9-9cee-8c48bbe1876f" containerName="revoke-keys"
Sep 09 14:28:45.715693 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:45.715612    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8eaaf93-b766-48e9-9cee-8c48bbe1876f" containerName="revoke-keys"
Sep 09 14:28:45.715839 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:45.715718    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="51ff6878-d559-4f48-945e-e0ba6db97bb8" containerName="payload-processing"
Sep 09 14:28:45.715839 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:45.715734    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8eaaf93-b766-48e9-9cee-8c48bbe1876f" containerName="revoke-keys"
Sep 09 14:28:45.720357 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:45.720323    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl"
Sep 09 14:28:45.723497 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:45.723462    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:28:45.723823 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:45.723513    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:28:45.725870 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:45.725840    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl"]
Sep 09 14:28:45.802269 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:45.802228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8143506-8fcc-453b-846e-d450517f078f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl\" (UID: \"c8143506-8fcc-453b-846e-d450517f078f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl"
Sep 09 14:28:45.903655 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:45.903615    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8143506-8fcc-453b-846e-d450517f078f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl\" (UID: \"c8143506-8fcc-453b-846e-d450517f078f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl"
Sep 09 14:28:45.904386 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:45.904357    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8143506-8fcc-453b-846e-d450517f078f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl\" (UID: \"c8143506-8fcc-453b-846e-d450517f078f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl"
Sep 09 14:28:46.028861 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:46.028749    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:46.033424 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:46.033388    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl"
Sep 09 14:28:46.341591 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:46.341541    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl"]
Sep 09 14:28:46.344335 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:28:46.344295    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8143506_8fcc_453b_846e_d450517f078f.slice/crio-66f2ebf06567335c08a8adc972d4bff0518554db0cd3d9f2651c908448f82ee0 WatchSource:0}: Error finding container 66f2ebf06567335c08a8adc972d4bff0518554db0cd3d9f2651c908448f82ee0: Status 404 returned error can't find the container with id 66f2ebf06567335c08a8adc972d4bff0518554db0cd3d9f2651c908448f82ee0
Sep 09 14:28:46.816762 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:46.816725    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl" event={"ID":"c8143506-8fcc-453b-846e-d450517f078f","Type":"ContainerStarted","Data":"b41299d9ed91469abf32e6d91f963ed834f79dcbf3d4d6006c3483cfd5d10c64"}
Sep 09 14:28:46.817244 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:46.816792    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl" event={"ID":"c8143506-8fcc-453b-846e-d450517f078f","Type":"ContainerStarted","Data":"66f2ebf06567335c08a8adc972d4bff0518554db0cd3d9f2651c908448f82ee0"}
Sep 09 14:28:46.832552 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:46.832478    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl" podStartSLOduration=1.832447771 podStartE2EDuration="1.832447771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:28:46.831801044 +0000 UTC m=+1091.558341147" watchObservedRunningTime="2026-09-09 14:28:46.832447771 +0000 UTC m=+1091.558987873"
Sep 09 14:28:47.002897 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:47.002794    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:47.103732 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:47.103692    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:47.238125 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:47.238085    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"]
Sep 09 14:28:47.238748 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:47.238707    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d" podUID="59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" containerName="istio-proxy" containerID="cri-o://f25556d688f38d3c03ebdd1f30a4edc7c1c9836bc03eda85614f7ff12bf255d5" gracePeriod=30
Sep 09 14:28:47.261790 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:47.261675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:47.825742 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:47.825706    2562 generic.go:356] "Generic (PLEG): container finished" podID="c8143506-8fcc-453b-846e-d450517f078f" containerID="b41299d9ed91469abf32e6d91f963ed834f79dcbf3d4d6006c3483cfd5d10c64" exitCode=0
Sep 09 14:28:47.826231 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:47.825802    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl" event={"ID":"c8143506-8fcc-453b-846e-d450517f078f","Type":"ContainerDied","Data":"b41299d9ed91469abf32e6d91f963ed834f79dcbf3d4d6006c3483cfd5d10c64"}
Sep 09 14:28:47.837556 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:47.837508    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:48.982280 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:48.982247    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl"
Sep 09 14:28:49.136733 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:49.136630    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8143506-8fcc-453b-846e-d450517f078f-maas-api-service-ca\") pod \"c8143506-8fcc-453b-846e-d450517f078f\" (UID: \"c8143506-8fcc-453b-846e-d450517f078f\") "
Sep 09 14:28:49.137066 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:49.137040    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8143506-8fcc-453b-846e-d450517f078f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c8143506-8fcc-453b-846e-d450517f078f" (UID: "c8143506-8fcc-453b-846e-d450517f078f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:28:49.238427 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:49.238386    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8143506-8fcc-453b-846e-d450517f078f-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:49.842900 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:49.842869    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl"
Sep 09 14:28:49.843128 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:49.842900    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl" event={"ID":"c8143506-8fcc-453b-846e-d450517f078f","Type":"ContainerDied","Data":"66f2ebf06567335c08a8adc972d4bff0518554db0cd3d9f2651c908448f82ee0"}
Sep 09 14:28:49.843128 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:49.842956    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66f2ebf06567335c08a8adc972d4bff0518554db0cd3d9f2651c908448f82ee0"
Sep 09 14:28:52.514356 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.514283    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:28:52.675020 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.674978    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-workload-socket\") pod \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") "
Sep 09 14:28:52.675248 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675041    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-podinfo\") pod \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") "
Sep 09 14:28:52.675248 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675075    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-workload-certs\") pod \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") "
Sep 09 14:28:52.675248 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675143    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istiod-ca-cert\") pod \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") "
Sep 09 14:28:52.675248 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675216    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kc24k\" (UniqueName: \"kubernetes.io/projected/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-kube-api-access-kc24k\") pod \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") "
Sep 09 14:28:52.675248 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675244    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-data\") pod \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") "
Sep 09 14:28:52.675550 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675314    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-credential-socket\") pod \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") "
Sep 09 14:28:52.675550 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675364    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-token\") pod \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") "
Sep 09 14:28:52.675550 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675393    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-envoy\") pod \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\" (UID: \"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e\") "
Sep 09 14:28:52.675550 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675397    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" (UID: "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:28:52.675550 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675473    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" (UID: "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:28:52.675793 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675594    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-data" (OuterVolumeSpecName: "istio-data") pod "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" (UID: "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:28:52.675793 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675625    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" (UID: "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:28:52.675793 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675694    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" (UID: "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:28:52.675793 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675783    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-workload-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:52.676004 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675805    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-workload-certs\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:52.676004 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675818    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istiod-ca-cert\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:52.676004 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675832    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-data\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:52.676004 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.675845    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-credential-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:52.677533 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.677501    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" (UID: "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:28:52.677675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.677602    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" (UID: "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:28:52.677675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.677604    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-token" (OuterVolumeSpecName: "istio-token") pod "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" (UID: "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:28:52.677885 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.677860    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-kube-api-access-kc24k" (OuterVolumeSpecName: "kube-api-access-kc24k") pod "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" (UID: "59d2f33a-a93b-4818-8ba9-d9d1a55fd02e"). InnerVolumeSpecName "kube-api-access-kc24k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:28:52.776513 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.776413    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-token\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:52.776513 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.776446    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-envoy\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:52.776513 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.776456    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-istio-podinfo\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:52.776513 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.776467    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kc24k\" (UniqueName: \"kubernetes.io/projected/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e-kube-api-access-kc24k\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:52.864228 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.864188    2562 generic.go:356] "Generic (PLEG): container finished" podID="59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" containerID="f25556d688f38d3c03ebdd1f30a4edc7c1c9836bc03eda85614f7ff12bf255d5" exitCode=0
Sep 09 14:28:52.864429 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.864240    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"
Sep 09 14:28:52.864429 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.864267    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d" event={"ID":"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e","Type":"ContainerDied","Data":"f25556d688f38d3c03ebdd1f30a4edc7c1c9836bc03eda85614f7ff12bf255d5"}
Sep 09 14:28:52.864429 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.864328    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d" event={"ID":"59d2f33a-a93b-4818-8ba9-d9d1a55fd02e","Type":"ContainerDied","Data":"1c87f4729aeb0a76714b2a63be9dfa60e794efe49f3a0b8f4b85312da6358624"}
Sep 09 14:28:52.864429 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.864352    2562 scope.go:117] "RemoveContainer" containerID="f25556d688f38d3c03ebdd1f30a4edc7c1c9836bc03eda85614f7ff12bf255d5"
Sep 09 14:28:52.875116 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.875089    2562 scope.go:117] "RemoveContainer" containerID="3698419f9e5ec088251b187687617fce1d424f2c0354dfbb15681460798c9031"
Sep 09 14:28:52.885260 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.885229    2562 scope.go:117] "RemoveContainer" containerID="f25556d688f38d3c03ebdd1f30a4edc7c1c9836bc03eda85614f7ff12bf255d5"
Sep 09 14:28:52.885664 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:28:52.885644    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f25556d688f38d3c03ebdd1f30a4edc7c1c9836bc03eda85614f7ff12bf255d5\": container with ID starting with f25556d688f38d3c03ebdd1f30a4edc7c1c9836bc03eda85614f7ff12bf255d5 not found: ID does not exist" containerID="f25556d688f38d3c03ebdd1f30a4edc7c1c9836bc03eda85614f7ff12bf255d5"
Sep 09 14:28:52.885721 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.885677    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f25556d688f38d3c03ebdd1f30a4edc7c1c9836bc03eda85614f7ff12bf255d5"} err="failed to get container status \"f25556d688f38d3c03ebdd1f30a4edc7c1c9836bc03eda85614f7ff12bf255d5\": rpc error: code = NotFound desc = could not find container \"f25556d688f38d3c03ebdd1f30a4edc7c1c9836bc03eda85614f7ff12bf255d5\": container with ID starting with f25556d688f38d3c03ebdd1f30a4edc7c1c9836bc03eda85614f7ff12bf255d5 not found: ID does not exist"
Sep 09 14:28:52.885721 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.885702    2562 scope.go:117] "RemoveContainer" containerID="3698419f9e5ec088251b187687617fce1d424f2c0354dfbb15681460798c9031"
Sep 09 14:28:52.886056 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:28:52.886030    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3698419f9e5ec088251b187687617fce1d424f2c0354dfbb15681460798c9031\": container with ID starting with 3698419f9e5ec088251b187687617fce1d424f2c0354dfbb15681460798c9031 not found: ID does not exist" containerID="3698419f9e5ec088251b187687617fce1d424f2c0354dfbb15681460798c9031"
Sep 09 14:28:52.886131 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.886062    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3698419f9e5ec088251b187687617fce1d424f2c0354dfbb15681460798c9031"} err="failed to get container status \"3698419f9e5ec088251b187687617fce1d424f2c0354dfbb15681460798c9031\": rpc error: code = NotFound desc = could not find container \"3698419f9e5ec088251b187687617fce1d424f2c0354dfbb15681460798c9031\": container with ID starting with 3698419f9e5ec088251b187687617fce1d424f2c0354dfbb15681460798c9031 not found: ID does not exist"
Sep 09 14:28:52.887644 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.887590    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"]
Sep 09 14:28:52.890833 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:52.890791    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a0fa5a-openshift-default-54c544477d-ppw8d"]
Sep 09 14:28:53.800459 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:53.800415    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" path="/var/lib/kubelet/pods/59d2f33a-a93b-4818-8ba9-d9d1a55fd02e/volumes"
Sep 09 14:28:55.894833 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:55.894788    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:56.463052 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.462998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:56.490810 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.490768    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"]
Sep 09 14:28:56.491135 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.491102    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5" podUID="3b5db717-7cae-49e1-8785-d5618f93881b" containerName="payload-pre-processing" containerID="cri-o://18ff0461535a41e6fded8f4c3877a34f3e4de2dd8f87a5a44fc58c9cdff55407" gracePeriod=30
Sep 09 14:28:56.542403 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.542289    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:56.643195 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.642158    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl"]
Sep 09 14:28:56.643195 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.643034    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:56.644902 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.644869    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d94c06b6-djfkl"]
Sep 09 14:28:56.728161 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.728057    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:56.772664 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.772634    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"
Sep 09 14:28:56.808396 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.808357    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b5db717-7cae-49e1-8785-d5618f93881b-plugins-config-volume\") pod \"3b5db717-7cae-49e1-8785-d5618f93881b\" (UID: \"3b5db717-7cae-49e1-8785-d5618f93881b\") "
Sep 09 14:28:56.808625 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.808429    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdbrr\" (UniqueName: \"kubernetes.io/projected/3b5db717-7cae-49e1-8785-d5618f93881b-kube-api-access-mdbrr\") pod \"3b5db717-7cae-49e1-8785-d5618f93881b\" (UID: \"3b5db717-7cae-49e1-8785-d5618f93881b\") "
Sep 09 14:28:56.808757 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.808728    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b5db717-7cae-49e1-8785-d5618f93881b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3b5db717-7cae-49e1-8785-d5618f93881b" (UID: "3b5db717-7cae-49e1-8785-d5618f93881b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:28:56.810831 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.810793    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b5db717-7cae-49e1-8785-d5618f93881b-kube-api-access-mdbrr" (OuterVolumeSpecName: "kube-api-access-mdbrr") pod "3b5db717-7cae-49e1-8785-d5618f93881b" (UID: "3b5db717-7cae-49e1-8785-d5618f93881b"). InnerVolumeSpecName "kube-api-access-mdbrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:28:56.891392 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.891352    2562 generic.go:356] "Generic (PLEG): container finished" podID="3b5db717-7cae-49e1-8785-d5618f93881b" containerID="18ff0461535a41e6fded8f4c3877a34f3e4de2dd8f87a5a44fc58c9cdff55407" exitCode=0
Sep 09 14:28:56.891392 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.891400    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"
Sep 09 14:28:56.891652 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.891443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5" event={"ID":"3b5db717-7cae-49e1-8785-d5618f93881b","Type":"ContainerDied","Data":"18ff0461535a41e6fded8f4c3877a34f3e4de2dd8f87a5a44fc58c9cdff55407"}
Sep 09 14:28:56.891652 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.891502    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5" event={"ID":"3b5db717-7cae-49e1-8785-d5618f93881b","Type":"ContainerDied","Data":"49fc05693b4413b5147b77f5defc3d2f00c2cf16cb52e1496a2b3ae1ec7ef028"}
Sep 09 14:28:56.891652 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.891537    2562 scope.go:117] "RemoveContainer" containerID="18ff0461535a41e6fded8f4c3877a34f3e4de2dd8f87a5a44fc58c9cdff55407"
Sep 09 14:28:56.902396 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.902373    2562 scope.go:117] "RemoveContainer" containerID="18ff0461535a41e6fded8f4c3877a34f3e4de2dd8f87a5a44fc58c9cdff55407"
Sep 09 14:28:56.902791 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:28:56.902769    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18ff0461535a41e6fded8f4c3877a34f3e4de2dd8f87a5a44fc58c9cdff55407\": container with ID starting with 18ff0461535a41e6fded8f4c3877a34f3e4de2dd8f87a5a44fc58c9cdff55407 not found: ID does not exist" containerID="18ff0461535a41e6fded8f4c3877a34f3e4de2dd8f87a5a44fc58c9cdff55407"
Sep 09 14:28:56.902847 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.902802    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ff0461535a41e6fded8f4c3877a34f3e4de2dd8f87a5a44fc58c9cdff55407"} err="failed to get container status \"18ff0461535a41e6fded8f4c3877a34f3e4de2dd8f87a5a44fc58c9cdff55407\": rpc error: code = NotFound desc = could not find container \"18ff0461535a41e6fded8f4c3877a34f3e4de2dd8f87a5a44fc58c9cdff55407\": container with ID starting with 18ff0461535a41e6fded8f4c3877a34f3e4de2dd8f87a5a44fc58c9cdff55407 not found: ID does not exist"
Sep 09 14:28:56.909243 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.909136    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b5db717-7cae-49e1-8785-d5618f93881b-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:56.909243 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.909204    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdbrr\" (UniqueName: \"kubernetes.io/projected/3b5db717-7cae-49e1-8785-d5618f93881b-kube-api-access-mdbrr\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:56.914365 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.914326    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"]
Sep 09 14:28:56.918540 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:56.918507    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d94c06b6-76675cff66-rhms5"]
Sep 09 14:28:57.053112 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:57.053075    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:57.800882 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:57.800839    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b5db717-7cae-49e1-8785-d5618f93881b" path="/var/lib/kubelet/pods/3b5db717-7cae-49e1-8785-d5618f93881b/volumes"
Sep 09 14:28:57.801259 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:57.801245    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8143506-8fcc-453b-846e-d450517f078f" path="/var/lib/kubelet/pods/c8143506-8fcc-453b-846e-d450517f078f/volumes"
Sep 09 14:28:57.841164 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:57.841120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:58.423490 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.423447    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:58.436015 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.435978    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"]
Sep 09 14:28:58.436308 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.436279    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9" podUID="0b15530e-95b2-4a59-b04c-bab67c0c99c3" containerName="payload-processing" containerID="cri-o://af0209ba3451ce225eb818cf1fb96ae9287eae79b8f2109273e582baf072ac25" gracePeriod=30
Sep 09 14:28:58.524150 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.524105    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:58.652541 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.652484    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:58.721644 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.721608    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"
Sep 09 14:28:58.722085 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.722060    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4t9bw\" (UniqueName: \"kubernetes.io/projected/0b15530e-95b2-4a59-b04c-bab67c0c99c3-kube-api-access-4t9bw\") pod \"0b15530e-95b2-4a59-b04c-bab67c0c99c3\" (UID: \"0b15530e-95b2-4a59-b04c-bab67c0c99c3\") "
Sep 09 14:28:58.722208 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.722120    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b15530e-95b2-4a59-b04c-bab67c0c99c3-plugins-config-volume\") pod \"0b15530e-95b2-4a59-b04c-bab67c0c99c3\" (UID: \"0b15530e-95b2-4a59-b04c-bab67c0c99c3\") "
Sep 09 14:28:58.722542 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.722515    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b15530e-95b2-4a59-b04c-bab67c0c99c3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0b15530e-95b2-4a59-b04c-bab67c0c99c3" (UID: "0b15530e-95b2-4a59-b04c-bab67c0c99c3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:28:58.724332 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.724303    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b15530e-95b2-4a59-b04c-bab67c0c99c3-kube-api-access-4t9bw" (OuterVolumeSpecName: "kube-api-access-4t9bw") pod "0b15530e-95b2-4a59-b04c-bab67c0c99c3" (UID: "0b15530e-95b2-4a59-b04c-bab67c0c99c3"). InnerVolumeSpecName "kube-api-access-4t9bw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:28:58.788450 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.788401    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:58.823336 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.823290    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t9bw\" (UniqueName: \"kubernetes.io/projected/0b15530e-95b2-4a59-b04c-bab67c0c99c3-kube-api-access-4t9bw\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:58.823336 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.823327    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b15530e-95b2-4a59-b04c-bab67c0c99c3-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:28:58.907290 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.907255    2562 generic.go:356] "Generic (PLEG): container finished" podID="0b15530e-95b2-4a59-b04c-bab67c0c99c3" containerID="af0209ba3451ce225eb818cf1fb96ae9287eae79b8f2109273e582baf072ac25" exitCode=0
Sep 09 14:28:58.907503 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.907318    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"
Sep 09 14:28:58.907503 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.907346    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9" event={"ID":"0b15530e-95b2-4a59-b04c-bab67c0c99c3","Type":"ContainerDied","Data":"af0209ba3451ce225eb818cf1fb96ae9287eae79b8f2109273e582baf072ac25"}
Sep 09 14:28:58.907503 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.907412    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9" event={"ID":"0b15530e-95b2-4a59-b04c-bab67c0c99c3","Type":"ContainerDied","Data":"746a3598e98e97f0976b4b42696d3731abcb629248d8344d43e28779af7691b7"}
Sep 09 14:28:58.907503 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.907446    2562 scope.go:117] "RemoveContainer" containerID="af0209ba3451ce225eb818cf1fb96ae9287eae79b8f2109273e582baf072ac25"
Sep 09 14:28:58.918363 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.918337    2562 scope.go:117] "RemoveContainer" containerID="af0209ba3451ce225eb818cf1fb96ae9287eae79b8f2109273e582baf072ac25"
Sep 09 14:28:58.918770 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:28:58.918745    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af0209ba3451ce225eb818cf1fb96ae9287eae79b8f2109273e582baf072ac25\": container with ID starting with af0209ba3451ce225eb818cf1fb96ae9287eae79b8f2109273e582baf072ac25 not found: ID does not exist" containerID="af0209ba3451ce225eb818cf1fb96ae9287eae79b8f2109273e582baf072ac25"
Sep 09 14:28:58.918881 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.918780    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af0209ba3451ce225eb818cf1fb96ae9287eae79b8f2109273e582baf072ac25"} err="failed to get container status \"af0209ba3451ce225eb818cf1fb96ae9287eae79b8f2109273e582baf072ac25\": rpc error: code = NotFound desc = could not find container \"af0209ba3451ce225eb818cf1fb96ae9287eae79b8f2109273e582baf072ac25\": container with ID starting with af0209ba3451ce225eb818cf1fb96ae9287eae79b8f2109273e582baf072ac25 not found: ID does not exist"
Sep 09 14:28:58.923807 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.923772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:58.931620 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.931581    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"]
Sep 09 14:28:58.944839 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:58.944798    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d85f87-6fb794b455-t42h9"]
Sep 09 14:28:59.100863 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:59.100812    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:28:59.800197 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:28:59.800145    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b15530e-95b2-4a59-b04c-bab67c0c99c3" path="/var/lib/kubelet/pods/0b15530e-95b2-4a59-b04c-bab67c0c99c3/volumes"
Sep 09 14:29:03.876600 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:03.876558    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:03.987309 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:03.987266    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:04.208557 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:04.208444    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:04.559414 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:04.559379    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:04.661953 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:04.661912    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:04.835194 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:04.835072    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:05.995503 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:05.995457    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:06.107156 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:06.107112    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:06.264393 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:06.264274    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"]
Sep 09 14:29:06.264618 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:06.264582    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx" podUID="3402af9b-e789-4904-8ace-207f5e5a0bea" containerName="istio-proxy" containerID="cri-o://141393bfc97aa1e930866ba008a681c813a02694f92fd910b31134ba9ab60896" gracePeriod=30
Sep 09 14:29:06.306922 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:06.306886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:06.876981 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:06.876939    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:07.167262 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.167145    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"]
Sep 09 14:29:07.167624 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.167596    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b5db717-7cae-49e1-8785-d5618f93881b" containerName="payload-pre-processing"
Sep 09 14:29:07.167624 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.167610    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b5db717-7cae-49e1-8785-d5618f93881b" containerName="payload-pre-processing"
Sep 09 14:29:07.167703 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.167627    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" containerName="istio-proxy"
Sep 09 14:29:07.167703 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.167634    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" containerName="istio-proxy"
Sep 09 14:29:07.167703 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.167653    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" containerName="istio-proxy"
Sep 09 14:29:07.167703 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.167660    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" containerName="istio-proxy"
Sep 09 14:29:07.167703 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.167671    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b15530e-95b2-4a59-b04c-bab67c0c99c3" containerName="payload-processing"
Sep 09 14:29:07.167703 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.167677    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b15530e-95b2-4a59-b04c-bab67c0c99c3" containerName="payload-processing"
Sep 09 14:29:07.167703 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.167687    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8143506-8fcc-453b-846e-d450517f078f" containerName="revoke-keys"
Sep 09 14:29:07.167703 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.167692    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8143506-8fcc-453b-846e-d450517f078f" containerName="revoke-keys"
Sep 09 14:29:07.167946 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.167760    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8143506-8fcc-453b-846e-d450517f078f" containerName="revoke-keys"
Sep 09 14:29:07.167946 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.167770    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" containerName="istio-proxy"
Sep 09 14:29:07.167946 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.167779    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b5db717-7cae-49e1-8785-d5618f93881b" containerName="payload-pre-processing"
Sep 09 14:29:07.167946 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.167786    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="59d2f33a-a93b-4818-8ba9-d9d1a55fd02e" containerName="istio-proxy"
Sep 09 14:29:07.167946 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.167794    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b15530e-95b2-4a59-b04c-bab67c0c99c3" containerName="payload-processing"
Sep 09 14:29:07.171270 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.171242    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.173805 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.173769    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-e565aa-openshift-default-dockercfg-bpq5w\""
Sep 09 14:29:07.186914 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.186876    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"]
Sep 09 14:29:07.201144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.201094    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49674920-0231-4c9e-b0b7-8250892a22bd-istiod-ca-cert\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.201144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.201148    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-workload-socket\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.201427 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.201213    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49674920-0231-4c9e-b0b7-8250892a22bd-istio-podinfo\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.201427 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.201242    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-credential-socket\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.201427 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.201332    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgqtc\" (UniqueName: \"kubernetes.io/projected/49674920-0231-4c9e-b0b7-8250892a22bd-kube-api-access-kgqtc\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.201427 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.201393    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-istio-data\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.201583 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.201428    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-istio-envoy\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.201583 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.201474    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49674920-0231-4c9e-b0b7-8250892a22bd-istio-token\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.201583 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.201493    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-workload-certs\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.226250 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.226207    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:07.302963 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.302918    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-credential-socket\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.302963 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.302968    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgqtc\" (UniqueName: \"kubernetes.io/projected/49674920-0231-4c9e-b0b7-8250892a22bd-kube-api-access-kgqtc\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.303330 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.302996    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-istio-data\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.303330 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.303025    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-istio-envoy\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.303330 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.303065    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49674920-0231-4c9e-b0b7-8250892a22bd-istio-token\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.303330 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.303084    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-workload-certs\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.303330 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.303131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49674920-0231-4c9e-b0b7-8250892a22bd-istiod-ca-cert\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.303330 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.303270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-workload-socket\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.303330 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.303314    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49674920-0231-4c9e-b0b7-8250892a22bd-istio-podinfo\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.303700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.303470    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-credential-socket\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.303700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.303574    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-istio-data\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.303700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.303630    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-workload-certs\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.303700 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.303687    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-workload-socket\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.303943 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.303921    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49674920-0231-4c9e-b0b7-8250892a22bd-istiod-ca-cert\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.305929 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.305904    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-istio-envoy\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.306053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.305987    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49674920-0231-4c9e-b0b7-8250892a22bd-istio-podinfo\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.311805 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.311766    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49674920-0231-4c9e-b0b7-8250892a22bd-istio-token\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.311929 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.311882    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgqtc\" (UniqueName: \"kubernetes.io/projected/49674920-0231-4c9e-b0b7-8250892a22bd-kube-api-access-kgqtc\") pod \"e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") " pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.482977 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.482858    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:07.775660 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.775625    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"]
Sep 09 14:29:07.778052 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:29:07.778019    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49674920_0231_4c9e_b0b7_8250892a22bd.slice/crio-0f920e88f0fcaeb4511d790b39594849d4980aa1e670b4636a8bcb62f78a7627 WatchSource:0}: Error finding container 0f920e88f0fcaeb4511d790b39594849d4980aa1e670b4636a8bcb62f78a7627: Status 404 returned error can't find the container with id 0f920e88f0fcaeb4511d790b39594849d4980aa1e670b4636a8bcb62f78a7627
Sep 09 14:29:07.780503 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.780462    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:29:07.780579 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.780548    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:29:07.780622 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.780583    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:29:07.797636 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.797596    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:07.968987 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.968935    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l" event={"ID":"49674920-0231-4c9e-b0b7-8250892a22bd","Type":"ContainerStarted","Data":"cd0efc15bf63edd0bb8dc1f7272151a55a66523dfdc4e45d596da4a0f4157e68"}
Sep 09 14:29:07.969234 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.969019    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l" event={"ID":"49674920-0231-4c9e-b0b7-8250892a22bd","Type":"ContainerStarted","Data":"0f920e88f0fcaeb4511d790b39594849d4980aa1e670b4636a8bcb62f78a7627"}
Sep 09 14:29:07.990036 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:07.989969    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l" podStartSLOduration=0.989941949 podStartE2EDuration="989.941949ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:29:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:29:07.989442084 +0000 UTC m=+1112.715982186" watchObservedRunningTime="2026-09-09 14:29:07.989941949 +0000 UTC m=+1112.716482052"
Sep 09 14:29:08.483722 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:08.483682    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:08.489449 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:08.489414    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:08.975143 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:08.975103    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:08.976434 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:08.976405    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:09.975459 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:09.975411    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:10.076022 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:10.075985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:10.567518 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:10.567474    2562 patch_prober.go:28] interesting pod/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 14:29:10.567738 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:10.567545    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx" podUID="3402af9b-e789-4904-8ace-207f5e5a0bea" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 14:29:11.150348 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.150284    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:11.268127 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.268086    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:11.388821 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.388772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:11.533778 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.533745    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:29:11.646139 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.646090    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-podinfo\") pod \"3402af9b-e789-4904-8ace-207f5e5a0bea\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") "
Sep 09 14:29:11.646388 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.646155    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-credential-socket\") pod \"3402af9b-e789-4904-8ace-207f5e5a0bea\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") "
Sep 09 14:29:11.646388 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.646275    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3402af9b-e789-4904-8ace-207f5e5a0bea-istiod-ca-cert\") pod \"3402af9b-e789-4904-8ace-207f5e5a0bea\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") "
Sep 09 14:29:11.646388 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.646328    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-workload-socket\") pod \"3402af9b-e789-4904-8ace-207f5e5a0bea\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") "
Sep 09 14:29:11.646388 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.646367    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-workload-certs\") pod \"3402af9b-e789-4904-8ace-207f5e5a0bea\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") "
Sep 09 14:29:11.646577 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.646406    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-data\") pod \"3402af9b-e789-4904-8ace-207f5e5a0bea\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") "
Sep 09 14:29:11.646577 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.646435    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-token\") pod \"3402af9b-e789-4904-8ace-207f5e5a0bea\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") "
Sep 09 14:29:11.646577 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.646489    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-envoy\") pod \"3402af9b-e789-4904-8ace-207f5e5a0bea\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") "
Sep 09 14:29:11.646577 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.646519    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t76lx\" (UniqueName: \"kubernetes.io/projected/3402af9b-e789-4904-8ace-207f5e5a0bea-kube-api-access-t76lx\") pod \"3402af9b-e789-4904-8ace-207f5e5a0bea\" (UID: \"3402af9b-e789-4904-8ace-207f5e5a0bea\") "
Sep 09 14:29:11.646857 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.646588    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3402af9b-e789-4904-8ace-207f5e5a0bea" (UID: "3402af9b-e789-4904-8ace-207f5e5a0bea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:29:11.646857 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.646748    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3402af9b-e789-4904-8ace-207f5e5a0bea" (UID: "3402af9b-e789-4904-8ace-207f5e5a0bea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:29:11.647059 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.647000    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-credential-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:29:11.647059 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.647029    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-workload-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:29:11.647059 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.647050    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3402af9b-e789-4904-8ace-207f5e5a0bea" (UID: "3402af9b-e789-4904-8ace-207f5e5a0bea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:29:11.647302 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.647206    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-data" (OuterVolumeSpecName: "istio-data") pod "3402af9b-e789-4904-8ace-207f5e5a0bea" (UID: "3402af9b-e789-4904-8ace-207f5e5a0bea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:29:11.647447 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.647416    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3402af9b-e789-4904-8ace-207f5e5a0bea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3402af9b-e789-4904-8ace-207f5e5a0bea" (UID: "3402af9b-e789-4904-8ace-207f5e5a0bea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:29:11.649104 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.649059    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3402af9b-e789-4904-8ace-207f5e5a0bea" (UID: "3402af9b-e789-4904-8ace-207f5e5a0bea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:29:11.649648 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.649625    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-token" (OuterVolumeSpecName: "istio-token") pod "3402af9b-e789-4904-8ace-207f5e5a0bea" (UID: "3402af9b-e789-4904-8ace-207f5e5a0bea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:29:11.649648 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.649635    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3402af9b-e789-4904-8ace-207f5e5a0bea" (UID: "3402af9b-e789-4904-8ace-207f5e5a0bea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:29:11.649938 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.649909    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3402af9b-e789-4904-8ace-207f5e5a0bea-kube-api-access-t76lx" (OuterVolumeSpecName: "kube-api-access-t76lx") pod "3402af9b-e789-4904-8ace-207f5e5a0bea" (UID: "3402af9b-e789-4904-8ace-207f5e5a0bea"). InnerVolumeSpecName "kube-api-access-t76lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:29:11.671641 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.671595    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:11.748160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.748050    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-podinfo\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:29:11.748160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.748090    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3402af9b-e789-4904-8ace-207f5e5a0bea-istiod-ca-cert\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:29:11.748160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.748103    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-workload-certs\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:29:11.748160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.748111    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-data\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:29:11.748160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.748119    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-token\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:29:11.748160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.748127    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3402af9b-e789-4904-8ace-207f5e5a0bea-istio-envoy\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:29:11.748160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.748137    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t76lx\" (UniqueName: \"kubernetes.io/projected/3402af9b-e789-4904-8ace-207f5e5a0bea-kube-api-access-t76lx\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:29:11.767701 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.767656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:11.803448 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.803406    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"]
Sep 09 14:29:11.803840 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.803827    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3402af9b-e789-4904-8ace-207f5e5a0bea" containerName="istio-proxy"
Sep 09 14:29:11.803911 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.803843    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3402af9b-e789-4904-8ace-207f5e5a0bea" containerName="istio-proxy"
Sep 09 14:29:11.803952 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.803926    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3402af9b-e789-4904-8ace-207f5e5a0bea" containerName="istio-proxy"
Sep 09 14:29:11.807421 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.807391    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"
Sep 09 14:29:11.809611 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.809579    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-e565aa\""
Sep 09 14:29:11.809769 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.809612    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-e565aa-dockercfg-wkk7q\""
Sep 09 14:29:11.819774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.819738    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"]
Sep 09 14:29:11.849317 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.849268    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7286859-9823-434e-8986-f4bb5ec86cee-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492\" (UID: \"e7286859-9823-434e-8986-f4bb5ec86cee\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"
Sep 09 14:29:11.849494 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.849356    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xq7j\" (UniqueName: \"kubernetes.io/projected/e7286859-9823-434e-8986-f4bb5ec86cee-kube-api-access-9xq7j\") pod \"payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492\" (UID: \"e7286859-9823-434e-8986-f4bb5ec86cee\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"
Sep 09 14:29:11.950989 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.950943    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xq7j\" (UniqueName: \"kubernetes.io/projected/e7286859-9823-434e-8986-f4bb5ec86cee-kube-api-access-9xq7j\") pod \"payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492\" (UID: \"e7286859-9823-434e-8986-f4bb5ec86cee\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"
Sep 09 14:29:11.951218 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.951091    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7286859-9823-434e-8986-f4bb5ec86cee-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492\" (UID: \"e7286859-9823-434e-8986-f4bb5ec86cee\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"
Sep 09 14:29:11.952080 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.952050    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7286859-9823-434e-8986-f4bb5ec86cee-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492\" (UID: \"e7286859-9823-434e-8986-f4bb5ec86cee\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"
Sep 09 14:29:11.960577 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.960532    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xq7j\" (UniqueName: \"kubernetes.io/projected/e7286859-9823-434e-8986-f4bb5ec86cee-kube-api-access-9xq7j\") pod \"payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492\" (UID: \"e7286859-9823-434e-8986-f4bb5ec86cee\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"
Sep 09 14:29:11.994419 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.994382    2562 generic.go:356] "Generic (PLEG): container finished" podID="3402af9b-e789-4904-8ace-207f5e5a0bea" containerID="141393bfc97aa1e930866ba008a681c813a02694f92fd910b31134ba9ab60896" exitCode=0
Sep 09 14:29:11.994605 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.994435    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"
Sep 09 14:29:11.994605 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.994467    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx" event={"ID":"3402af9b-e789-4904-8ace-207f5e5a0bea","Type":"ContainerDied","Data":"141393bfc97aa1e930866ba008a681c813a02694f92fd910b31134ba9ab60896"}
Sep 09 14:29:11.994605 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.994532    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx" event={"ID":"3402af9b-e789-4904-8ace-207f5e5a0bea","Type":"ContainerDied","Data":"5a99662e143a4e0039763f72f1d0c8903f30d749e635ed9acccb9ca8c0a45b2f"}
Sep 09 14:29:11.994605 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:11.994563    2562 scope.go:117] "RemoveContainer" containerID="141393bfc97aa1e930866ba008a681c813a02694f92fd910b31134ba9ab60896"
Sep 09 14:29:12.004596 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:12.004572    2562 scope.go:117] "RemoveContainer" containerID="4557e01d82c1ed4bd2e9c3a0c780faadd7b6835836c86184ca381e002b50bdac"
Sep 09 14:29:12.014568 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:12.014542    2562 scope.go:117] "RemoveContainer" containerID="141393bfc97aa1e930866ba008a681c813a02694f92fd910b31134ba9ab60896"
Sep 09 14:29:12.015055 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:29:12.014938    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"141393bfc97aa1e930866ba008a681c813a02694f92fd910b31134ba9ab60896\": container with ID starting with 141393bfc97aa1e930866ba008a681c813a02694f92fd910b31134ba9ab60896 not found: ID does not exist" containerID="141393bfc97aa1e930866ba008a681c813a02694f92fd910b31134ba9ab60896"
Sep 09 14:29:12.015055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:12.014981    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"141393bfc97aa1e930866ba008a681c813a02694f92fd910b31134ba9ab60896"} err="failed to get container status \"141393bfc97aa1e930866ba008a681c813a02694f92fd910b31134ba9ab60896\": rpc error: code = NotFound desc = could not find container \"141393bfc97aa1e930866ba008a681c813a02694f92fd910b31134ba9ab60896\": container with ID starting with 141393bfc97aa1e930866ba008a681c813a02694f92fd910b31134ba9ab60896 not found: ID does not exist"
Sep 09 14:29:12.015055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:12.015011    2562 scope.go:117] "RemoveContainer" containerID="4557e01d82c1ed4bd2e9c3a0c780faadd7b6835836c86184ca381e002b50bdac"
Sep 09 14:29:12.015963 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:29:12.015472    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4557e01d82c1ed4bd2e9c3a0c780faadd7b6835836c86184ca381e002b50bdac\": container with ID starting with 4557e01d82c1ed4bd2e9c3a0c780faadd7b6835836c86184ca381e002b50bdac not found: ID does not exist" containerID="4557e01d82c1ed4bd2e9c3a0c780faadd7b6835836c86184ca381e002b50bdac"
Sep 09 14:29:12.015963 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:12.015502    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4557e01d82c1ed4bd2e9c3a0c780faadd7b6835836c86184ca381e002b50bdac"} err="failed to get container status \"4557e01d82c1ed4bd2e9c3a0c780faadd7b6835836c86184ca381e002b50bdac\": rpc error: code = NotFound desc = could not find container \"4557e01d82c1ed4bd2e9c3a0c780faadd7b6835836c86184ca381e002b50bdac\": container with ID starting with 4557e01d82c1ed4bd2e9c3a0c780faadd7b6835836c86184ca381e002b50bdac not found: ID does not exist"
Sep 09 14:29:12.018207 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:12.018185    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"]
Sep 09 14:29:12.021976 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:12.021945    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-d85f87-openshift-default-677fb4cbf6-tbfjx"]
Sep 09 14:29:12.121233 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:12.121194    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"
Sep 09 14:29:12.404364 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:12.404339    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"]
Sep 09 14:29:12.406737 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:29:12.406705    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7286859_9823_434e_8986_f4bb5ec86cee.slice/crio-5ee2090e68dc0f44ea1b3ce1387e245c0fe789a6020f1a1ffd2ec3fc3bab37c6 WatchSource:0}: Error finding container 5ee2090e68dc0f44ea1b3ce1387e245c0fe789a6020f1a1ffd2ec3fc3bab37c6: Status 404 returned error can't find the container with id 5ee2090e68dc0f44ea1b3ce1387e245c0fe789a6020f1a1ffd2ec3fc3bab37c6
Sep 09 14:29:12.700204 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:12.700083    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:12.814397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:12.814353    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:12.912299 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:12.912239    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:13.004246 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:13.004118    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492" event={"ID":"e7286859-9823-434e-8986-f4bb5ec86cee","Type":"ContainerStarted","Data":"42840753620efcb560ca0060e36376a04b03d49ded8bf8b7a011e93ac6ed6a2b"}
Sep 09 14:29:13.004246 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:13.004209    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"
Sep 09 14:29:13.004246 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:13.004237    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492" event={"ID":"e7286859-9823-434e-8986-f4bb5ec86cee","Type":"ContainerStarted","Data":"5ee2090e68dc0f44ea1b3ce1387e245c0fe789a6020f1a1ffd2ec3fc3bab37c6"}
Sep 09 14:29:13.024743 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:13.024667    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492" podStartSLOduration=2.024641172 podStartE2EDuration="2.024641172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:29:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:29:13.022215619 +0000 UTC m=+1117.748755723" watchObservedRunningTime="2026-09-09 14:29:13.024641172 +0000 UTC m=+1117.751181277"
Sep 09 14:29:13.040327 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:13.040287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:13.800621 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:13.800582    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3402af9b-e789-4904-8ace-207f5e5a0bea" path="/var/lib/kubelet/pods/3402af9b-e789-4904-8ace-207f5e5a0bea/volumes"
Sep 09 14:29:19.008548 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:19.008505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:19.117991 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:19.117943    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:19.963095 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:19.963053    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:20.287071 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:20.286958    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:20.506957 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:20.506920    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:23.616806 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:23.616760    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:23.727247 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:23.727202    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:24.014584 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:24.014492    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"
Sep 09 14:29:24.996054 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:24.996010    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:25.017403 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.017352    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 14:29:25.017618 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.017430    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l" podUID="49674920-0231-4c9e-b0b7-8250892a22bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 14:29:25.099384 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.099345    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:25.304063 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.304019    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:25.486545 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.486446    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:25.580892 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.580794    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:25.581829 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.581801    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"]
Sep 09 14:29:25.582289 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.582273    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3402af9b-e789-4904-8ace-207f5e5a0bea" containerName="istio-proxy"
Sep 09 14:29:25.582356 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.582291    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3402af9b-e789-4904-8ace-207f5e5a0bea" containerName="istio-proxy"
Sep 09 14:29:25.582402 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.582381    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3402af9b-e789-4904-8ace-207f5e5a0bea" containerName="istio-proxy"
Sep 09 14:29:25.584463 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.584445    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"
Sep 09 14:29:25.587939 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.587910    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-cbb7fb\""
Sep 09 14:29:25.587939 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.587933    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-cbb7fb-dockercfg-k7whl\""
Sep 09 14:29:25.600840 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.600803    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"]
Sep 09 14:29:25.620359 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.620310    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"]
Sep 09 14:29:25.623222 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.623158    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"
Sep 09 14:29:25.653143 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.653101    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"]
Sep 09 14:29:25.690864 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.690821    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c31a0cf7-23fc-4ed0-b36a-542c90ca6324-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf\" (UID: \"c31a0cf7-23fc-4ed0-b36a-542c90ca6324\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"
Sep 09 14:29:25.691087 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.690948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spbm5\" (UniqueName: \"kubernetes.io/projected/c31a0cf7-23fc-4ed0-b36a-542c90ca6324-kube-api-access-spbm5\") pod \"payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf\" (UID: \"c31a0cf7-23fc-4ed0-b36a-542c90ca6324\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"
Sep 09 14:29:25.791738 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.791691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80ba21a3-6730-4448-bf83-235b12821726-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9\" (UID: \"80ba21a3-6730-4448-bf83-235b12821726\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"
Sep 09 14:29:25.791996 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.791756    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spbm5\" (UniqueName: \"kubernetes.io/projected/c31a0cf7-23fc-4ed0-b36a-542c90ca6324-kube-api-access-spbm5\") pod \"payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf\" (UID: \"c31a0cf7-23fc-4ed0-b36a-542c90ca6324\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"
Sep 09 14:29:25.791996 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.791865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7rm5\" (UniqueName: \"kubernetes.io/projected/80ba21a3-6730-4448-bf83-235b12821726-kube-api-access-f7rm5\") pod \"payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9\" (UID: \"80ba21a3-6730-4448-bf83-235b12821726\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"
Sep 09 14:29:25.791996 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.791930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c31a0cf7-23fc-4ed0-b36a-542c90ca6324-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf\" (UID: \"c31a0cf7-23fc-4ed0-b36a-542c90ca6324\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"
Sep 09 14:29:25.792662 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.792640    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c31a0cf7-23fc-4ed0-b36a-542c90ca6324-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf\" (UID: \"c31a0cf7-23fc-4ed0-b36a-542c90ca6324\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"
Sep 09 14:29:25.806701 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.806655    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spbm5\" (UniqueName: \"kubernetes.io/projected/c31a0cf7-23fc-4ed0-b36a-542c90ca6324-kube-api-access-spbm5\") pod \"payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf\" (UID: \"c31a0cf7-23fc-4ed0-b36a-542c90ca6324\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"
Sep 09 14:29:25.892946 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.892830    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7rm5\" (UniqueName: \"kubernetes.io/projected/80ba21a3-6730-4448-bf83-235b12821726-kube-api-access-f7rm5\") pod \"payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9\" (UID: \"80ba21a3-6730-4448-bf83-235b12821726\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"
Sep 09 14:29:25.893155 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.893001    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80ba21a3-6730-4448-bf83-235b12821726-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9\" (UID: \"80ba21a3-6730-4448-bf83-235b12821726\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"
Sep 09 14:29:25.893928 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.893903    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80ba21a3-6730-4448-bf83-235b12821726-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9\" (UID: \"80ba21a3-6730-4448-bf83-235b12821726\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"
Sep 09 14:29:25.895656 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.895633    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"
Sep 09 14:29:25.901968 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.901939    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7rm5\" (UniqueName: \"kubernetes.io/projected/80ba21a3-6730-4448-bf83-235b12821726-kube-api-access-f7rm5\") pod \"payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9\" (UID: \"80ba21a3-6730-4448-bf83-235b12821726\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"
Sep 09 14:29:25.935793 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:25.935741    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"
Sep 09 14:29:26.101164 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:26.101121    2562 generic.go:356] "Generic (PLEG): container finished" podID="49674920-0231-4c9e-b0b7-8250892a22bd" containerID="cd0efc15bf63edd0bb8dc1f7272151a55a66523dfdc4e45d596da4a0f4157e68" exitCode=0
Sep 09 14:29:26.101690 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:26.101224    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l" event={"ID":"49674920-0231-4c9e-b0b7-8250892a22bd","Type":"ContainerDied","Data":"cd0efc15bf63edd0bb8dc1f7272151a55a66523dfdc4e45d596da4a0f4157e68"}
Sep 09 14:29:26.101783 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:26.101766    2562 scope.go:117] "RemoveContainer" containerID="cd0efc15bf63edd0bb8dc1f7272151a55a66523dfdc4e45d596da4a0f4157e68"
Sep 09 14:29:26.102954 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:26.102927    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:29:26.103029 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:26.103014    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:29:26.103068 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:26.103059    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:29:26.182302 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:26.182183    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"]
Sep 09 14:29:26.184032 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:29:26.184005    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc31a0cf7_23fc_4ed0_b36a_542c90ca6324.slice/crio-2d0e3cecd890c5bc1fe53350e649d83274307f68305c92da89771fc6ea1569a9 WatchSource:0}: Error finding container 2d0e3cecd890c5bc1fe53350e649d83274307f68305c92da89771fc6ea1569a9: Status 404 returned error can't find the container with id 2d0e3cecd890c5bc1fe53350e649d83274307f68305c92da89771fc6ea1569a9
Sep 09 14:29:26.242802 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:26.238445    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"]
Sep 09 14:29:27.109249 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:27.109193    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l" event={"ID":"49674920-0231-4c9e-b0b7-8250892a22bd","Type":"ContainerStarted","Data":"b47641bceb1acebb08aa4db1144d3405c46b96b5f408b944bd39160433fafa16"}
Sep 09 14:29:27.111104 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:27.111065    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9" event={"ID":"80ba21a3-6730-4448-bf83-235b12821726","Type":"ContainerStarted","Data":"2ad8c0e99538a21261eb590f4ba4208aab50d7539ed5bd45c01c353f9e6dc616"}
Sep 09 14:29:27.111283 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:27.111134    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"
Sep 09 14:29:27.111283 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:27.111158    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9" event={"ID":"80ba21a3-6730-4448-bf83-235b12821726","Type":"ContainerStarted","Data":"bc2b118994dd00b82c094cf1e046d320871a52d579345d3ac57365f2586d6297"}
Sep 09 14:29:27.112821 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:27.112796    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf" event={"ID":"c31a0cf7-23fc-4ed0-b36a-542c90ca6324","Type":"ContainerStarted","Data":"299d42db3ed62fdf96557df73432b6a516358c3bc2b8487b1a91da35ba54abc8"}
Sep 09 14:29:27.112944 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:27.112840    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf" event={"ID":"c31a0cf7-23fc-4ed0-b36a-542c90ca6324","Type":"ContainerStarted","Data":"2d0e3cecd890c5bc1fe53350e649d83274307f68305c92da89771fc6ea1569a9"}
Sep 09 14:29:27.112944 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:27.112859    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"
Sep 09 14:29:27.169198 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:27.167986    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf" podStartSLOduration=2.167956959 podStartE2EDuration="2.167956959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:29:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:29:27.147949943 +0000 UTC m=+1131.874490045" watchObservedRunningTime="2026-09-09 14:29:27.167956959 +0000 UTC m=+1131.894497062"
Sep 09 14:29:27.483336 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:27.483235    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:27.484015 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:27.483994    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 09 14:29:27.484073 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:27.484052    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l" podUID="49674920-0231-4c9e-b0b7-8250892a22bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 09 14:29:28.484353 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:28.484306    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 09 14:29:28.484763 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:28.484388    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l" podUID="49674920-0231-4c9e-b0b7-8250892a22bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 09 14:29:29.483534 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:29.483488    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 09 14:29:29.483750 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:29.483570    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l" podUID="49674920-0231-4c9e-b0b7-8250892a22bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 09 14:29:30.483885 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:30.483834    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 09 14:29:30.484377 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:30.483906    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l" podUID="49674920-0231-4c9e-b0b7-8250892a22bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 09 14:29:31.483663 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:31.483617    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 09 14:29:31.483879 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:31.483693    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l" podUID="49674920-0231-4c9e-b0b7-8250892a22bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 09 14:29:32.103575 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:32.103532    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:32.483996 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:32.483889    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 09 14:29:32.483996 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:32.483961    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l" podUID="49674920-0231-4c9e-b0b7-8250892a22bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 09 14:29:33.488831 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:33.488791    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:33.489313 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:33.489111    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:33.489817 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:33.489797    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:29:33.511721 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:33.511662    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9" podStartSLOduration=8.511643377 podStartE2EDuration="8.511643377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:29:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:29:27.169604763 +0000 UTC m=+1131.896144866" watchObservedRunningTime="2026-09-09 14:29:33.511643377 +0000 UTC m=+1138.238183479"
Sep 09 14:29:34.929424 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:34.929384    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:35.271044 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:35.270928    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:35.569481 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:35.569434    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:36.063015 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:36.062970    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:38.121378 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:38.121334    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"
Sep 09 14:29:38.121858 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:38.121530    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"
Sep 09 14:29:38.715310 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:38.715270    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:38.810614 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:38.810570    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:40.021226 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.021156    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:40.122519 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.122479    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:40.222598 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.222546    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:40.517725 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.517688    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:40.619094 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.619055    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:40.636229 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.636187    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"]
Sep 09 14:29:40.639695 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.639655    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"
Sep 09 14:29:40.642522 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.642472    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-c5e2d3\""
Sep 09 14:29:40.642768 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.642747    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-c5e2d3-dockercfg-dkxxk\""
Sep 09 14:29:40.658812 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.658775    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"]
Sep 09 14:29:40.745796 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.743768    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f859cfb-6b52-4296-bd31-37f48dd28653-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc\" (UID: \"6f859cfb-6b52-4296-bd31-37f48dd28653\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"
Sep 09 14:29:40.745796 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.743917    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlch5\" (UniqueName: \"kubernetes.io/projected/6f859cfb-6b52-4296-bd31-37f48dd28653-kube-api-access-dlch5\") pod \"payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc\" (UID: \"6f859cfb-6b52-4296-bd31-37f48dd28653\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"
Sep 09 14:29:40.844482 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.844437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f859cfb-6b52-4296-bd31-37f48dd28653-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc\" (UID: \"6f859cfb-6b52-4296-bd31-37f48dd28653\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"
Sep 09 14:29:40.844844 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.844811    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlch5\" (UniqueName: \"kubernetes.io/projected/6f859cfb-6b52-4296-bd31-37f48dd28653-kube-api-access-dlch5\") pod \"payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc\" (UID: \"6f859cfb-6b52-4296-bd31-37f48dd28653\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"
Sep 09 14:29:40.845474 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.845443    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f859cfb-6b52-4296-bd31-37f48dd28653-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc\" (UID: \"6f859cfb-6b52-4296-bd31-37f48dd28653\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"
Sep 09 14:29:40.854699 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.854661    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlch5\" (UniqueName: \"kubernetes.io/projected/6f859cfb-6b52-4296-bd31-37f48dd28653-kube-api-access-dlch5\") pod \"payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc\" (UID: \"6f859cfb-6b52-4296-bd31-37f48dd28653\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"
Sep 09 14:29:40.954535 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:40.954493    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"
Sep 09 14:29:41.240758 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:41.240710    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"]
Sep 09 14:29:41.241828 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:29:41.241687    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f859cfb_6b52_4296_bd31_37f48dd28653.slice/crio-1af88ae0af8328d928a1fab8cc18f67804a8592c18fc82086754e5536778e8d4 WatchSource:0}: Error finding container 1af88ae0af8328d928a1fab8cc18f67804a8592c18fc82086754e5536778e8d4: Status 404 returned error can't find the container with id 1af88ae0af8328d928a1fab8cc18f67804a8592c18fc82086754e5536778e8d4
Sep 09 14:29:42.241250 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:42.241200    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc" event={"ID":"6f859cfb-6b52-4296-bd31-37f48dd28653","Type":"ContainerStarted","Data":"55fb2dc970786b54c7e223c9d0e3f6a708fef73fc9708f234865ec282098b623"}
Sep 09 14:29:42.241734 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:42.241284    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc" event={"ID":"6f859cfb-6b52-4296-bd31-37f48dd28653","Type":"ContainerStarted","Data":"1af88ae0af8328d928a1fab8cc18f67804a8592c18fc82086754e5536778e8d4"}
Sep 09 14:29:42.241734 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:42.241439    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"
Sep 09 14:29:42.264026 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:42.263962    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc" podStartSLOduration=2.263939617 podStartE2EDuration="2.263939617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:29:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:29:42.261440679 +0000 UTC m=+1146.987980782" watchObservedRunningTime="2026-09-09 14:29:42.263939617 +0000 UTC m=+1146.990479719"
Sep 09 14:29:46.030420 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:46.030384    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:48.597357 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:48.597310    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:48.963040 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:48.962927    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:49.340400 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:49.340357    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:49.574574 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:49.574525    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:52.810524 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:52.810482    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:52.910619 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:52.910565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:53.249782 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:53.249690    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"
Sep 09 14:29:54.035013 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.034963    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:54.138302 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.138256    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:54.304766 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.304726    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:54.555563 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.555462    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:54.642856 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.642800    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:29:54.681008 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.677721    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"]
Sep 09 14:29:54.683301 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.683262    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"
Sep 09 14:29:54.686869 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.686838    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-fecaf9\""
Sep 09 14:29:54.687039 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.686880    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-fecaf9-dockercfg-spg78\""
Sep 09 14:29:54.699256 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.699221    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"]
Sep 09 14:29:54.785859 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.785756    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vcjs\" (UniqueName: \"kubernetes.io/projected/1fa335c5-f581-46f3-97ab-6259347ff1fc-kube-api-access-6vcjs\") pod \"payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds\" (UID: \"1fa335c5-f581-46f3-97ab-6259347ff1fc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"
Sep 09 14:29:54.786221 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.785918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa335c5-f581-46f3-97ab-6259347ff1fc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds\" (UID: \"1fa335c5-f581-46f3-97ab-6259347ff1fc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"
Sep 09 14:29:54.886908 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.886814    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vcjs\" (UniqueName: \"kubernetes.io/projected/1fa335c5-f581-46f3-97ab-6259347ff1fc-kube-api-access-6vcjs\") pod \"payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds\" (UID: \"1fa335c5-f581-46f3-97ab-6259347ff1fc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"
Sep 09 14:29:54.886908 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.886905    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa335c5-f581-46f3-97ab-6259347ff1fc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds\" (UID: \"1fa335c5-f581-46f3-97ab-6259347ff1fc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"
Sep 09 14:29:54.887715 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.887690    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa335c5-f581-46f3-97ab-6259347ff1fc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds\" (UID: \"1fa335c5-f581-46f3-97ab-6259347ff1fc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"
Sep 09 14:29:54.894941 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.894909    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vcjs\" (UniqueName: \"kubernetes.io/projected/1fa335c5-f581-46f3-97ab-6259347ff1fc-kube-api-access-6vcjs\") pod \"payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds\" (UID: \"1fa335c5-f581-46f3-97ab-6259347ff1fc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"
Sep 09 14:29:54.996139 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:54.996092    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"
Sep 09 14:29:55.279114 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:55.279079    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"]
Sep 09 14:29:55.281336 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:29:55.281294    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa335c5_f581_46f3_97ab_6259347ff1fc.slice/crio-7b583fc96f350413a42787668dca0e11f9511f86bd0dee67982ed9db033891e7 WatchSource:0}: Error finding container 7b583fc96f350413a42787668dca0e11f9511f86bd0dee67982ed9db033891e7: Status 404 returned error can't find the container with id 7b583fc96f350413a42787668dca0e11f9511f86bd0dee67982ed9db033891e7
Sep 09 14:29:55.323332 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:55.323284    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds" event={"ID":"1fa335c5-f581-46f3-97ab-6259347ff1fc","Type":"ContainerStarted","Data":"7b583fc96f350413a42787668dca0e11f9511f86bd0dee67982ed9db033891e7"}
Sep 09 14:29:56.331934 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:56.331892    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds" event={"ID":"1fa335c5-f581-46f3-97ab-6259347ff1fc","Type":"ContainerStarted","Data":"794c40d16c149849fca013beca97eb456f33e2c32ab0cfa56ae847783dca9cc2"}
Sep 09 14:29:56.332459 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:56.332128    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"
Sep 09 14:29:56.350433 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:29:56.350374    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds" podStartSLOduration=2.35035413 podStartE2EDuration="2.35035413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:29:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:29:56.348684573 +0000 UTC m=+1161.075224709" watchObservedRunningTime="2026-09-09 14:29:56.35035413 +0000 UTC m=+1161.076894265"
Sep 09 14:30:00.147357 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.147192    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-e565aa-29816070-45lgd"]
Sep 09 14:30:00.152138 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.152082    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816070-wp8zs"]
Sep 09 14:30:00.156373 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.156337    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816070-wp8zs"
Sep 09 14:30:00.157270 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.157247    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-e565aa-29816070-45lgd"
Sep 09 14:30:00.160156 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.160123    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:30:00.176414 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.175153    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c5e2d3-29816070-rnqnh"]
Sep 09 14:30:00.181194 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.181151    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816070-wp8zs"
Sep 09 14:30:00.189033 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.188526    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c5e2d3-29816070-rnqnh"
Sep 09 14:30:00.189298 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.189275    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-e565aa-29816070-45lgd"]
Sep 09 14:30:00.189456 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.189443    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816070-wp8zs"]
Sep 09 14:30:00.196155 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.196111    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c5e2d3-29816070-rnqnh"]
Sep 09 14:30:00.229067 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.229026    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-e565aa-29816070-45lgd"
Sep 09 14:30:00.236473 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.236445    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c5e2d3-29816070-rnqnh"
Sep 09 14:30:00.490345 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.490313    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816070-wp8zs"]
Sep 09 14:30:00.492136 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:30:00.492103    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc648229_a694_4547_a410_a81940b9f1de.slice/crio-01ceb19b40d7ba888d0dc5263d32f10686357494c840c9e4bb7811c091a34300 WatchSource:0}: Error finding container 01ceb19b40d7ba888d0dc5263d32f10686357494c840c9e4bb7811c091a34300: Status 404 returned error can't find the container with id 01ceb19b40d7ba888d0dc5263d32f10686357494c840c9e4bb7811c091a34300
Sep 09 14:30:00.540714 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.540622    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-e565aa-29816070-45lgd"]
Sep 09 14:30:00.546561 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:30:00.546508    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7943fbc_2220_44f7_82df_3d844d5550cd.slice/crio-1565fde11827069d9d9456a0b000f95bb053a658f0dddee543d53a77706dee7c WatchSource:0}: Error finding container 1565fde11827069d9d9456a0b000f95bb053a658f0dddee543d53a77706dee7c: Status 404 returned error can't find the container with id 1565fde11827069d9d9456a0b000f95bb053a658f0dddee543d53a77706dee7c
Sep 09 14:30:00.553147 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.553116    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c5e2d3-29816070-rnqnh"]
Sep 09 14:30:00.556124 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:30:00.556092    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8182e43c_0b31_4c67_b02a_41f4cef27865.slice/crio-564942827fd0e7b23ccd628ca58402df0fe98d8ca49bf18bcdc6e96ecdadc561 WatchSource:0}: Error finding container 564942827fd0e7b23ccd628ca58402df0fe98d8ca49bf18bcdc6e96ecdadc561: Status 404 returned error can't find the container with id 564942827fd0e7b23ccd628ca58402df0fe98d8ca49bf18bcdc6e96ecdadc561
Sep 09 14:30:00.957395 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:00.957333    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:01.372437 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:01.372394    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816070-wp8zs" event={"ID":"fc648229-a694-4547-a410-a81940b9f1de","Type":"ContainerStarted","Data":"fe40ff4d8c4a2c58c170bb74d103a873e4fa4097980c0fd3b656c6a9e6a68ee0"}
Sep 09 14:30:01.373029 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:01.372458    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816070-wp8zs" event={"ID":"fc648229-a694-4547-a410-a81940b9f1de","Type":"ContainerStarted","Data":"01ceb19b40d7ba888d0dc5263d32f10686357494c840c9e4bb7811c091a34300"}
Sep 09 14:30:01.374634 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:01.374588    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-e565aa-29816070-45lgd" event={"ID":"f7943fbc-2220-44f7-82df-3d844d5550cd","Type":"ContainerStarted","Data":"428d1d412300c8b5f50569165a2b6fa2e629aff152937bf77a414008209faa59"}
Sep 09 14:30:01.374831 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:01.374673    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-e565aa-29816070-45lgd" event={"ID":"f7943fbc-2220-44f7-82df-3d844d5550cd","Type":"ContainerStarted","Data":"1565fde11827069d9d9456a0b000f95bb053a658f0dddee543d53a77706dee7c"}
Sep 09 14:30:01.376695 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:01.376659    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c5e2d3-29816070-rnqnh" event={"ID":"8182e43c-0b31-4c67-b02a-41f4cef27865","Type":"ContainerStarted","Data":"b96b4467dbaf9bb19f97e600a7427e083f1ac840f3c57ec3cc5396fbaf24b8ac"}
Sep 09 14:30:01.376860 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:01.376717    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c5e2d3-29816070-rnqnh" event={"ID":"8182e43c-0b31-4c67-b02a-41f4cef27865","Type":"ContainerStarted","Data":"564942827fd0e7b23ccd628ca58402df0fe98d8ca49bf18bcdc6e96ecdadc561"}
Sep 09 14:30:01.389009 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:01.388942    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816070-wp8zs" podStartSLOduration=1.388924753 podStartE2EDuration="1.388924753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:30:01.387479966 +0000 UTC m=+1166.114020068" watchObservedRunningTime="2026-09-09 14:30:01.388924753 +0000 UTC m=+1166.115464854"
Sep 09 14:30:01.401718 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:01.401662    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c5e2d3-29816070-rnqnh" podStartSLOduration=1.401643537 podStartE2EDuration="1.401643537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:30:01.400749747 +0000 UTC m=+1166.127289849" watchObservedRunningTime="2026-09-09 14:30:01.401643537 +0000 UTC m=+1166.128183639"
Sep 09 14:30:01.415127 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:01.415060    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-e565aa-29816070-45lgd" podStartSLOduration=1.415038641 podStartE2EDuration="1.415038641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:30:01.413021232 +0000 UTC m=+1166.139561334" watchObservedRunningTime="2026-09-09 14:30:01.415038641 +0000 UTC m=+1166.141578742"
Sep 09 14:30:02.385439 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:02.385399    2562 generic.go:356] "Generic (PLEG): container finished" podID="fc648229-a694-4547-a410-a81940b9f1de" containerID="fe40ff4d8c4a2c58c170bb74d103a873e4fa4097980c0fd3b656c6a9e6a68ee0" exitCode=0
Sep 09 14:30:02.385929 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:02.385493    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816070-wp8zs" event={"ID":"fc648229-a694-4547-a410-a81940b9f1de","Type":"ContainerDied","Data":"fe40ff4d8c4a2c58c170bb74d103a873e4fa4097980c0fd3b656c6a9e6a68ee0"}
Sep 09 14:30:02.387402 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:02.387370    2562 generic.go:356] "Generic (PLEG): container finished" podID="f7943fbc-2220-44f7-82df-3d844d5550cd" containerID="428d1d412300c8b5f50569165a2b6fa2e629aff152937bf77a414008209faa59" exitCode=0
Sep 09 14:30:02.387501 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:02.387458    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-e565aa-29816070-45lgd" event={"ID":"f7943fbc-2220-44f7-82df-3d844d5550cd","Type":"ContainerDied","Data":"428d1d412300c8b5f50569165a2b6fa2e629aff152937bf77a414008209faa59"}
Sep 09 14:30:02.389217 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:02.389191    2562 generic.go:356] "Generic (PLEG): container finished" podID="8182e43c-0b31-4c67-b02a-41f4cef27865" containerID="b96b4467dbaf9bb19f97e600a7427e083f1ac840f3c57ec3cc5396fbaf24b8ac" exitCode=0
Sep 09 14:30:02.389323 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:02.389270    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c5e2d3-29816070-rnqnh" event={"ID":"8182e43c-0b31-4c67-b02a-41f4cef27865","Type":"ContainerDied","Data":"b96b4467dbaf9bb19f97e600a7427e083f1ac840f3c57ec3cc5396fbaf24b8ac"}
Sep 09 14:30:03.562428 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:03.562118    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-e565aa-29816070-45lgd"
Sep 09 14:30:03.604668 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:03.604627    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c5e2d3-29816070-rnqnh"
Sep 09 14:30:03.632298 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:03.632264    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816070-wp8zs"
Sep 09 14:30:03.727485 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:03.727386    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:04.404471 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:04.404436    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c5e2d3-29816070-rnqnh"
Sep 09 14:30:04.404471 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:04.404461    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c5e2d3-29816070-rnqnh" event={"ID":"8182e43c-0b31-4c67-b02a-41f4cef27865","Type":"ContainerDied","Data":"564942827fd0e7b23ccd628ca58402df0fe98d8ca49bf18bcdc6e96ecdadc561"}
Sep 09 14:30:04.404730 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:04.404517    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="564942827fd0e7b23ccd628ca58402df0fe98d8ca49bf18bcdc6e96ecdadc561"
Sep 09 14:30:04.406386 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:04.406350    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816070-wp8zs"
Sep 09 14:30:04.406557 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:04.406383    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816070-wp8zs" event={"ID":"fc648229-a694-4547-a410-a81940b9f1de","Type":"ContainerDied","Data":"01ceb19b40d7ba888d0dc5263d32f10686357494c840c9e4bb7811c091a34300"}
Sep 09 14:30:04.406557 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:04.406434    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01ceb19b40d7ba888d0dc5263d32f10686357494c840c9e4bb7811c091a34300"
Sep 09 14:30:04.408227 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:04.408164    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-e565aa-29816070-45lgd" event={"ID":"f7943fbc-2220-44f7-82df-3d844d5550cd","Type":"ContainerDied","Data":"1565fde11827069d9d9456a0b000f95bb053a658f0dddee543d53a77706dee7c"}
Sep 09 14:30:04.408404 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:04.408233    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-e565aa-29816070-45lgd"
Sep 09 14:30:04.408404 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:04.408253    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1565fde11827069d9d9456a0b000f95bb053a658f0dddee543d53a77706dee7c"
Sep 09 14:30:07.341398 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:07.341352    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"
Sep 09 14:30:12.033107 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:12.033064    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:14.961037 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:14.960990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:17.848859 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:17.848816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:18.519676 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.519628    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7381-139766017578592"]
Sep 09 14:30:18.520119 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.520104    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8182e43c-0b31-4c67-b02a-41f4cef27865" containerName="cleanup"
Sep 09 14:30:18.520180 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.520121    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8182e43c-0b31-4c67-b02a-41f4cef27865" containerName="cleanup"
Sep 09 14:30:18.520180 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.520129    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc648229-a694-4547-a410-a81940b9f1de" containerName="cleanup"
Sep 09 14:30:18.520180 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.520135    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc648229-a694-4547-a410-a81940b9f1de" containerName="cleanup"
Sep 09 14:30:18.520180 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.520144    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7943fbc-2220-44f7-82df-3d844d5550cd" containerName="cleanup"
Sep 09 14:30:18.520180 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.520150    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7943fbc-2220-44f7-82df-3d844d5550cd" containerName="cleanup"
Sep 09 14:30:18.520342 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.520225    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8182e43c-0b31-4c67-b02a-41f4cef27865" containerName="cleanup"
Sep 09 14:30:18.520342 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.520233    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7943fbc-2220-44f7-82df-3d844d5550cd" containerName="cleanup"
Sep 09 14:30:18.520342 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.520241    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc648229-a694-4547-a410-a81940b9f1de" containerName="cleanup"
Sep 09 14:30:18.523702 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.523681    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-139766017578592"
Sep 09 14:30:18.525959 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.525931    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-txzw7\""
Sep 09 14:30:18.530016 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.529988    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-139766017578592"]
Sep 09 14:30:18.640799 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.640752    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln49s\" (UniqueName: \"kubernetes.io/projected/21ec5b80-7a5d-4a59-81dd-f317378078eb-kube-api-access-ln49s\") pod \"test-curl-7381-139766017578592\" (UID: \"21ec5b80-7a5d-4a59-81dd-f317378078eb\") " pod="opendatahub/test-curl-7381-139766017578592"
Sep 09 14:30:18.741977 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.741932    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln49s\" (UniqueName: \"kubernetes.io/projected/21ec5b80-7a5d-4a59-81dd-f317378078eb-kube-api-access-ln49s\") pod \"test-curl-7381-139766017578592\" (UID: \"21ec5b80-7a5d-4a59-81dd-f317378078eb\") " pod="opendatahub/test-curl-7381-139766017578592"
Sep 09 14:30:18.749617 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.749579    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln49s\" (UniqueName: \"kubernetes.io/projected/21ec5b80-7a5d-4a59-81dd-f317378078eb-kube-api-access-ln49s\") pod \"test-curl-7381-139766017578592\" (UID: \"21ec5b80-7a5d-4a59-81dd-f317378078eb\") " pod="opendatahub/test-curl-7381-139766017578592"
Sep 09 14:30:18.836288 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:18.836238    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-139766017578592"
Sep 09 14:30:19.114454 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:19.114421    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-139766017578592"]
Sep 09 14:30:19.116627 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:30:19.116596    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21ec5b80_7a5d_4a59_81dd_f317378078eb.slice/crio-ba145b27ccedc073aed52c5b790be67cac1864b239655f5599f83646e087ef42 WatchSource:0}: Error finding container ba145b27ccedc073aed52c5b790be67cac1864b239655f5599f83646e087ef42: Status 404 returned error can't find the container with id ba145b27ccedc073aed52c5b790be67cac1864b239655f5599f83646e087ef42
Sep 09 14:30:19.118436 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:19.118414    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 14:30:19.509113 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:19.509010    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-139766017578592" event={"ID":"21ec5b80-7a5d-4a59-81dd-f317378078eb","Type":"ContainerStarted","Data":"ba145b27ccedc073aed52c5b790be67cac1864b239655f5599f83646e087ef42"}
Sep 09 14:30:20.518082 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:20.518036    2562 generic.go:356] "Generic (PLEG): container finished" podID="21ec5b80-7a5d-4a59-81dd-f317378078eb" containerID="176381589c5bd80f0f5bf50f6eb982387f71f893a0fe506d241f4d9ac921d2d3" exitCode=0
Sep 09 14:30:20.518551 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:20.518120    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-139766017578592" event={"ID":"21ec5b80-7a5d-4a59-81dd-f317378078eb","Type":"ContainerDied","Data":"176381589c5bd80f0f5bf50f6eb982387f71f893a0fe506d241f4d9ac921d2d3"}
Sep 09 14:30:21.673152 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:21.673117    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-139766017578592"
Sep 09 14:30:21.692859 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:21.692815    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7381-139766017578592_21ec5b80-7a5d-4a59-81dd-f317378078eb/test-curl-7381-139766017578592/0.log"
Sep 09 14:30:21.716613 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:21.716522    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7381-139766017578592"]
Sep 09 14:30:21.720042 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:21.720004    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7381-139766017578592"]
Sep 09 14:30:21.779918 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:21.779803    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ln49s\" (UniqueName: \"kubernetes.io/projected/21ec5b80-7a5d-4a59-81dd-f317378078eb-kube-api-access-ln49s\") pod \"21ec5b80-7a5d-4a59-81dd-f317378078eb\" (UID: \"21ec5b80-7a5d-4a59-81dd-f317378078eb\") "
Sep 09 14:30:21.782204 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:21.782159    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21ec5b80-7a5d-4a59-81dd-f317378078eb-kube-api-access-ln49s" (OuterVolumeSpecName: "kube-api-access-ln49s") pod "21ec5b80-7a5d-4a59-81dd-f317378078eb" (UID: "21ec5b80-7a5d-4a59-81dd-f317378078eb"). InnerVolumeSpecName "kube-api-access-ln49s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:30:21.801551 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:21.801508    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21ec5b80-7a5d-4a59-81dd-f317378078eb" path="/var/lib/kubelet/pods/21ec5b80-7a5d-4a59-81dd-f317378078eb/volumes"
Sep 09 14:30:21.840974 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:21.840930    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7381-139766017578592"]
Sep 09 14:30:21.841425 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:21.841410    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21ec5b80-7a5d-4a59-81dd-f317378078eb" containerName="test-curl-7381-139766017578592"
Sep 09 14:30:21.841482 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:21.841427    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="21ec5b80-7a5d-4a59-81dd-f317378078eb" containerName="test-curl-7381-139766017578592"
Sep 09 14:30:21.841521 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:21.841491    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="21ec5b80-7a5d-4a59-81dd-f317378078eb" containerName="test-curl-7381-139766017578592"
Sep 09 14:30:21.844826 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:21.844804    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-139766017578592"
Sep 09 14:30:21.851983 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:21.851947    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-139766017578592"]
Sep 09 14:30:21.881341 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:21.881302    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ln49s\" (UniqueName: \"kubernetes.io/projected/21ec5b80-7a5d-4a59-81dd-f317378078eb-kube-api-access-ln49s\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:30:21.982587 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:21.982543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh852\" (UniqueName: \"kubernetes.io/projected/c02b8d00-81e5-4e8b-85ae-1652e0f3b02f-kube-api-access-vh852\") pod \"test-curl-7381-139766017578592\" (UID: \"c02b8d00-81e5-4e8b-85ae-1652e0f3b02f\") " pod="opendatahub/test-curl-7381-139766017578592"
Sep 09 14:30:22.083354 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:22.083290    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh852\" (UniqueName: \"kubernetes.io/projected/c02b8d00-81e5-4e8b-85ae-1652e0f3b02f-kube-api-access-vh852\") pod \"test-curl-7381-139766017578592\" (UID: \"c02b8d00-81e5-4e8b-85ae-1652e0f3b02f\") " pod="opendatahub/test-curl-7381-139766017578592"
Sep 09 14:30:22.092208 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:22.092134    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh852\" (UniqueName: \"kubernetes.io/projected/c02b8d00-81e5-4e8b-85ae-1652e0f3b02f-kube-api-access-vh852\") pod \"test-curl-7381-139766017578592\" (UID: \"c02b8d00-81e5-4e8b-85ae-1652e0f3b02f\") " pod="opendatahub/test-curl-7381-139766017578592"
Sep 09 14:30:22.156584 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:22.156540    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-139766017578592"
Sep 09 14:30:22.433936 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:22.433901    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-139766017578592"]
Sep 09 14:30:22.435886 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:30:22.435849    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc02b8d00_81e5_4e8b_85ae_1652e0f3b02f.slice/crio-90340f615d91ae8d77d9244d3531a8c3e14461012ab7fa06b7820cf722643a5e WatchSource:0}: Error finding container 90340f615d91ae8d77d9244d3531a8c3e14461012ab7fa06b7820cf722643a5e: Status 404 returned error can't find the container with id 90340f615d91ae8d77d9244d3531a8c3e14461012ab7fa06b7820cf722643a5e
Sep 09 14:30:22.532929 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:22.532894    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-139766017578592"
Sep 09 14:30:22.533128 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:22.532894    2562 scope.go:117] "RemoveContainer" containerID="176381589c5bd80f0f5bf50f6eb982387f71f893a0fe506d241f4d9ac921d2d3"
Sep 09 14:30:22.534551 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:22.534519    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-139766017578592" event={"ID":"c02b8d00-81e5-4e8b-85ae-1652e0f3b02f","Type":"ContainerStarted","Data":"90340f615d91ae8d77d9244d3531a8c3e14461012ab7fa06b7820cf722643a5e"}
Sep 09 14:30:23.543300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:23.543188    2562 generic.go:356] "Generic (PLEG): container finished" podID="c02b8d00-81e5-4e8b-85ae-1652e0f3b02f" containerID="c3d30f7bbefc4681578ecdfaa30d645846af1661abf467afb79fc3b95ac3bff2" exitCode=0
Sep 09 14:30:23.543686 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:23.543288    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-139766017578592" event={"ID":"c02b8d00-81e5-4e8b-85ae-1652e0f3b02f","Type":"ContainerDied","Data":"c3d30f7bbefc4681578ecdfaa30d645846af1661abf467afb79fc3b95ac3bff2"}
Sep 09 14:30:24.694285 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:24.694250    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-139766017578592"
Sep 09 14:30:24.714833 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:24.714802    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7381-139766017578592_c02b8d00-81e5-4e8b-85ae-1652e0f3b02f/test-curl-7381-139766017578592/0.log"
Sep 09 14:30:24.740203 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:24.740141    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7381-139766017578592"]
Sep 09 14:30:24.743545 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:24.743504    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7381-139766017578592"]
Sep 09 14:30:24.809641 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:24.809595    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh852\" (UniqueName: \"kubernetes.io/projected/c02b8d00-81e5-4e8b-85ae-1652e0f3b02f-kube-api-access-vh852\") pod \"c02b8d00-81e5-4e8b-85ae-1652e0f3b02f\" (UID: \"c02b8d00-81e5-4e8b-85ae-1652e0f3b02f\") "
Sep 09 14:30:24.811970 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:24.811929    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c02b8d00-81e5-4e8b-85ae-1652e0f3b02f-kube-api-access-vh852" (OuterVolumeSpecName: "kube-api-access-vh852") pod "c02b8d00-81e5-4e8b-85ae-1652e0f3b02f" (UID: "c02b8d00-81e5-4e8b-85ae-1652e0f3b02f"). InnerVolumeSpecName "kube-api-access-vh852". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:30:24.860118 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:24.860075    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7381-139766017579168"]
Sep 09 14:30:24.860567 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:24.860552    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c02b8d00-81e5-4e8b-85ae-1652e0f3b02f" containerName="test-curl-7381-139766017578592"
Sep 09 14:30:24.860628 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:24.860569    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c02b8d00-81e5-4e8b-85ae-1652e0f3b02f" containerName="test-curl-7381-139766017578592"
Sep 09 14:30:24.860673 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:24.860661    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c02b8d00-81e5-4e8b-85ae-1652e0f3b02f" containerName="test-curl-7381-139766017578592"
Sep 09 14:30:24.863906 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:24.863881    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-139766017579168"
Sep 09 14:30:24.871799 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:24.871759    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-139766017579168"]
Sep 09 14:30:24.911280 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:24.911233    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqtsq\" (UniqueName: \"kubernetes.io/projected/928ce959-9917-452f-a48c-9691769d7250-kube-api-access-mqtsq\") pod \"test-curl-7381-139766017579168\" (UID: \"928ce959-9917-452f-a48c-9691769d7250\") " pod="opendatahub/test-curl-7381-139766017579168"
Sep 09 14:30:24.911584 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:24.911550    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh852\" (UniqueName: \"kubernetes.io/projected/c02b8d00-81e5-4e8b-85ae-1652e0f3b02f-kube-api-access-vh852\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:30:25.012946 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:25.012901    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqtsq\" (UniqueName: \"kubernetes.io/projected/928ce959-9917-452f-a48c-9691769d7250-kube-api-access-mqtsq\") pod \"test-curl-7381-139766017579168\" (UID: \"928ce959-9917-452f-a48c-9691769d7250\") " pod="opendatahub/test-curl-7381-139766017579168"
Sep 09 14:30:25.021331 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:25.021278    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqtsq\" (UniqueName: \"kubernetes.io/projected/928ce959-9917-452f-a48c-9691769d7250-kube-api-access-mqtsq\") pod \"test-curl-7381-139766017579168\" (UID: \"928ce959-9917-452f-a48c-9691769d7250\") " pod="opendatahub/test-curl-7381-139766017579168"
Sep 09 14:30:25.175716 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:25.175605    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-139766017579168"
Sep 09 14:30:25.464669 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:25.464635    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-139766017579168"]
Sep 09 14:30:25.466842 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:30:25.466811    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod928ce959_9917_452f_a48c_9691769d7250.slice/crio-d3bc6fff800a2aa29f2d220ed2d33f5811b01be57f41382ed247d609affb710b WatchSource:0}: Error finding container d3bc6fff800a2aa29f2d220ed2d33f5811b01be57f41382ed247d609affb710b: Status 404 returned error can't find the container with id d3bc6fff800a2aa29f2d220ed2d33f5811b01be57f41382ed247d609affb710b
Sep 09 14:30:25.556976 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:25.556923    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-139766017579168" event={"ID":"928ce959-9917-452f-a48c-9691769d7250","Type":"ContainerStarted","Data":"d3bc6fff800a2aa29f2d220ed2d33f5811b01be57f41382ed247d609affb710b"}
Sep 09 14:30:25.558348 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:25.558326    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90340f615d91ae8d77d9244d3531a8c3e14461012ab7fa06b7820cf722643a5e"
Sep 09 14:30:25.558463 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:25.558351    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-139766017578592"
Sep 09 14:30:25.569182 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:30:25.569124    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7381-139766017578592\" is forbidden: User \"system:node:ip-10-0-140-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-6.ec2.internal' and this object" podUID="c02b8d00-81e5-4e8b-85ae-1652e0f3b02f" pod="opendatahub/test-curl-7381-139766017578592"
Sep 09 14:30:25.799465 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:30:25.799362    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7381-139766017578592\" is forbidden: User \"system:node:ip-10-0-140-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-6.ec2.internal' and this object" podUID="c02b8d00-81e5-4e8b-85ae-1652e0f3b02f" pod="opendatahub/test-curl-7381-139766017578592"
Sep 09 14:30:25.801668 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:25.801633    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c02b8d00-81e5-4e8b-85ae-1652e0f3b02f" path="/var/lib/kubelet/pods/c02b8d00-81e5-4e8b-85ae-1652e0f3b02f/volumes"
Sep 09 14:30:26.573996 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:26.573950    2562 generic.go:356] "Generic (PLEG): container finished" podID="928ce959-9917-452f-a48c-9691769d7250" containerID="cce63bbbb2b7c3a16fb190aa9757e54b9f90b30148e7f29a8989cff94e187411" exitCode=0
Sep 09 14:30:26.574214 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:26.574037    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-139766017579168" event={"ID":"928ce959-9917-452f-a48c-9691769d7250","Type":"ContainerDied","Data":"cce63bbbb2b7c3a16fb190aa9757e54b9f90b30148e7f29a8989cff94e187411"}
Sep 09 14:30:27.123959 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:27.123903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:27.732390 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:27.732362    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-139766017579168"
Sep 09 14:30:27.751415 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:27.751379    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7381-139766017579168_928ce959-9917-452f-a48c-9691769d7250/test-curl-7381-139766017579168/0.log"
Sep 09 14:30:27.774417 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:27.774365    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7381-139766017579168"]
Sep 09 14:30:27.777955 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:27.777921    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7381-139766017579168"]
Sep 09 14:30:27.840875 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:27.840761    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqtsq\" (UniqueName: \"kubernetes.io/projected/928ce959-9917-452f-a48c-9691769d7250-kube-api-access-mqtsq\") pod \"928ce959-9917-452f-a48c-9691769d7250\" (UID: \"928ce959-9917-452f-a48c-9691769d7250\") "
Sep 09 14:30:27.843017 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:27.842973    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/928ce959-9917-452f-a48c-9691769d7250-kube-api-access-mqtsq" (OuterVolumeSpecName: "kube-api-access-mqtsq") pod "928ce959-9917-452f-a48c-9691769d7250" (UID: "928ce959-9917-452f-a48c-9691769d7250"). InnerVolumeSpecName "kube-api-access-mqtsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:30:27.896468 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:27.896430    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7381-139766017579168"]
Sep 09 14:30:27.896900 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:27.896884    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="928ce959-9917-452f-a48c-9691769d7250" containerName="test-curl-7381-139766017579168"
Sep 09 14:30:27.896943 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:27.896901    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="928ce959-9917-452f-a48c-9691769d7250" containerName="test-curl-7381-139766017579168"
Sep 09 14:30:27.896976 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:27.896971    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="928ce959-9917-452f-a48c-9691769d7250" containerName="test-curl-7381-139766017579168"
Sep 09 14:30:27.900154 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:27.900131    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-139766017579168"
Sep 09 14:30:27.907152 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:27.907114    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-139766017579168"]
Sep 09 14:30:27.942712 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:27.942672    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqtsq\" (UniqueName: \"kubernetes.io/projected/928ce959-9917-452f-a48c-9691769d7250-kube-api-access-mqtsq\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:30:28.044139 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:28.044091    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkltl\" (UniqueName: \"kubernetes.io/projected/fe0994da-5983-49a4-b4ae-a50994aae89c-kube-api-access-wkltl\") pod \"test-curl-7381-139766017579168\" (UID: \"fe0994da-5983-49a4-b4ae-a50994aae89c\") " pod="opendatahub/test-curl-7381-139766017579168"
Sep 09 14:30:28.145468 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:28.145363    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkltl\" (UniqueName: \"kubernetes.io/projected/fe0994da-5983-49a4-b4ae-a50994aae89c-kube-api-access-wkltl\") pod \"test-curl-7381-139766017579168\" (UID: \"fe0994da-5983-49a4-b4ae-a50994aae89c\") " pod="opendatahub/test-curl-7381-139766017579168"
Sep 09 14:30:28.153908 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:28.153865    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkltl\" (UniqueName: \"kubernetes.io/projected/fe0994da-5983-49a4-b4ae-a50994aae89c-kube-api-access-wkltl\") pod \"test-curl-7381-139766017579168\" (UID: \"fe0994da-5983-49a4-b4ae-a50994aae89c\") " pod="opendatahub/test-curl-7381-139766017579168"
Sep 09 14:30:28.211930 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:28.211887    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-139766017579168"
Sep 09 14:30:28.487480 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:28.487448    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7381-139766017579168"]
Sep 09 14:30:28.489742 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:30:28.489711    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe0994da_5983_49a4_b4ae_a50994aae89c.slice/crio-87dba6e834a5ea27aa47d88c29b5e9f1db28101fa5902dcc7beb9fcacd2f5a7d WatchSource:0}: Error finding container 87dba6e834a5ea27aa47d88c29b5e9f1db28101fa5902dcc7beb9fcacd2f5a7d: Status 404 returned error can't find the container with id 87dba6e834a5ea27aa47d88c29b5e9f1db28101fa5902dcc7beb9fcacd2f5a7d
Sep 09 14:30:28.588341 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:28.588307    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-139766017579168"
Sep 09 14:30:28.588541 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:28.588363    2562 scope.go:117] "RemoveContainer" containerID="cce63bbbb2b7c3a16fb190aa9757e54b9f90b30148e7f29a8989cff94e187411"
Sep 09 14:30:28.590060 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:28.590033    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-139766017579168" event={"ID":"fe0994da-5983-49a4-b4ae-a50994aae89c","Type":"ContainerStarted","Data":"87dba6e834a5ea27aa47d88c29b5e9f1db28101fa5902dcc7beb9fcacd2f5a7d"}
Sep 09 14:30:29.597723 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:29.597683    2562 generic.go:356] "Generic (PLEG): container finished" podID="fe0994da-5983-49a4-b4ae-a50994aae89c" containerID="fe707682a7d2721dc0e55838b23b016bdafa13573c0d2e8a4027e4ae053c7809" exitCode=0
Sep 09 14:30:29.598164 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:29.597768    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7381-139766017579168" event={"ID":"fe0994da-5983-49a4-b4ae-a50994aae89c","Type":"ContainerDied","Data":"fe707682a7d2721dc0e55838b23b016bdafa13573c0d2e8a4027e4ae053c7809"}
Sep 09 14:30:29.800861 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:29.800820    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="928ce959-9917-452f-a48c-9691769d7250" path="/var/lib/kubelet/pods/928ce959-9917-452f-a48c-9691769d7250/volumes"
Sep 09 14:30:30.755066 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:30.755025    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-139766017579168"
Sep 09 14:30:30.775287 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:30.775249    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7381-139766017579168_fe0994da-5983-49a4-b4ae-a50994aae89c/test-curl-7381-139766017579168/0.log"
Sep 09 14:30:30.798110 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:30.798061    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7381-139766017579168"]
Sep 09 14:30:30.802129 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:30.802089    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7381-139766017579168"]
Sep 09 14:30:30.873232 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:30.873096    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkltl\" (UniqueName: \"kubernetes.io/projected/fe0994da-5983-49a4-b4ae-a50994aae89c-kube-api-access-wkltl\") pod \"fe0994da-5983-49a4-b4ae-a50994aae89c\" (UID: \"fe0994da-5983-49a4-b4ae-a50994aae89c\") "
Sep 09 14:30:30.875455 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:30.875414    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe0994da-5983-49a4-b4ae-a50994aae89c-kube-api-access-wkltl" (OuterVolumeSpecName: "kube-api-access-wkltl") pod "fe0994da-5983-49a4-b4ae-a50994aae89c" (UID: "fe0994da-5983-49a4-b4ae-a50994aae89c"). InnerVolumeSpecName "kube-api-access-wkltl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:30:30.974417 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:30.974368    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkltl\" (UniqueName: \"kubernetes.io/projected/fe0994da-5983-49a4-b4ae-a50994aae89c-kube-api-access-wkltl\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:30:31.423709 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.423617    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:31.614699 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.614664    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7381-139766017579168"
Sep 09 14:30:31.614699 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.614682    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87dba6e834a5ea27aa47d88c29b5e9f1db28101fa5902dcc7beb9fcacd2f5a7d"
Sep 09 14:30:31.626124 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:30:31.626071    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7381-139766017579168\" is forbidden: User \"system:node:ip-10-0-140-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-6.ec2.internal' and this object" podUID="fe0994da-5983-49a4-b4ae-a50994aae89c" pod="opendatahub/test-curl-7381-139766017579168"
Sep 09 14:30:31.710009 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.709895    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"]
Sep 09 14:30:31.710694 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.710668    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe0994da-5983-49a4-b4ae-a50994aae89c" containerName="test-curl-7381-139766017579168"
Sep 09 14:30:31.710694 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.710694    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe0994da-5983-49a4-b4ae-a50994aae89c" containerName="test-curl-7381-139766017579168"
Sep 09 14:30:31.710844 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.710801    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe0994da-5983-49a4-b4ae-a50994aae89c" containerName="test-curl-7381-139766017579168"
Sep 09 14:30:31.712801 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.712768    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:31.714806 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.714781    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.717005 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.716980    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5b36371b-openshift-default-dockercfg-28xjd\""
Sep 09 14:30:31.726765 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.726727    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"]
Sep 09 14:30:31.744557 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:30:31.744490    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7381-139766017579168\" is forbidden: User \"system:node:ip-10-0-140-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-6.ec2.internal' and this object" podUID="fe0994da-5983-49a4-b4ae-a50994aae89c" pod="opendatahub/test-curl-7381-139766017579168"
Sep 09 14:30:31.782775 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.782721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-podinfo\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.782775 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.782771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-data\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.783328 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.782796    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-token\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.783328 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.782862    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvngg\" (UniqueName: \"kubernetes.io/projected/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-kube-api-access-dvngg\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.783328 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.782914    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-workload-socket\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.783328 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.782948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-workload-certs\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.783328 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.782966    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-credential-socket\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.783328 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.783070    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-envoy\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.783328 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.783121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istiod-ca-cert\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.802913 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.802872    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe0994da-5983-49a4-b4ae-a50994aae89c" path="/var/lib/kubelet/pods/fe0994da-5983-49a4-b4ae-a50994aae89c/volumes"
Sep 09 14:30:31.884345 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.884299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-podinfo\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.884345 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.884346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-data\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.884642 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.884370    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-token\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.884642 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.884400    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvngg\" (UniqueName: \"kubernetes.io/projected/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-kube-api-access-dvngg\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.884642 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.884434    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-workload-socket\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.884642 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.884473    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-workload-certs\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.884642 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.884502    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-credential-socket\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.884642 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.884546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-envoy\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.884642 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.884571    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istiod-ca-cert\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.884995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.884852    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-data\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.884995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.884929    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-workload-socket\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.885106 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.884998    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-workload-certs\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.885106 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.885057    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-credential-socket\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.885416 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.885393    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istiod-ca-cert\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.887079 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.887055    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-envoy\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.887198 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.887153    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-podinfo\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.892549 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.892509    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-token\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:31.892777 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:31.892760    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvngg\" (UniqueName: \"kubernetes.io/projected/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-kube-api-access-dvngg\") pod \"e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") " pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:32.029150 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:32.029042    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:32.314810 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:32.314770    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"]
Sep 09 14:30:32.317062 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:30:32.317025    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd90ea1_98d6_4f20_8159_7f16ddd520aa.slice/crio-6907f6c0b28136fac0f9d32defec2342d38af09ebaf85d4816cb254b77a32b1b WatchSource:0}: Error finding container 6907f6c0b28136fac0f9d32defec2342d38af09ebaf85d4816cb254b77a32b1b: Status 404 returned error can't find the container with id 6907f6c0b28136fac0f9d32defec2342d38af09ebaf85d4816cb254b77a32b1b
Sep 09 14:30:32.319899 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:32.319855    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:30:32.320024 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:32.319942    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:30:32.320024 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:32.319979    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:30:32.623471 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:32.623373    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t" event={"ID":"6bd90ea1-98d6-4f20-8159-7f16ddd520aa","Type":"ContainerStarted","Data":"b92515dc53e3769efb0839740fb4c383b4c6294a864d9bbe23d966feb8a9b90d"}
Sep 09 14:30:32.623471 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:32.623433    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t" event={"ID":"6bd90ea1-98d6-4f20-8159-7f16ddd520aa","Type":"ContainerStarted","Data":"6907f6c0b28136fac0f9d32defec2342d38af09ebaf85d4816cb254b77a32b1b"}
Sep 09 14:30:32.648082 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:32.648021    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t" podStartSLOduration=1.647999507 podStartE2EDuration="1.647999507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:30:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:30:32.646474404 +0000 UTC m=+1197.373014530" watchObservedRunningTime="2026-09-09 14:30:32.647999507 +0000 UTC m=+1197.374539685"
Sep 09 14:30:32.755094 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:32.755057    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:32.855551 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:32.855507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:33.029677 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:33.029555    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:33.035811 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:33.035778    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:33.629986 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:33.629948    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:33.631059 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:33.631034    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:34.607619 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:34.607566    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:34.704488 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:34.704450    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:35.857156 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:35.857113    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:35.863925 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:35.863896    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:30:35.867095 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:35.867056    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:30:35.959037 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:35.958987    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:35.990553 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:35.990516    2562 scope.go:117] "RemoveContainer" containerID="d61a2bfda376f56c334b7f5d9c848c38fd68ac1bb5a780bd12cc15db127cad3c"
Sep 09 14:30:36.000688 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.000662    2562 scope.go:117] "RemoveContainer" containerID="d78828988c667f2d16793d015f307dd24c82a639dcda322a873ef0674696a929"
Sep 09 14:30:36.013192 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.013147    2562 scope.go:117] "RemoveContainer" containerID="537db90f5a4982691fb7a545947b0a4026e47996133dd78dcaeb1f307f03c1c3"
Sep 09 14:30:36.312562 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.312523    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:36.413965 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.413924    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:36.446926 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.446880    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"]
Sep 09 14:30:36.452054 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.452019    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"
Sep 09 14:30:36.454494 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.454461    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-5b36371b-dockercfg-jzhwt\""
Sep 09 14:30:36.454660 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.454464    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-5b36371b\""
Sep 09 14:30:36.460494 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.460457    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"]
Sep 09 14:30:36.479671 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.479629    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"]
Sep 09 14:30:36.483535 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.483503    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"
Sep 09 14:30:36.495841 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.495805    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"]
Sep 09 14:30:36.497274 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.497233    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:36.537033 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.536988    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49088760-0aae-4aef-bb7a-81e297ff8a57-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267\" (UID: \"49088760-0aae-4aef-bb7a-81e297ff8a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"
Sep 09 14:30:36.537257 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.537093    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk6cc\" (UniqueName: \"kubernetes.io/projected/49088760-0aae-4aef-bb7a-81e297ff8a57-kube-api-access-wk6cc\") pod \"payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267\" (UID: \"49088760-0aae-4aef-bb7a-81e297ff8a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"
Sep 09 14:30:36.637951 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.637829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49088760-0aae-4aef-bb7a-81e297ff8a57-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267\" (UID: \"49088760-0aae-4aef-bb7a-81e297ff8a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"
Sep 09 14:30:36.637951 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.637939    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cc5892d-dae1-4328-8ad0-7627c716c481-plugins-config-volume\") pod \"payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd\" (UID: \"6cc5892d-dae1-4328-8ad0-7627c716c481\") " pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"
Sep 09 14:30:36.638265 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.637997    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk6cc\" (UniqueName: \"kubernetes.io/projected/49088760-0aae-4aef-bb7a-81e297ff8a57-kube-api-access-wk6cc\") pod \"payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267\" (UID: \"49088760-0aae-4aef-bb7a-81e297ff8a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"
Sep 09 14:30:36.638265 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.638066    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p87fw\" (UniqueName: \"kubernetes.io/projected/6cc5892d-dae1-4328-8ad0-7627c716c481-kube-api-access-p87fw\") pod \"payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd\" (UID: \"6cc5892d-dae1-4328-8ad0-7627c716c481\") " pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"
Sep 09 14:30:36.639129 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.639099    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49088760-0aae-4aef-bb7a-81e297ff8a57-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267\" (UID: \"49088760-0aae-4aef-bb7a-81e297ff8a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"
Sep 09 14:30:36.648123 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.648089    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk6cc\" (UniqueName: \"kubernetes.io/projected/49088760-0aae-4aef-bb7a-81e297ff8a57-kube-api-access-wk6cc\") pod \"payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267\" (UID: \"49088760-0aae-4aef-bb7a-81e297ff8a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"
Sep 09 14:30:36.739322 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.739267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p87fw\" (UniqueName: \"kubernetes.io/projected/6cc5892d-dae1-4328-8ad0-7627c716c481-kube-api-access-p87fw\") pod \"payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd\" (UID: \"6cc5892d-dae1-4328-8ad0-7627c716c481\") " pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"
Sep 09 14:30:36.739551 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.739451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cc5892d-dae1-4328-8ad0-7627c716c481-plugins-config-volume\") pod \"payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd\" (UID: \"6cc5892d-dae1-4328-8ad0-7627c716c481\") " pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"
Sep 09 14:30:36.740527 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.740494    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cc5892d-dae1-4328-8ad0-7627c716c481-plugins-config-volume\") pod \"payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd\" (UID: \"6cc5892d-dae1-4328-8ad0-7627c716c481\") " pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"
Sep 09 14:30:36.748006 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.747973    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p87fw\" (UniqueName: \"kubernetes.io/projected/6cc5892d-dae1-4328-8ad0-7627c716c481-kube-api-access-p87fw\") pod \"payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd\" (UID: \"6cc5892d-dae1-4328-8ad0-7627c716c481\") " pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"
Sep 09 14:30:36.767055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.766987    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"
Sep 09 14:30:36.798376 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:36.798337    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"
Sep 09 14:30:37.053302 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:37.053266    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"]
Sep 09 14:30:37.054885 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:30:37.054853    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49088760_0aae_4aef_bb7a_81e297ff8a57.slice/crio-c97d76c2ac4032be6b4982017e1578333f09328ed92a72f67502626905c96431 WatchSource:0}: Error finding container c97d76c2ac4032be6b4982017e1578333f09328ed92a72f67502626905c96431: Status 404 returned error can't find the container with id c97d76c2ac4032be6b4982017e1578333f09328ed92a72f67502626905c96431
Sep 09 14:30:37.099690 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:37.099586    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"]
Sep 09 14:30:37.103212 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:30:37.103127    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc5892d_dae1_4328_8ad0_7627c716c481.slice/crio-fc2152316291cfc539aabe3ba274f20ab848318bf2236183956e09721036d2eb WatchSource:0}: Error finding container fc2152316291cfc539aabe3ba274f20ab848318bf2236183956e09721036d2eb: Status 404 returned error can't find the container with id fc2152316291cfc539aabe3ba274f20ab848318bf2236183956e09721036d2eb
Sep 09 14:30:37.667732 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:37.667691    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd" event={"ID":"6cc5892d-dae1-4328-8ad0-7627c716c481","Type":"ContainerStarted","Data":"568c7d98dbdfb853f5fc55804ec48143c153e463fc0cbab790624fed044f85d4"}
Sep 09 14:30:37.667992 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:37.667894    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"
Sep 09 14:30:37.667992 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:37.667955    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd" event={"ID":"6cc5892d-dae1-4328-8ad0-7627c716c481","Type":"ContainerStarted","Data":"fc2152316291cfc539aabe3ba274f20ab848318bf2236183956e09721036d2eb"}
Sep 09 14:30:37.669624 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:37.669588    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267" event={"ID":"49088760-0aae-4aef-bb7a-81e297ff8a57","Type":"ContainerStarted","Data":"5671619ea790cde6025139ab91b4fff1569eb262f7240b867e645a330517fcd1"}
Sep 09 14:30:37.669792 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:37.669646    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267" event={"ID":"49088760-0aae-4aef-bb7a-81e297ff8a57","Type":"ContainerStarted","Data":"c97d76c2ac4032be6b4982017e1578333f09328ed92a72f67502626905c96431"}
Sep 09 14:30:37.669792 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:37.669760    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"
Sep 09 14:30:37.684672 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:37.684595    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd" podStartSLOduration=1.684570216 podStartE2EDuration="1.684570216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:30:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:30:37.683413706 +0000 UTC m=+1202.409953808" watchObservedRunningTime="2026-09-09 14:30:37.684570216 +0000 UTC m=+1202.411110324"
Sep 09 14:30:37.700874 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:37.700805    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267" podStartSLOduration=1.7007844479999998 podStartE2EDuration="1.700784448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:30:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:30:37.697928853 +0000 UTC m=+1202.424468956" watchObservedRunningTime="2026-09-09 14:30:37.700784448 +0000 UTC m=+1202.427324547"
Sep 09 14:30:38.030032 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:38.029935    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:30:48.681766 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:48.681726    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"
Sep 09 14:30:48.682298 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:48.682141    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"
Sep 09 14:30:57.843391 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:57.843353    2562 generic.go:356] "Generic (PLEG): container finished" podID="6bd90ea1-98d6-4f20-8159-7f16ddd520aa" containerID="b92515dc53e3769efb0839740fb4c383b4c6294a864d9bbe23d966feb8a9b90d" exitCode=0
Sep 09 14:30:57.843948 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:57.843425    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t" event={"ID":"6bd90ea1-98d6-4f20-8159-7f16ddd520aa","Type":"ContainerDied","Data":"b92515dc53e3769efb0839740fb4c383b4c6294a864d9bbe23d966feb8a9b90d"}
Sep 09 14:30:57.843948 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:57.843907    2562 scope.go:117] "RemoveContainer" containerID="b92515dc53e3769efb0839740fb4c383b4c6294a864d9bbe23d966feb8a9b90d"
Sep 09 14:30:57.845387 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:57.845355    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:30:57.845479 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:57.845431    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:30:57.845479 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:57.845469    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:30:58.858364 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:58.858319    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t" event={"ID":"6bd90ea1-98d6-4f20-8159-7f16ddd520aa","Type":"ContainerStarted","Data":"6cbf853ff3cde32bd6ffd36032a92bf1f9191481b8e6e0ade2911515ec0bb04d"}
Sep 09 14:30:59.029888 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:59.029837    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:30:59.031552 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:59.031517    2562 patch_prober.go:28] interesting pod/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 09 14:30:59.031704 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:59.031574    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t" podUID="6bd90ea1-98d6-4f20-8159-7f16ddd520aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 09 14:30:59.613453 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:30:59.613401    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:31:00.030540 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:00.030441    2562 patch_prober.go:28] interesting pod/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 09 14:31:00.030540 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:00.030512    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t" podUID="6bd90ea1-98d6-4f20-8159-7f16ddd520aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 09 14:31:01.030242 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:01.030201    2562 patch_prober.go:28] interesting pod/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 09 14:31:01.030453 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:01.030280    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t" podUID="6bd90ea1-98d6-4f20-8159-7f16ddd520aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 09 14:31:02.029857 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:02.029811    2562 patch_prober.go:28] interesting pod/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 09 14:31:02.030294 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:02.029878    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t" podUID="6bd90ea1-98d6-4f20-8159-7f16ddd520aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 09 14:31:03.030233 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:03.030148    2562 patch_prober.go:28] interesting pod/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 09 14:31:03.030656 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:03.030265    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t" podUID="6bd90ea1-98d6-4f20-8159-7f16ddd520aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 09 14:31:03.630217 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:03.630150    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:31:04.030916 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:04.030720    2562 patch_prober.go:28] interesting pod/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 09 14:31:04.030916 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:04.030858    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t" podUID="6bd90ea1-98d6-4f20-8159-7f16ddd520aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 09 14:31:05.033838 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:05.033803    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:31:05.034857 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:05.034833    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:31:07.434463 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:07.434421    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:31:21.773033 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:21.772998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:31:36.061116 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:36.061046    2562 scope.go:117] "RemoveContainer" containerID="05e1d2403b233991576dcc68f7365745fa6d31a9394a7b0f38f7afd523c313c1"
Sep 09 14:31:43.067971 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:43.067934    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:31:55.790806 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:55.790767    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8"]
Sep 09 14:31:55.796811 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:55.796790    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8"
Sep 09 14:31:55.799861 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:55.799491    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:31:55.799861 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:55.799499    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:31:55.805717 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:55.805693    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8"]
Sep 09 14:31:55.887721 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:55.887674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/646cedf2-b73d-421b-8c50-b43f97336b8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8\" (UID: \"646cedf2-b73d-421b-8c50-b43f97336b8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8"
Sep 09 14:31:55.988875 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:55.988840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/646cedf2-b73d-421b-8c50-b43f97336b8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8\" (UID: \"646cedf2-b73d-421b-8c50-b43f97336b8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8"
Sep 09 14:31:55.989509 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:55.989482    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/646cedf2-b73d-421b-8c50-b43f97336b8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8\" (UID: \"646cedf2-b73d-421b-8c50-b43f97336b8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8"
Sep 09 14:31:56.109976 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:56.109947    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8"
Sep 09 14:31:56.386623 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:56.386590    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8"]
Sep 09 14:31:56.389579 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:31:56.389546    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod646cedf2_b73d_421b_8c50_b43f97336b8b.slice/crio-670b70e56b3d79eaa3dfb365e8ed13c081adbc22130189460578e50a3e9f1200 WatchSource:0}: Error finding container 670b70e56b3d79eaa3dfb365e8ed13c081adbc22130189460578e50a3e9f1200: Status 404 returned error can't find the container with id 670b70e56b3d79eaa3dfb365e8ed13c081adbc22130189460578e50a3e9f1200
Sep 09 14:31:57.250556 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:57.250520    2562 generic.go:356] "Generic (PLEG): container finished" podID="646cedf2-b73d-421b-8c50-b43f97336b8b" containerID="072e46ba5e401fc457e87001f7104a9a5203ec288615d2798c2aee830ce2b3ee" exitCode=0
Sep 09 14:31:57.250976 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:57.250602    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8" event={"ID":"646cedf2-b73d-421b-8c50-b43f97336b8b","Type":"ContainerDied","Data":"072e46ba5e401fc457e87001f7104a9a5203ec288615d2798c2aee830ce2b3ee"}
Sep 09 14:31:57.250976 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:57.250681    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8" event={"ID":"646cedf2-b73d-421b-8c50-b43f97336b8b","Type":"ContainerStarted","Data":"670b70e56b3d79eaa3dfb365e8ed13c081adbc22130189460578e50a3e9f1200"}
Sep 09 14:31:58.403904 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:58.403874    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8"
Sep 09 14:31:58.512335 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:58.512238    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/646cedf2-b73d-421b-8c50-b43f97336b8b-maas-api-service-ca\") pod \"646cedf2-b73d-421b-8c50-b43f97336b8b\" (UID: \"646cedf2-b73d-421b-8c50-b43f97336b8b\") "
Sep 09 14:31:58.512617 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:58.512590    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/646cedf2-b73d-421b-8c50-b43f97336b8b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "646cedf2-b73d-421b-8c50-b43f97336b8b" (UID: "646cedf2-b73d-421b-8c50-b43f97336b8b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:31:58.613709 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:58.613673    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/646cedf2-b73d-421b-8c50-b43f97336b8b-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:31:59.265770 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:59.265743    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8"
Sep 09 14:31:59.265937 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:59.265741    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8" event={"ID":"646cedf2-b73d-421b-8c50-b43f97336b8b","Type":"ContainerDied","Data":"670b70e56b3d79eaa3dfb365e8ed13c081adbc22130189460578e50a3e9f1200"}
Sep 09 14:31:59.265937 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:31:59.265868    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="670b70e56b3d79eaa3dfb365e8ed13c081adbc22130189460578e50a3e9f1200"
Sep 09 14:32:11.477494 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.474715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:32:11.477494 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.476686    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"]
Sep 09 14:32:11.477494 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.476977    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd" podUID="6cc5892d-dae1-4328-8ad0-7627c716c481" containerName="payload-processing" containerID="cri-o://568c7d98dbdfb853f5fc55804ec48143c153e463fc0cbab790624fed044f85d4" gracePeriod=30
Sep 09 14:32:11.484278 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.484253    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"]
Sep 09 14:32:11.484465 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.484446    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267" podUID="49088760-0aae-4aef-bb7a-81e297ff8a57" containerName="payload-pre-processing" containerID="cri-o://5671619ea790cde6025139ab91b4fff1569eb262f7240b867e645a330517fcd1" gracePeriod=30
Sep 09 14:32:11.572784 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.572752    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:32:11.665974 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.665941    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8"]
Sep 09 14:32:11.669752 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.669722    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:32:11.671669 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.671611    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5b36371b-ld6g8"]
Sep 09 14:32:11.735109 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.735056    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"
Sep 09 14:32:11.759417 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.759377    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:32:11.777546 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.777526    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"
Sep 09 14:32:11.802153 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.802127    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="646cedf2-b73d-421b-8c50-b43f97336b8b" path="/var/lib/kubelet/pods/646cedf2-b73d-421b-8c50-b43f97336b8b/volumes"
Sep 09 14:32:11.833525 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.833489    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cc5892d-dae1-4328-8ad0-7627c716c481-plugins-config-volume\") pod \"6cc5892d-dae1-4328-8ad0-7627c716c481\" (UID: \"6cc5892d-dae1-4328-8ad0-7627c716c481\") "
Sep 09 14:32:11.833691 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.833538    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p87fw\" (UniqueName: \"kubernetes.io/projected/6cc5892d-dae1-4328-8ad0-7627c716c481-kube-api-access-p87fw\") pod \"6cc5892d-dae1-4328-8ad0-7627c716c481\" (UID: \"6cc5892d-dae1-4328-8ad0-7627c716c481\") "
Sep 09 14:32:11.834771 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.834739    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cc5892d-dae1-4328-8ad0-7627c716c481-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6cc5892d-dae1-4328-8ad0-7627c716c481" (UID: "6cc5892d-dae1-4328-8ad0-7627c716c481"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:32:11.836114 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.836084    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cc5892d-dae1-4328-8ad0-7627c716c481-kube-api-access-p87fw" (OuterVolumeSpecName: "kube-api-access-p87fw") pod "6cc5892d-dae1-4328-8ad0-7627c716c481" (UID: "6cc5892d-dae1-4328-8ad0-7627c716c481"). InnerVolumeSpecName "kube-api-access-p87fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:32:11.935276 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.935164    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk6cc\" (UniqueName: \"kubernetes.io/projected/49088760-0aae-4aef-bb7a-81e297ff8a57-kube-api-access-wk6cc\") pod \"49088760-0aae-4aef-bb7a-81e297ff8a57\" (UID: \"49088760-0aae-4aef-bb7a-81e297ff8a57\") "
Sep 09 14:32:11.935461 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.935394    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49088760-0aae-4aef-bb7a-81e297ff8a57-plugins-config-volume\") pod \"49088760-0aae-4aef-bb7a-81e297ff8a57\" (UID: \"49088760-0aae-4aef-bb7a-81e297ff8a57\") "
Sep 09 14:32:11.935753 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.935733    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6cc5892d-dae1-4328-8ad0-7627c716c481-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:32:11.935850 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.935757    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p87fw\" (UniqueName: \"kubernetes.io/projected/6cc5892d-dae1-4328-8ad0-7627c716c481-kube-api-access-p87fw\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:32:11.935895 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.935851    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49088760-0aae-4aef-bb7a-81e297ff8a57-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "49088760-0aae-4aef-bb7a-81e297ff8a57" (UID: "49088760-0aae-4aef-bb7a-81e297ff8a57"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:32:11.937260 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:11.937214    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49088760-0aae-4aef-bb7a-81e297ff8a57-kube-api-access-wk6cc" (OuterVolumeSpecName: "kube-api-access-wk6cc") pod "49088760-0aae-4aef-bb7a-81e297ff8a57" (UID: "49088760-0aae-4aef-bb7a-81e297ff8a57"). InnerVolumeSpecName "kube-api-access-wk6cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:32:12.036605 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.036538    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk6cc\" (UniqueName: \"kubernetes.io/projected/49088760-0aae-4aef-bb7a-81e297ff8a57-kube-api-access-wk6cc\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:32:12.036605 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.036563    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49088760-0aae-4aef-bb7a-81e297ff8a57-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:32:12.341477 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.341433    2562 generic.go:356] "Generic (PLEG): container finished" podID="6cc5892d-dae1-4328-8ad0-7627c716c481" containerID="568c7d98dbdfb853f5fc55804ec48143c153e463fc0cbab790624fed044f85d4" exitCode=0
Sep 09 14:32:12.341675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.341481    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"
Sep 09 14:32:12.341675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.341507    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd" event={"ID":"6cc5892d-dae1-4328-8ad0-7627c716c481","Type":"ContainerDied","Data":"568c7d98dbdfb853f5fc55804ec48143c153e463fc0cbab790624fed044f85d4"}
Sep 09 14:32:12.341675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.341572    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd" event={"ID":"6cc5892d-dae1-4328-8ad0-7627c716c481","Type":"ContainerDied","Data":"fc2152316291cfc539aabe3ba274f20ab848318bf2236183956e09721036d2eb"}
Sep 09 14:32:12.341675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.341606    2562 scope.go:117] "RemoveContainer" containerID="568c7d98dbdfb853f5fc55804ec48143c153e463fc0cbab790624fed044f85d4"
Sep 09 14:32:12.342966 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.342944    2562 generic.go:356] "Generic (PLEG): container finished" podID="49088760-0aae-4aef-bb7a-81e297ff8a57" containerID="5671619ea790cde6025139ab91b4fff1569eb262f7240b867e645a330517fcd1" exitCode=0
Sep 09 14:32:12.343058 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.342975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267" event={"ID":"49088760-0aae-4aef-bb7a-81e297ff8a57","Type":"ContainerDied","Data":"5671619ea790cde6025139ab91b4fff1569eb262f7240b867e645a330517fcd1"}
Sep 09 14:32:12.343058 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.342995    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"
Sep 09 14:32:12.343058 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.343013    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267" event={"ID":"49088760-0aae-4aef-bb7a-81e297ff8a57","Type":"ContainerDied","Data":"c97d76c2ac4032be6b4982017e1578333f09328ed92a72f67502626905c96431"}
Sep 09 14:32:12.354089 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.354071    2562 scope.go:117] "RemoveContainer" containerID="568c7d98dbdfb853f5fc55804ec48143c153e463fc0cbab790624fed044f85d4"
Sep 09 14:32:12.354510 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:32:12.354488    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"568c7d98dbdfb853f5fc55804ec48143c153e463fc0cbab790624fed044f85d4\": container with ID starting with 568c7d98dbdfb853f5fc55804ec48143c153e463fc0cbab790624fed044f85d4 not found: ID does not exist" containerID="568c7d98dbdfb853f5fc55804ec48143c153e463fc0cbab790624fed044f85d4"
Sep 09 14:32:12.354602 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.354521    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"568c7d98dbdfb853f5fc55804ec48143c153e463fc0cbab790624fed044f85d4"} err="failed to get container status \"568c7d98dbdfb853f5fc55804ec48143c153e463fc0cbab790624fed044f85d4\": rpc error: code = NotFound desc = could not find container \"568c7d98dbdfb853f5fc55804ec48143c153e463fc0cbab790624fed044f85d4\": container with ID starting with 568c7d98dbdfb853f5fc55804ec48143c153e463fc0cbab790624fed044f85d4 not found: ID does not exist"
Sep 09 14:32:12.354602 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.354542    2562 scope.go:117] "RemoveContainer" containerID="5671619ea790cde6025139ab91b4fff1569eb262f7240b867e645a330517fcd1"
Sep 09 14:32:12.363267 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.363250    2562 scope.go:117] "RemoveContainer" containerID="5671619ea790cde6025139ab91b4fff1569eb262f7240b867e645a330517fcd1"
Sep 09 14:32:12.363539 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:32:12.363517    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5671619ea790cde6025139ab91b4fff1569eb262f7240b867e645a330517fcd1\": container with ID starting with 5671619ea790cde6025139ab91b4fff1569eb262f7240b867e645a330517fcd1 not found: ID does not exist" containerID="5671619ea790cde6025139ab91b4fff1569eb262f7240b867e645a330517fcd1"
Sep 09 14:32:12.363600 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.363545    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5671619ea790cde6025139ab91b4fff1569eb262f7240b867e645a330517fcd1"} err="failed to get container status \"5671619ea790cde6025139ab91b4fff1569eb262f7240b867e645a330517fcd1\": rpc error: code = NotFound desc = could not find container \"5671619ea790cde6025139ab91b4fff1569eb262f7240b867e645a330517fcd1\": container with ID starting with 5671619ea790cde6025139ab91b4fff1569eb262f7240b867e645a330517fcd1 not found: ID does not exist"
Sep 09 14:32:12.366501 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.366481    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"]
Sep 09 14:32:12.370429 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.370408    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-5b36371b-8d457df4f-24wdd"]
Sep 09 14:32:12.380240 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.380221    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"]
Sep 09 14:32:12.383272 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:12.383253    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-5b36371b-cc8b4b686-c9267"]
Sep 09 14:32:13.800415 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:13.800382    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49088760-0aae-4aef-bb7a-81e297ff8a57" path="/var/lib/kubelet/pods/49088760-0aae-4aef-bb7a-81e297ff8a57/volumes"
Sep 09 14:32:13.800778 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:13.800733    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cc5892d-dae1-4328-8ad0-7627c716c481" path="/var/lib/kubelet/pods/6cc5892d-dae1-4328-8ad0-7627c716c481/volumes"
Sep 09 14:32:16.508132 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:16.508092    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:32:21.579139 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:21.579100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:32:36.083449 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:36.083414    2562 scope.go:117] "RemoveContainer" containerID="40313c50f8e548fcdfebfd6bbcfff6b19a1ee9751c07514ec1771a2d1f738ba5"
Sep 09 14:32:36.092053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:36.092027    2562 scope.go:117] "RemoveContainer" containerID="fe6af7af0123f89bd0aa4b4a01b71b4299a1427a546e0ab449a89621a4edf729"
Sep 09 14:32:36.100237 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:36.100214    2562 scope.go:117] "RemoveContainer" containerID="3dc39cc414f987da179825f3c52c5ad193ad2d33a7da2cc2e4002edff7628622"
Sep 09 14:32:51.130685 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:51.130647    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:32:58.426529 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:58.426456    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:32:59.154972 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:32:59.154935    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:05.002182 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:05.002135    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:05.102594 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:05.102558    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:05.244302 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:05.244266    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"]
Sep 09 14:33:05.244879 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:05.244815    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t" podUID="6bd90ea1-98d6-4f20-8159-7f16ddd520aa" containerName="istio-proxy" containerID="cri-o://6cbf853ff3cde32bd6ffd36032a92bf1f9191481b8e6e0ade2911515ec0bb04d" gracePeriod=30
Sep 09 14:33:05.258491 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:05.258425    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:06.544508 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:06.544451    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:06.635562 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:06.635527    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:06.735652 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:06.735615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:07.348575 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:07.348538    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:07.447949 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:07.447911    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:07.548836 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:07.548808    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:08.819724 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:08.819689    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:10.506307 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.506281    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:33:10.671228 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.671191    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvngg\" (UniqueName: \"kubernetes.io/projected/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-kube-api-access-dvngg\") pod \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") "
Sep 09 14:33:10.671228 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.671235    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-envoy\") pod \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") "
Sep 09 14:33:10.671457 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.671289    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istiod-ca-cert\") pod \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") "
Sep 09 14:33:10.671457 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.671314    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-workload-certs\") pod \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") "
Sep 09 14:33:10.671457 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.671342    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-credential-socket\") pod \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") "
Sep 09 14:33:10.671457 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.671367    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-podinfo\") pod \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") "
Sep 09 14:33:10.671457 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.671391    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-workload-socket\") pod \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") "
Sep 09 14:33:10.671457 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.671420    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-data\") pod \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") "
Sep 09 14:33:10.671457 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.671446    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-token\") pod \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\" (UID: \"6bd90ea1-98d6-4f20-8159-7f16ddd520aa\") "
Sep 09 14:33:10.671832 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.671650    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6bd90ea1-98d6-4f20-8159-7f16ddd520aa" (UID: "6bd90ea1-98d6-4f20-8159-7f16ddd520aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:33:10.671832 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.671759    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6bd90ea1-98d6-4f20-8159-7f16ddd520aa" (UID: "6bd90ea1-98d6-4f20-8159-7f16ddd520aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:33:10.671832 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.671817    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-credential-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:33:10.671996 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.671853    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-data" (OuterVolumeSpecName: "istio-data") pod "6bd90ea1-98d6-4f20-8159-7f16ddd520aa" (UID: "6bd90ea1-98d6-4f20-8159-7f16ddd520aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:33:10.671996 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.671780    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6bd90ea1-98d6-4f20-8159-7f16ddd520aa" (UID: "6bd90ea1-98d6-4f20-8159-7f16ddd520aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:33:10.671996 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.671872    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6bd90ea1-98d6-4f20-8159-7f16ddd520aa" (UID: "6bd90ea1-98d6-4f20-8159-7f16ddd520aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:33:10.673411 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.673389    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6bd90ea1-98d6-4f20-8159-7f16ddd520aa" (UID: "6bd90ea1-98d6-4f20-8159-7f16ddd520aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:33:10.673524 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.673417    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-kube-api-access-dvngg" (OuterVolumeSpecName: "kube-api-access-dvngg") pod "6bd90ea1-98d6-4f20-8159-7f16ddd520aa" (UID: "6bd90ea1-98d6-4f20-8159-7f16ddd520aa"). InnerVolumeSpecName "kube-api-access-dvngg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:33:10.673524 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.673456    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6bd90ea1-98d6-4f20-8159-7f16ddd520aa" (UID: "6bd90ea1-98d6-4f20-8159-7f16ddd520aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:33:10.673640 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.673623    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-token" (OuterVolumeSpecName: "istio-token") pod "6bd90ea1-98d6-4f20-8159-7f16ddd520aa" (UID: "6bd90ea1-98d6-4f20-8159-7f16ddd520aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:33:10.690012 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.689983    2562 generic.go:356] "Generic (PLEG): container finished" podID="6bd90ea1-98d6-4f20-8159-7f16ddd520aa" containerID="6cbf853ff3cde32bd6ffd36032a92bf1f9191481b8e6e0ade2911515ec0bb04d" exitCode=0
Sep 09 14:33:10.690109 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.690034    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"
Sep 09 14:33:10.690109 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.690065    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t" event={"ID":"6bd90ea1-98d6-4f20-8159-7f16ddd520aa","Type":"ContainerDied","Data":"6cbf853ff3cde32bd6ffd36032a92bf1f9191481b8e6e0ade2911515ec0bb04d"}
Sep 09 14:33:10.690210 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.690121    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t" event={"ID":"6bd90ea1-98d6-4f20-8159-7f16ddd520aa","Type":"ContainerDied","Data":"6907f6c0b28136fac0f9d32defec2342d38af09ebaf85d4816cb254b77a32b1b"}
Sep 09 14:33:10.690210 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.690150    2562 scope.go:117] "RemoveContainer" containerID="6cbf853ff3cde32bd6ffd36032a92bf1f9191481b8e6e0ade2911515ec0bb04d"
Sep 09 14:33:10.699281 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.699263    2562 scope.go:117] "RemoveContainer" containerID="b92515dc53e3769efb0839740fb4c383b4c6294a864d9bbe23d966feb8a9b90d"
Sep 09 14:33:10.707386 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.707368    2562 scope.go:117] "RemoveContainer" containerID="6cbf853ff3cde32bd6ffd36032a92bf1f9191481b8e6e0ade2911515ec0bb04d"
Sep 09 14:33:10.707638 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:33:10.707620    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cbf853ff3cde32bd6ffd36032a92bf1f9191481b8e6e0ade2911515ec0bb04d\": container with ID starting with 6cbf853ff3cde32bd6ffd36032a92bf1f9191481b8e6e0ade2911515ec0bb04d not found: ID does not exist" containerID="6cbf853ff3cde32bd6ffd36032a92bf1f9191481b8e6e0ade2911515ec0bb04d"
Sep 09 14:33:10.707698 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.707645    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cbf853ff3cde32bd6ffd36032a92bf1f9191481b8e6e0ade2911515ec0bb04d"} err="failed to get container status \"6cbf853ff3cde32bd6ffd36032a92bf1f9191481b8e6e0ade2911515ec0bb04d\": rpc error: code = NotFound desc = could not find container \"6cbf853ff3cde32bd6ffd36032a92bf1f9191481b8e6e0ade2911515ec0bb04d\": container with ID starting with 6cbf853ff3cde32bd6ffd36032a92bf1f9191481b8e6e0ade2911515ec0bb04d not found: ID does not exist"
Sep 09 14:33:10.707698 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.707662    2562 scope.go:117] "RemoveContainer" containerID="b92515dc53e3769efb0839740fb4c383b4c6294a864d9bbe23d966feb8a9b90d"
Sep 09 14:33:10.707878 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:33:10.707864    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b92515dc53e3769efb0839740fb4c383b4c6294a864d9bbe23d966feb8a9b90d\": container with ID starting with b92515dc53e3769efb0839740fb4c383b4c6294a864d9bbe23d966feb8a9b90d not found: ID does not exist" containerID="b92515dc53e3769efb0839740fb4c383b4c6294a864d9bbe23d966feb8a9b90d"
Sep 09 14:33:10.707918 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.707880    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b92515dc53e3769efb0839740fb4c383b4c6294a864d9bbe23d966feb8a9b90d"} err="failed to get container status \"b92515dc53e3769efb0839740fb4c383b4c6294a864d9bbe23d966feb8a9b90d\": rpc error: code = NotFound desc = could not find container \"b92515dc53e3769efb0839740fb4c383b4c6294a864d9bbe23d966feb8a9b90d\": container with ID starting with b92515dc53e3769efb0839740fb4c383b4c6294a864d9bbe23d966feb8a9b90d not found: ID does not exist"
Sep 09 14:33:10.711522 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.711501    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"]
Sep 09 14:33:10.715850 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.715831    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5b36371b-openshift-default-68985f86d8-zd28t"]
Sep 09 14:33:10.772746 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.772712    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-envoy\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:33:10.772746 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.772744    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istiod-ca-cert\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:33:10.772746 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.772753    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-workload-certs\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:33:10.772910 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.772761    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-podinfo\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:33:10.772910 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.772770    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-workload-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:33:10.772910 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.772777    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-data\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:33:10.772910 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.772785    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-istio-token\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:33:10.772910 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:10.772793    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvngg\" (UniqueName: \"kubernetes.io/projected/6bd90ea1-98d6-4f20-8159-7f16ddd520aa-kube-api-access-dvngg\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:33:11.800528 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:11.800497    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bd90ea1-98d6-4f20-8159-7f16ddd520aa" path="/var/lib/kubelet/pods/6bd90ea1-98d6-4f20-8159-7f16ddd520aa/volumes"
Sep 09 14:33:14.746347 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:14.746308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:14.816705 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:14.816673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:15.417886 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:15.417853    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:16.585229 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.585190    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7384-26dceb"]
Sep 09 14:33:16.585646 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.585625    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bd90ea1-98d6-4f20-8159-7f16ddd520aa" containerName="istio-proxy"
Sep 09 14:33:16.585717 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.585650    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bd90ea1-98d6-4f20-8159-7f16ddd520aa" containerName="istio-proxy"
Sep 09 14:33:16.585717 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.585665    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49088760-0aae-4aef-bb7a-81e297ff8a57" containerName="payload-pre-processing"
Sep 09 14:33:16.585717 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.585671    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="49088760-0aae-4aef-bb7a-81e297ff8a57" containerName="payload-pre-processing"
Sep 09 14:33:16.585717 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.585690    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cc5892d-dae1-4328-8ad0-7627c716c481" containerName="payload-processing"
Sep 09 14:33:16.585717 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.585698    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cc5892d-dae1-4328-8ad0-7627c716c481" containerName="payload-processing"
Sep 09 14:33:16.585717 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.585719    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="646cedf2-b73d-421b-8c50-b43f97336b8b" containerName="revoke-keys"
Sep 09 14:33:16.585949 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.585728    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="646cedf2-b73d-421b-8c50-b43f97336b8b" containerName="revoke-keys"
Sep 09 14:33:16.585949 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.585823    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cc5892d-dae1-4328-8ad0-7627c716c481" containerName="payload-processing"
Sep 09 14:33:16.585949 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.585833    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bd90ea1-98d6-4f20-8159-7f16ddd520aa" containerName="istio-proxy"
Sep 09 14:33:16.585949 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.585841    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="49088760-0aae-4aef-bb7a-81e297ff8a57" containerName="payload-pre-processing"
Sep 09 14:33:16.585949 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.585851    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="646cedf2-b73d-421b-8c50-b43f97336b8b" containerName="revoke-keys"
Sep 09 14:33:16.590769 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.590745    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7384-26dceb"
Sep 09 14:33:16.593195 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.593156    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-txzw7\""
Sep 09 14:33:16.594259 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.594224    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7384-26dceb"]
Sep 09 14:33:16.727718 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.727686    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pp2v\" (UniqueName: \"kubernetes.io/projected/5948e973-d3b4-42ab-ac8f-6dbf138a0382-kube-api-access-9pp2v\") pod \"mt-curl-7384-26dceb\" (UID: \"5948e973-d3b4-42ab-ac8f-6dbf138a0382\") " pod="opendatahub/mt-curl-7384-26dceb"
Sep 09 14:33:16.828971 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.828937    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pp2v\" (UniqueName: \"kubernetes.io/projected/5948e973-d3b4-42ab-ac8f-6dbf138a0382-kube-api-access-9pp2v\") pod \"mt-curl-7384-26dceb\" (UID: \"5948e973-d3b4-42ab-ac8f-6dbf138a0382\") " pod="opendatahub/mt-curl-7384-26dceb"
Sep 09 14:33:16.836894 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.836830    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pp2v\" (UniqueName: \"kubernetes.io/projected/5948e973-d3b4-42ab-ac8f-6dbf138a0382-kube-api-access-9pp2v\") pod \"mt-curl-7384-26dceb\" (UID: \"5948e973-d3b4-42ab-ac8f-6dbf138a0382\") " pod="opendatahub/mt-curl-7384-26dceb"
Sep 09 14:33:16.902370 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:16.902337    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7384-26dceb"
Sep 09 14:33:17.172671 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:17.172643    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7384-26dceb"]
Sep 09 14:33:17.174091 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:33:17.174064    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5948e973_d3b4_42ab_ac8f_6dbf138a0382.slice/crio-890343e402f1cc0c1f0c7fc018b96f1e7ba8be0e963bd593fe8fb98f5c6b4cea WatchSource:0}: Error finding container 890343e402f1cc0c1f0c7fc018b96f1e7ba8be0e963bd593fe8fb98f5c6b4cea: Status 404 returned error can't find the container with id 890343e402f1cc0c1f0c7fc018b96f1e7ba8be0e963bd593fe8fb98f5c6b4cea
Sep 09 14:33:17.731797 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:17.731759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7384-26dceb" event={"ID":"5948e973-d3b4-42ab-ac8f-6dbf138a0382","Type":"ContainerStarted","Data":"890343e402f1cc0c1f0c7fc018b96f1e7ba8be0e963bd593fe8fb98f5c6b4cea"}
Sep 09 14:33:18.738499 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:18.738461    2562 generic.go:356] "Generic (PLEG): container finished" podID="5948e973-d3b4-42ab-ac8f-6dbf138a0382" containerID="cd94451719337f147cf555c784106a249c301c1eb1fbc1258474668adff4d7a5" exitCode=0
Sep 09 14:33:18.738942 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:18.738542    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7384-26dceb" event={"ID":"5948e973-d3b4-42ab-ac8f-6dbf138a0382","Type":"ContainerDied","Data":"cd94451719337f147cf555c784106a249c301c1eb1fbc1258474668adff4d7a5"}
Sep 09 14:33:19.871252 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:19.871222    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7384-26dceb"
Sep 09 14:33:19.891785 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:19.891744    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7384-26dceb_5948e973-d3b4-42ab-ac8f-6dbf138a0382/mt-curl-7384-26dceb/0.log"
Sep 09 14:33:19.914745 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:19.914716    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7384-26dceb"]
Sep 09 14:33:19.916841 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:19.916814    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7384-26dceb"]
Sep 09 14:33:19.951549 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:19.951517    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pp2v\" (UniqueName: \"kubernetes.io/projected/5948e973-d3b4-42ab-ac8f-6dbf138a0382-kube-api-access-9pp2v\") pod \"5948e973-d3b4-42ab-ac8f-6dbf138a0382\" (UID: \"5948e973-d3b4-42ab-ac8f-6dbf138a0382\") "
Sep 09 14:33:19.953624 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:19.953595    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5948e973-d3b4-42ab-ac8f-6dbf138a0382-kube-api-access-9pp2v" (OuterVolumeSpecName: "kube-api-access-9pp2v") pod "5948e973-d3b4-42ab-ac8f-6dbf138a0382" (UID: "5948e973-d3b4-42ab-ac8f-6dbf138a0382"). InnerVolumeSpecName "kube-api-access-9pp2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:33:20.052352 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:20.052298    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pp2v\" (UniqueName: \"kubernetes.io/projected/5948e973-d3b4-42ab-ac8f-6dbf138a0382-kube-api-access-9pp2v\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:33:20.751895 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:20.751866    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7384-26dceb"
Sep 09 14:33:20.752068 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:20.751918    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="890343e402f1cc0c1f0c7fc018b96f1e7ba8be0e963bd593fe8fb98f5c6b4cea"
Sep 09 14:33:20.761449 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:33:20.761424    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7384-26dceb\" is forbidden: User \"system:node:ip-10-0-140-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-6.ec2.internal' and this object" podUID="5948e973-d3b4-42ab-ac8f-6dbf138a0382" pod="opendatahub/mt-curl-7384-26dceb"
Sep 09 14:33:21.317822 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:21.317779    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:21.799840 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:21.799767    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5948e973-d3b4-42ab-ac8f-6dbf138a0382" path="/var/lib/kubelet/pods/5948e973-d3b4-42ab-ac8f-6dbf138a0382/volumes"
Sep 09 14:33:22.061349 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:22.061310    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:22.163022 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:22.162994    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:24.212195 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:24.212128    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:33.224835 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:33.224792    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:33.324854 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:33.324824    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:36.137040 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:36.137010    2562 scope.go:117] "RemoveContainer" containerID="275fc5e47d872c5b177311256990864f09312e557401e9d9e8bc365f0cc6fd7d"
Sep 09 14:33:42.513200 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:42.513138    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:33:53.966355 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:33:53.966320    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:00.392382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:00.392338    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:00.492638 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:00.492600    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:00.776754 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:00.776661    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:01.009108 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.009071    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"]
Sep 09 14:34:01.009544 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.009519    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5948e973-d3b4-42ab-ac8f-6dbf138a0382" containerName="mt-curl-7384-26dceb"
Sep 09 14:34:01.009544 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.009544    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5948e973-d3b4-42ab-ac8f-6dbf138a0382" containerName="mt-curl-7384-26dceb"
Sep 09 14:34:01.009707 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.009562    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bd90ea1-98d6-4f20-8159-7f16ddd520aa" containerName="istio-proxy"
Sep 09 14:34:01.009707 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.009568    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bd90ea1-98d6-4f20-8159-7f16ddd520aa" containerName="istio-proxy"
Sep 09 14:34:01.009707 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.009636    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5948e973-d3b4-42ab-ac8f-6dbf138a0382" containerName="mt-curl-7384-26dceb"
Sep 09 14:34:01.009707 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.009645    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bd90ea1-98d6-4f20-8159-7f16ddd520aa" containerName="istio-proxy"
Sep 09 14:34:01.014397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.014341    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.017133 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.017109    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-4b83c2-openshift-default-dockercfg-c7p2h\""
Sep 09 14:34:01.024808 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.024784    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"]
Sep 09 14:34:01.075044 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.075013    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:01.122381 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.122341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-envoy\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.122561 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.122390    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f3ed25f-2731-4916-8f3d-747570194aa3-istiod-ca-cert\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.122561 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.122422    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-token\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.122561 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.122508    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-workload-socket\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.122561 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.122555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-workload-certs\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.122696 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.122599    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-podinfo\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.122696 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.122619    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-credential-socket\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.122696 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.122643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4zwp\" (UniqueName: \"kubernetes.io/projected/8f3ed25f-2731-4916-8f3d-747570194aa3-kube-api-access-l4zwp\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.122696 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.122670    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-data\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.176634 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.176600    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:01.223363 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.223328    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-workload-socket\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.223557 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.223376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-workload-certs\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.223557 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.223405    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-podinfo\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.223557 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.223425    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-credential-socket\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.223557 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.223449    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4zwp\" (UniqueName: \"kubernetes.io/projected/8f3ed25f-2731-4916-8f3d-747570194aa3-kube-api-access-l4zwp\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.223557 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.223467    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-data\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.223557 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.223491    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-envoy\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.223557 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.223526    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f3ed25f-2731-4916-8f3d-747570194aa3-istiod-ca-cert\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.224086 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.223562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-token\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.224086 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.223771    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-workload-socket\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.224086 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.223864    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-credential-socket\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.224086 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.223956    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-data\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.224086 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.223970    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-workload-certs\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.232186 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.224702    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f3ed25f-2731-4916-8f3d-747570194aa3-istiod-ca-cert\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.232186 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.226221    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-envoy\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.232186 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.230266    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-podinfo\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.233163 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.232898    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-token\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.233404 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.233383    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4zwp\" (UniqueName: \"kubernetes.io/projected/8f3ed25f-2731-4916-8f3d-747570194aa3-kube-api-access-l4zwp\") pod \"e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") " pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.325871 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.325780    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:01.606141 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.606110    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"]
Sep 09 14:34:01.608247 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:34:01.608222    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f3ed25f_2731_4916_8f3d_747570194aa3.slice/crio-87c4fe1799f2259f66106590d453748418d7c28f32f32a3cdb7cb7a5aa62552e WatchSource:0}: Error finding container 87c4fe1799f2259f66106590d453748418d7c28f32f32a3cdb7cb7a5aa62552e: Status 404 returned error can't find the container with id 87c4fe1799f2259f66106590d453748418d7c28f32f32a3cdb7cb7a5aa62552e
Sep 09 14:34:01.610542 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.610502    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:34:01.610652 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.610594    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:34:01.610652 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.610638    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:34:01.987603 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.987506    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn" event={"ID":"8f3ed25f-2731-4916-8f3d-747570194aa3","Type":"ContainerStarted","Data":"8aac56b8b6e4cd60d1070a938c690beb48de2e0d6589a354a23a4140f333d0c1"}
Sep 09 14:34:01.987603 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:01.987566    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn" event={"ID":"8f3ed25f-2731-4916-8f3d-747570194aa3","Type":"ContainerStarted","Data":"87c4fe1799f2259f66106590d453748418d7c28f32f32a3cdb7cb7a5aa62552e"}
Sep 09 14:34:02.012858 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:02.012798    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn" podStartSLOduration=2.012777835 podStartE2EDuration="2.012777835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:34:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:34:02.009801034 +0000 UTC m=+1406.736341137" watchObservedRunningTime="2026-09-09 14:34:02.012777835 +0000 UTC m=+1406.739317938"
Sep 09 14:34:02.326861 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:02.326810    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:02.328468 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:02.328439    2562 patch_prober.go:28] interesting pod/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 09 14:34:02.328603 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:02.328489    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn" podUID="8f3ed25f-2731-4916-8f3d-747570194aa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 09 14:34:03.330421 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:03.330390    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:03.965632 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:03.965597    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:03.999883 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:03.999853    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:04.001051 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:04.001027    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:04.063400 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:04.063368    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:05.100231 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:05.100191    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:05.222770 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:05.222739    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:05.340460 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:05.340426    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:05.708688 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:05.708644    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:05.797400 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:05.797363    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:05.800282 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:05.800256    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"]
Sep 09 14:34:05.802725 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:05.802706    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"
Sep 09 14:34:05.805104 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:05.805085    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-4b83c2-dockercfg-rqwqj\""
Sep 09 14:34:05.805235 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:05.805159    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-4b83c2\""
Sep 09 14:34:05.810912 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:05.810889    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"]
Sep 09 14:34:05.868313 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:05.868280    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dffdbfa-bbb2-42b2-982b-a7fdc04fb689-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5\" (UID: \"7dffdbfa-bbb2-42b2-982b-a7fdc04fb689\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"
Sep 09 14:34:05.868481 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:05.868330    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkb4w\" (UniqueName: \"kubernetes.io/projected/7dffdbfa-bbb2-42b2-982b-a7fdc04fb689-kube-api-access-bkb4w\") pod \"payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5\" (UID: \"7dffdbfa-bbb2-42b2-982b-a7fdc04fb689\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"
Sep 09 14:34:05.969718 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:05.969633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dffdbfa-bbb2-42b2-982b-a7fdc04fb689-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5\" (UID: \"7dffdbfa-bbb2-42b2-982b-a7fdc04fb689\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"
Sep 09 14:34:05.969718 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:05.969694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkb4w\" (UniqueName: \"kubernetes.io/projected/7dffdbfa-bbb2-42b2-982b-a7fdc04fb689-kube-api-access-bkb4w\") pod \"payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5\" (UID: \"7dffdbfa-bbb2-42b2-982b-a7fdc04fb689\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"
Sep 09 14:34:05.970396 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:05.970373    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dffdbfa-bbb2-42b2-982b-a7fdc04fb689-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5\" (UID: \"7dffdbfa-bbb2-42b2-982b-a7fdc04fb689\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"
Sep 09 14:34:05.978157 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:05.978134    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkb4w\" (UniqueName: \"kubernetes.io/projected/7dffdbfa-bbb2-42b2-982b-a7fdc04fb689-kube-api-access-bkb4w\") pod \"payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5\" (UID: \"7dffdbfa-bbb2-42b2-982b-a7fdc04fb689\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"
Sep 09 14:34:06.115408 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:06.115354    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"
Sep 09 14:34:06.418428 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:06.418401    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"]
Sep 09 14:34:06.420578 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:34:06.420551    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dffdbfa_bbb2_42b2_982b_a7fdc04fb689.slice/crio-3ea4f63499e6f84a87ad907ef0f200dfe7beafd88ea6e1191e6912c35850d810 WatchSource:0}: Error finding container 3ea4f63499e6f84a87ad907ef0f200dfe7beafd88ea6e1191e6912c35850d810: Status 404 returned error can't find the container with id 3ea4f63499e6f84a87ad907ef0f200dfe7beafd88ea6e1191e6912c35850d810
Sep 09 14:34:07.019250 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:07.019211    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5" event={"ID":"7dffdbfa-bbb2-42b2-982b-a7fdc04fb689","Type":"ContainerStarted","Data":"410938df9c63e9763df53231c523160ea1363977564ef7b9d767fabf8d0fb12b"}
Sep 09 14:34:07.019437 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:07.019267    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5" event={"ID":"7dffdbfa-bbb2-42b2-982b-a7fdc04fb689","Type":"ContainerStarted","Data":"3ea4f63499e6f84a87ad907ef0f200dfe7beafd88ea6e1191e6912c35850d810"}
Sep 09 14:34:07.019437 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:07.019322    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"
Sep 09 14:34:07.040234 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:07.040141    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5" podStartSLOduration=2.040122228 podStartE2EDuration="2.040122228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:34:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:34:07.036848807 +0000 UTC m=+1411.763388909" watchObservedRunningTime="2026-09-09 14:34:07.040122228 +0000 UTC m=+1411.766662331"
Sep 09 14:34:18.027365 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:18.027327    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"
Sep 09 14:34:25.136014 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:25.135977    2562 generic.go:356] "Generic (PLEG): container finished" podID="8f3ed25f-2731-4916-8f3d-747570194aa3" containerID="8aac56b8b6e4cd60d1070a938c690beb48de2e0d6589a354a23a4140f333d0c1" exitCode=0
Sep 09 14:34:25.136536 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:25.136050    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn" event={"ID":"8f3ed25f-2731-4916-8f3d-747570194aa3","Type":"ContainerDied","Data":"8aac56b8b6e4cd60d1070a938c690beb48de2e0d6589a354a23a4140f333d0c1"}
Sep 09 14:34:25.136536 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:25.136525    2562 scope.go:117] "RemoveContainer" containerID="8aac56b8b6e4cd60d1070a938c690beb48de2e0d6589a354a23a4140f333d0c1"
Sep 09 14:34:25.137685 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:25.137658    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:34:25.137757 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:25.137721    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:34:25.137757 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:25.137750    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:34:26.146306 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:26.146269    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn" event={"ID":"8f3ed25f-2731-4916-8f3d-747570194aa3","Type":"ContainerStarted","Data":"7f75e5d3ea26d4d3ab7c510eade184f768674b44bd2cb16fab03b718fb2a4088"}
Sep 09 14:34:26.326595 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:26.326559    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:26.326856 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:26.326831    2562 patch_prober.go:28] interesting pod/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 09 14:34:26.326955 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:26.326900    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn" podUID="8f3ed25f-2731-4916-8f3d-747570194aa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 09 14:34:27.327108 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:27.327071    2562 patch_prober.go:28] interesting pod/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 09 14:34:27.327529 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:27.327136    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn" podUID="8f3ed25f-2731-4916-8f3d-747570194aa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 09 14:34:28.326451 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:28.326357    2562 patch_prober.go:28] interesting pod/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 09 14:34:28.326451 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:28.326422    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn" podUID="8f3ed25f-2731-4916-8f3d-747570194aa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 09 14:34:29.032266 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:29.032228    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:29.327020 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:29.326984    2562 patch_prober.go:28] interesting pod/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 09 14:34:29.327215 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:29.327043    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn" podUID="8f3ed25f-2731-4916-8f3d-747570194aa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 09 14:34:29.515444 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:29.515409    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:29.870698 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:29.870637    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:30.254921 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:30.254816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:30.327182 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:30.327144    2562 patch_prober.go:28] interesting pod/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 09 14:34:30.327377 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:30.327232    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn" podUID="8f3ed25f-2731-4916-8f3d-747570194aa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 09 14:34:31.326490 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:31.326455    2562 patch_prober.go:28] interesting pod/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 09 14:34:31.326858 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:31.326523    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn" podUID="8f3ed25f-2731-4916-8f3d-747570194aa3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 09 14:34:32.330255 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:32.330224    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:32.330620 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:32.330589    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:32.331330 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:32.331304    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:34:32.808539 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:32.808504    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:33.294278 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:33.294191    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:33.400657 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:33.400624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:34.527205 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:34.527152    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:34.593136 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:34.593073    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:34.818109 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:34.818072    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:34.976941 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:34.976900    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:35.064106 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.064064    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:35.065681 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.065655    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"]
Sep 09 14:34:35.070387 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.070335    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"
Sep 09 14:34:35.072382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.072363    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-a959bc\""
Sep 09 14:34:35.072483 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.072442    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-a959bc-dockercfg-pl7ss\""
Sep 09 14:34:35.079727 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.079704    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"]
Sep 09 14:34:35.098883 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.098856    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"]
Sep 09 14:34:35.102384 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.102366    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"
Sep 09 14:34:35.116705 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.116684    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"]
Sep 09 14:34:35.150615 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.150583    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f19195f2-b991-4f6e-92a2-fc73524298a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn\" (UID: \"f19195f2-b991-4f6e-92a2-fc73524298a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"
Sep 09 14:34:35.150744 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.150660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9z95\" (UniqueName: \"kubernetes.io/projected/f19195f2-b991-4f6e-92a2-fc73524298a2-kube-api-access-j9z95\") pod \"payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn\" (UID: \"f19195f2-b991-4f6e-92a2-fc73524298a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"
Sep 09 14:34:35.251945 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.251901    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f19195f2-b991-4f6e-92a2-fc73524298a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn\" (UID: \"f19195f2-b991-4f6e-92a2-fc73524298a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"
Sep 09 14:34:35.252129 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.251989    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9z95\" (UniqueName: \"kubernetes.io/projected/f19195f2-b991-4f6e-92a2-fc73524298a2-kube-api-access-j9z95\") pod \"payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn\" (UID: \"f19195f2-b991-4f6e-92a2-fc73524298a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"
Sep 09 14:34:35.252129 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.252034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6z9d\" (UniqueName: \"kubernetes.io/projected/c73bb435-9751-4d0a-9eeb-2699159df57a-kube-api-access-t6z9d\") pod \"payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82\" (UID: \"c73bb435-9751-4d0a-9eeb-2699159df57a\") " pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"
Sep 09 14:34:35.252129 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.252105    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c73bb435-9751-4d0a-9eeb-2699159df57a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82\" (UID: \"c73bb435-9751-4d0a-9eeb-2699159df57a\") " pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"
Sep 09 14:34:35.253155 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.253129    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f19195f2-b991-4f6e-92a2-fc73524298a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn\" (UID: \"f19195f2-b991-4f6e-92a2-fc73524298a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"
Sep 09 14:34:35.260955 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.260934    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9z95\" (UniqueName: \"kubernetes.io/projected/f19195f2-b991-4f6e-92a2-fc73524298a2-kube-api-access-j9z95\") pod \"payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn\" (UID: \"f19195f2-b991-4f6e-92a2-fc73524298a2\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"
Sep 09 14:34:35.353665 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.353590    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6z9d\" (UniqueName: \"kubernetes.io/projected/c73bb435-9751-4d0a-9eeb-2699159df57a-kube-api-access-t6z9d\") pod \"payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82\" (UID: \"c73bb435-9751-4d0a-9eeb-2699159df57a\") " pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"
Sep 09 14:34:35.353665 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.353646    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c73bb435-9751-4d0a-9eeb-2699159df57a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82\" (UID: \"c73bb435-9751-4d0a-9eeb-2699159df57a\") " pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"
Sep 09 14:34:35.354403 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.354379    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c73bb435-9751-4d0a-9eeb-2699159df57a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82\" (UID: \"c73bb435-9751-4d0a-9eeb-2699159df57a\") " pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"
Sep 09 14:34:35.361220 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.361188    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6z9d\" (UniqueName: \"kubernetes.io/projected/c73bb435-9751-4d0a-9eeb-2699159df57a-kube-api-access-t6z9d\") pod \"payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82\" (UID: \"c73bb435-9751-4d0a-9eeb-2699159df57a\") " pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"
Sep 09 14:34:35.380922 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.380899    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"
Sep 09 14:34:35.412801 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.412777    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"
Sep 09 14:34:35.656527 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.656500    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"]
Sep 09 14:34:35.658084 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:34:35.658057    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19195f2_b991_4f6e_92a2_fc73524298a2.slice/crio-639e53744938768484c4a49284ec5d07ed21e9b102574d1e2e507552166249a5 WatchSource:0}: Error finding container 639e53744938768484c4a49284ec5d07ed21e9b102574d1e2e507552166249a5: Status 404 returned error can't find the container with id 639e53744938768484c4a49284ec5d07ed21e9b102574d1e2e507552166249a5
Sep 09 14:34:35.702676 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:35.702653    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"]
Sep 09 14:34:36.169252 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:36.169220    2562 scope.go:117] "RemoveContainer" containerID="74dd5e01ad0f3345c18c886b2df893be53ec62cebcd21020055890b63f9fa48b"
Sep 09 14:34:36.214837 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:36.214804    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn" event={"ID":"f19195f2-b991-4f6e-92a2-fc73524298a2","Type":"ContainerStarted","Data":"7ff7c0e370aa638aab18653128f935484adeb18ee2d3dc0fa69210ee98bce7a4"}
Sep 09 14:34:36.214965 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:36.214867    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn" event={"ID":"f19195f2-b991-4f6e-92a2-fc73524298a2","Type":"ContainerStarted","Data":"639e53744938768484c4a49284ec5d07ed21e9b102574d1e2e507552166249a5"}
Sep 09 14:34:36.214965 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:36.214945    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"
Sep 09 14:34:36.216292 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:36.216271    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82" event={"ID":"c73bb435-9751-4d0a-9eeb-2699159df57a","Type":"ContainerStarted","Data":"a3dbc3aecd9e930d37ecf42e8e3c563977500b873a9ec70f7e88321ff4b1a084"}
Sep 09 14:34:36.216380 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:36.216305    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82" event={"ID":"c73bb435-9751-4d0a-9eeb-2699159df57a","Type":"ContainerStarted","Data":"2ff7c74dddcbcb3ceeb2680caa1f13e59749623c40c517d08603dfeab389abba"}
Sep 09 14:34:36.216380 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:36.216346    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"
Sep 09 14:34:36.231532 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:36.231495    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn" podStartSLOduration=1.231482311 podStartE2EDuration="1.231482311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:34:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:34:36.229561187 +0000 UTC m=+1440.956101289" watchObservedRunningTime="2026-09-09 14:34:36.231482311 +0000 UTC m=+1440.958022412"
Sep 09 14:34:36.246811 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:36.246753    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82" podStartSLOduration=1.2467357940000001 podStartE2EDuration="1.246735794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:34:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:34:36.243916547 +0000 UTC m=+1440.970456649" watchObservedRunningTime="2026-09-09 14:34:36.246735794 +0000 UTC m=+1440.973275893"
Sep 09 14:34:46.734937 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:46.734886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:47.225988 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:47.225953    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"
Sep 09 14:34:47.226183 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:47.226033    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"
Sep 09 14:34:55.230272 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:55.230225    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:56.221229 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:56.221188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:34:58.273586 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:34:58.273531    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:01.331102 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:01.331064    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v"]
Sep 09 14:35:01.336230 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:01.336210    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v"
Sep 09 14:35:01.343012 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:01.340785    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:35:01.343012 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:01.341042    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:35:01.346253 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:01.345735    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v"]
Sep 09 14:35:01.384181 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:01.384139    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcb2fdfc-3d20-4537-8f10-744d6d1df9ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v\" (UID: \"fcb2fdfc-3d20-4537-8f10-744d6d1df9ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v"
Sep 09 14:35:01.485426 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:01.485385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcb2fdfc-3d20-4537-8f10-744d6d1df9ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v\" (UID: \"fcb2fdfc-3d20-4537-8f10-744d6d1df9ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v"
Sep 09 14:35:01.486025 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:01.486002    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcb2fdfc-3d20-4537-8f10-744d6d1df9ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v\" (UID: \"fcb2fdfc-3d20-4537-8f10-744d6d1df9ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v"
Sep 09 14:35:01.547979 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:01.547944    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:01.654151 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:01.654064    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v"
Sep 09 14:35:01.928502 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:01.928466    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v"]
Sep 09 14:35:01.929989 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:35:01.929963    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb2fdfc_3d20_4537_8f10_744d6d1df9ea.slice/crio-a14fe1f8d27d2611e363f245117f437c15a56dd854d618e88418ff77664659d6 WatchSource:0}: Error finding container a14fe1f8d27d2611e363f245117f437c15a56dd854d618e88418ff77664659d6: Status 404 returned error can't find the container with id a14fe1f8d27d2611e363f245117f437c15a56dd854d618e88418ff77664659d6
Sep 09 14:35:02.176015 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:02.175968    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:02.379545 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:02.379508    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v" event={"ID":"fcb2fdfc-3d20-4537-8f10-744d6d1df9ea","Type":"ContainerStarted","Data":"919224175b5fe63bd904f77a8ecbe09ba12836eff1974bc4bc7d432df2df61c1"}
Sep 09 14:35:02.379954 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:02.379562    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v" event={"ID":"fcb2fdfc-3d20-4537-8f10-744d6d1df9ea","Type":"ContainerStarted","Data":"a14fe1f8d27d2611e363f245117f437c15a56dd854d618e88418ff77664659d6"}
Sep 09 14:35:02.396260 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:02.396211    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v" podStartSLOduration=1.396193889 podStartE2EDuration="1.396193889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:35:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:35:02.393528511 +0000 UTC m=+1467.120068613" watchObservedRunningTime="2026-09-09 14:35:02.396193889 +0000 UTC m=+1467.122733989"
Sep 09 14:35:02.827356 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:02.827313    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:03.387933 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:03.387892    2562 generic.go:356] "Generic (PLEG): container finished" podID="fcb2fdfc-3d20-4537-8f10-744d6d1df9ea" containerID="919224175b5fe63bd904f77a8ecbe09ba12836eff1974bc4bc7d432df2df61c1" exitCode=0
Sep 09 14:35:03.388325 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:03.387948    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v" event={"ID":"fcb2fdfc-3d20-4537-8f10-744d6d1df9ea","Type":"ContainerDied","Data":"919224175b5fe63bd904f77a8ecbe09ba12836eff1974bc4bc7d432df2df61c1"}
Sep 09 14:35:04.530208 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:04.530186    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v"
Sep 09 14:35:04.616634 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:04.616598    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcb2fdfc-3d20-4537-8f10-744d6d1df9ea-maas-api-service-ca\") pod \"fcb2fdfc-3d20-4537-8f10-744d6d1df9ea\" (UID: \"fcb2fdfc-3d20-4537-8f10-744d6d1df9ea\") "
Sep 09 14:35:04.616953 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:04.616931    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcb2fdfc-3d20-4537-8f10-744d6d1df9ea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fcb2fdfc-3d20-4537-8f10-744d6d1df9ea" (UID: "fcb2fdfc-3d20-4537-8f10-744d6d1df9ea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:35:04.717404 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:04.717319    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fcb2fdfc-3d20-4537-8f10-744d6d1df9ea-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:05.409291 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:05.409251    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v" event={"ID":"fcb2fdfc-3d20-4537-8f10-744d6d1df9ea","Type":"ContainerDied","Data":"a14fe1f8d27d2611e363f245117f437c15a56dd854d618e88418ff77664659d6"}
Sep 09 14:35:05.409291 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:05.409277    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v"
Sep 09 14:35:05.409484 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:05.409323    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a14fe1f8d27d2611e363f245117f437c15a56dd854d618e88418ff77664659d6"
Sep 09 14:35:15.727023 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:15.726986    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:16.848889 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:16.848855    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:16.876984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:16.876951    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"]
Sep 09 14:35:16.877261 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:16.877230    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5" podUID="7dffdbfa-bbb2-42b2-982b-a7fdc04fb689" containerName="payload-pre-processing" containerID="cri-o://410938df9c63e9763df53231c523160ea1363977564ef7b9d767fabf8d0fb12b" gracePeriod=30
Sep 09 14:35:16.949155 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:16.949118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:17.029874 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.029836    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v"]
Sep 09 14:35:17.031768 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.031732    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:17.032750 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.032731    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4b83c2-4gx5v"]
Sep 09 14:35:17.133262 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.133239    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"
Sep 09 14:35:17.227717 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.227683    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dffdbfa-bbb2-42b2-982b-a7fdc04fb689-plugins-config-volume\") pod \"7dffdbfa-bbb2-42b2-982b-a7fdc04fb689\" (UID: \"7dffdbfa-bbb2-42b2-982b-a7fdc04fb689\") "
Sep 09 14:35:17.227881 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.227769    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkb4w\" (UniqueName: \"kubernetes.io/projected/7dffdbfa-bbb2-42b2-982b-a7fdc04fb689-kube-api-access-bkb4w\") pod \"7dffdbfa-bbb2-42b2-982b-a7fdc04fb689\" (UID: \"7dffdbfa-bbb2-42b2-982b-a7fdc04fb689\") "
Sep 09 14:35:17.228027 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.228001    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dffdbfa-bbb2-42b2-982b-a7fdc04fb689-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7dffdbfa-bbb2-42b2-982b-a7fdc04fb689" (UID: "7dffdbfa-bbb2-42b2-982b-a7fdc04fb689"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:35:17.229910 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.229887    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dffdbfa-bbb2-42b2-982b-a7fdc04fb689-kube-api-access-bkb4w" (OuterVolumeSpecName: "kube-api-access-bkb4w") pod "7dffdbfa-bbb2-42b2-982b-a7fdc04fb689" (UID: "7dffdbfa-bbb2-42b2-982b-a7fdc04fb689"). InnerVolumeSpecName "kube-api-access-bkb4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:35:17.328615 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.328585    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkb4w\" (UniqueName: \"kubernetes.io/projected/7dffdbfa-bbb2-42b2-982b-a7fdc04fb689-kube-api-access-bkb4w\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:17.328615 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.328611    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7dffdbfa-bbb2-42b2-982b-a7fdc04fb689-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:17.332995 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.332963    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:17.433948 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.433863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:17.481993 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.481961    2562 generic.go:356] "Generic (PLEG): container finished" podID="7dffdbfa-bbb2-42b2-982b-a7fdc04fb689" containerID="410938df9c63e9763df53231c523160ea1363977564ef7b9d767fabf8d0fb12b" exitCode=0
Sep 09 14:35:17.482116 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.482015    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"
Sep 09 14:35:17.482116 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.482025    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5" event={"ID":"7dffdbfa-bbb2-42b2-982b-a7fdc04fb689","Type":"ContainerDied","Data":"410938df9c63e9763df53231c523160ea1363977564ef7b9d767fabf8d0fb12b"}
Sep 09 14:35:17.482116 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.482096    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5" event={"ID":"7dffdbfa-bbb2-42b2-982b-a7fdc04fb689","Type":"ContainerDied","Data":"3ea4f63499e6f84a87ad907ef0f200dfe7beafd88ea6e1191e6912c35850d810"}
Sep 09 14:35:17.482257 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.482121    2562 scope.go:117] "RemoveContainer" containerID="410938df9c63e9763df53231c523160ea1363977564ef7b9d767fabf8d0fb12b"
Sep 09 14:35:17.491332 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.491316    2562 scope.go:117] "RemoveContainer" containerID="410938df9c63e9763df53231c523160ea1363977564ef7b9d767fabf8d0fb12b"
Sep 09 14:35:17.491569 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:35:17.491551    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"410938df9c63e9763df53231c523160ea1363977564ef7b9d767fabf8d0fb12b\": container with ID starting with 410938df9c63e9763df53231c523160ea1363977564ef7b9d767fabf8d0fb12b not found: ID does not exist" containerID="410938df9c63e9763df53231c523160ea1363977564ef7b9d767fabf8d0fb12b"
Sep 09 14:35:17.491612 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.491577    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"410938df9c63e9763df53231c523160ea1363977564ef7b9d767fabf8d0fb12b"} err="failed to get container status \"410938df9c63e9763df53231c523160ea1363977564ef7b9d767fabf8d0fb12b\": rpc error: code = NotFound desc = could not find container \"410938df9c63e9763df53231c523160ea1363977564ef7b9d767fabf8d0fb12b\": container with ID starting with 410938df9c63e9763df53231c523160ea1363977564ef7b9d767fabf8d0fb12b not found: ID does not exist"
Sep 09 14:35:17.503370 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.503347    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"]
Sep 09 14:35:17.506860 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.506831    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-4b83c2-7f7bff475d-7nmd5"]
Sep 09 14:35:17.800847 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.800777    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dffdbfa-bbb2-42b2-982b-a7fdc04fb689" path="/var/lib/kubelet/pods/7dffdbfa-bbb2-42b2-982b-a7fdc04fb689/volumes"
Sep 09 14:35:17.801118 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:17.801105    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcb2fdfc-3d20-4537-8f10-744d6d1df9ea" path="/var/lib/kubelet/pods/fcb2fdfc-3d20-4537-8f10-744d6d1df9ea/volumes"
Sep 09 14:35:23.494920 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:23.494881    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:23.551351 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:23.551321    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:23.749133 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:23.749047    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"]
Sep 09 14:35:23.749333 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:23.749283    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn" podUID="8f3ed25f-2731-4916-8f3d-747570194aa3" containerName="istio-proxy" containerID="cri-o://7f75e5d3ea26d4d3ab7c510eade184f768674b44bd2cb16fab03b718fb2a4088" gracePeriod=30
Sep 09 14:35:23.764358 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:23.764329    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:24.102325 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:24.102284    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a959bc-m79rs"]
Sep 09 14:35:24.102741 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:24.102729    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcb2fdfc-3d20-4537-8f10-744d6d1df9ea" containerName="revoke-keys"
Sep 09 14:35:24.102786 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:24.102743    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcb2fdfc-3d20-4537-8f10-744d6d1df9ea" containerName="revoke-keys"
Sep 09 14:35:24.102786 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:24.102764    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dffdbfa-bbb2-42b2-982b-a7fdc04fb689" containerName="payload-pre-processing"
Sep 09 14:35:24.102786 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:24.102770    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dffdbfa-bbb2-42b2-982b-a7fdc04fb689" containerName="payload-pre-processing"
Sep 09 14:35:24.102882 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:24.102832    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dffdbfa-bbb2-42b2-982b-a7fdc04fb689" containerName="payload-pre-processing"
Sep 09 14:35:24.102882 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:24.102840    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcb2fdfc-3d20-4537-8f10-744d6d1df9ea" containerName="revoke-keys"
Sep 09 14:35:24.107516 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:24.107496    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a959bc-m79rs"
Sep 09 14:35:24.110345 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:24.110318    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:35:24.110455 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:24.110396    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:35:24.114709 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:24.114678    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a959bc-m79rs"]
Sep 09 14:35:24.195165 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:24.195129    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a641dd59-ed58-4ee5-9662-c0e18f91b9b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a959bc-m79rs\" (UID: \"a641dd59-ed58-4ee5-9662-c0e18f91b9b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a959bc-m79rs"
Sep 09 14:35:24.296031 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:24.295992    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a641dd59-ed58-4ee5-9662-c0e18f91b9b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a959bc-m79rs\" (UID: \"a641dd59-ed58-4ee5-9662-c0e18f91b9b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a959bc-m79rs"
Sep 09 14:35:24.296616 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:24.296595    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a641dd59-ed58-4ee5-9662-c0e18f91b9b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a959bc-m79rs\" (UID: \"a641dd59-ed58-4ee5-9662-c0e18f91b9b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a959bc-m79rs"
Sep 09 14:35:24.420010 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:24.419915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a959bc-m79rs"
Sep 09 14:35:24.694742 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:24.694709    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a959bc-m79rs"]
Sep 09 14:35:24.696521 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:35:24.696494    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda641dd59_ed58_4ee5_9662_c0e18f91b9b6.slice/crio-eaf20cde23125b151e5f9be6585aaaacaed5dce286b409e6cdddcb7932a0a595 WatchSource:0}: Error finding container eaf20cde23125b151e5f9be6585aaaacaed5dce286b409e6cdddcb7932a0a595: Status 404 returned error can't find the container with id eaf20cde23125b151e5f9be6585aaaacaed5dce286b409e6cdddcb7932a0a595
Sep 09 14:35:25.531797 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:25.531766    2562 generic.go:356] "Generic (PLEG): container finished" podID="a641dd59-ed58-4ee5-9662-c0e18f91b9b6" containerID="48ff73a9880717ebe236fac07c3f011eab477564245f309a2b17c25d26818b43" exitCode=0
Sep 09 14:35:25.531987 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:25.531854    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a959bc-m79rs" event={"ID":"a641dd59-ed58-4ee5-9662-c0e18f91b9b6","Type":"ContainerDied","Data":"48ff73a9880717ebe236fac07c3f011eab477564245f309a2b17c25d26818b43"}
Sep 09 14:35:25.531987 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:25.531907    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a959bc-m79rs" event={"ID":"a641dd59-ed58-4ee5-9662-c0e18f91b9b6","Type":"ContainerStarted","Data":"eaf20cde23125b151e5f9be6585aaaacaed5dce286b409e6cdddcb7932a0a595"}
Sep 09 14:35:25.781477 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:25.781393    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:26.680074 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:26.680048    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a959bc-m79rs"
Sep 09 14:35:26.815492 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:26.815467    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a641dd59-ed58-4ee5-9662-c0e18f91b9b6-maas-api-service-ca\") pod \"a641dd59-ed58-4ee5-9662-c0e18f91b9b6\" (UID: \"a641dd59-ed58-4ee5-9662-c0e18f91b9b6\") "
Sep 09 14:35:26.815910 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:26.815844    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a641dd59-ed58-4ee5-9662-c0e18f91b9b6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a641dd59-ed58-4ee5-9662-c0e18f91b9b6" (UID: "a641dd59-ed58-4ee5-9662-c0e18f91b9b6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:35:26.917209 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:26.917165    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a641dd59-ed58-4ee5-9662-c0e18f91b9b6-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:27.546240 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:27.546211    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a959bc-m79rs"
Sep 09 14:35:27.546481 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:27.546235    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a959bc-m79rs" event={"ID":"a641dd59-ed58-4ee5-9662-c0e18f91b9b6","Type":"ContainerDied","Data":"eaf20cde23125b151e5f9be6585aaaacaed5dce286b409e6cdddcb7932a0a595"}
Sep 09 14:35:27.546481 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:27.546282    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eaf20cde23125b151e5f9be6585aaaacaed5dce286b409e6cdddcb7932a0a595"
Sep 09 14:35:27.921944 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:27.921912    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:29.032030 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.032008    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:35:29.137432 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.137394    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-credential-socket\") pod \"8f3ed25f-2731-4916-8f3d-747570194aa3\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") "
Sep 09 14:35:29.137610 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.137461    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-token\") pod \"8f3ed25f-2731-4916-8f3d-747570194aa3\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") "
Sep 09 14:35:29.137610 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.137497    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f3ed25f-2731-4916-8f3d-747570194aa3-istiod-ca-cert\") pod \"8f3ed25f-2731-4916-8f3d-747570194aa3\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") "
Sep 09 14:35:29.137610 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.137528    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-envoy\") pod \"8f3ed25f-2731-4916-8f3d-747570194aa3\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") "
Sep 09 14:35:29.137610 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.137542    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-workload-socket\") pod \"8f3ed25f-2731-4916-8f3d-747570194aa3\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") "
Sep 09 14:35:29.137828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.137624    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-workload-certs\") pod \"8f3ed25f-2731-4916-8f3d-747570194aa3\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") "
Sep 09 14:35:29.137828 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.137739    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8f3ed25f-2731-4916-8f3d-747570194aa3" (UID: "8f3ed25f-2731-4916-8f3d-747570194aa3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:35:29.137930 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.137906    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8f3ed25f-2731-4916-8f3d-747570194aa3" (UID: "8f3ed25f-2731-4916-8f3d-747570194aa3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:35:29.137991 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.137954    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f3ed25f-2731-4916-8f3d-747570194aa3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8f3ed25f-2731-4916-8f3d-747570194aa3" (UID: "8f3ed25f-2731-4916-8f3d-747570194aa3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:35:29.138053 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.137662    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4zwp\" (UniqueName: \"kubernetes.io/projected/8f3ed25f-2731-4916-8f3d-747570194aa3-kube-api-access-l4zwp\") pod \"8f3ed25f-2731-4916-8f3d-747570194aa3\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") "
Sep 09 14:35:29.138102 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.138059    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-data\") pod \"8f3ed25f-2731-4916-8f3d-747570194aa3\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") "
Sep 09 14:35:29.138102 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.138093    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-podinfo\") pod \"8f3ed25f-2731-4916-8f3d-747570194aa3\" (UID: \"8f3ed25f-2731-4916-8f3d-747570194aa3\") "
Sep 09 14:35:29.138268 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.138243    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8f3ed25f-2731-4916-8f3d-747570194aa3" (UID: "8f3ed25f-2731-4916-8f3d-747570194aa3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:35:29.138365 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.138339    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-data" (OuterVolumeSpecName: "istio-data") pod "8f3ed25f-2731-4916-8f3d-747570194aa3" (UID: "8f3ed25f-2731-4916-8f3d-747570194aa3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:35:29.138559 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.138540    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-data\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:29.138630 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.138565    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-credential-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:29.138630 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.138582    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f3ed25f-2731-4916-8f3d-747570194aa3-istiod-ca-cert\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:29.138630 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.138595    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-workload-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:29.138630 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.138607    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-workload-certs\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:29.139850 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.139807    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8f3ed25f-2731-4916-8f3d-747570194aa3" (UID: "8f3ed25f-2731-4916-8f3d-747570194aa3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:35:29.139964 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.139846    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-token" (OuterVolumeSpecName: "istio-token") pod "8f3ed25f-2731-4916-8f3d-747570194aa3" (UID: "8f3ed25f-2731-4916-8f3d-747570194aa3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:35:29.140015 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.139981    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f3ed25f-2731-4916-8f3d-747570194aa3-kube-api-access-l4zwp" (OuterVolumeSpecName: "kube-api-access-l4zwp") pod "8f3ed25f-2731-4916-8f3d-747570194aa3" (UID: "8f3ed25f-2731-4916-8f3d-747570194aa3"). InnerVolumeSpecName "kube-api-access-l4zwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:35:29.140251 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.140231    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8f3ed25f-2731-4916-8f3d-747570194aa3" (UID: "8f3ed25f-2731-4916-8f3d-747570194aa3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:35:29.239328 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.239295    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-token\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:29.239328 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.239321    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-envoy\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:29.239328 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.239332    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4zwp\" (UniqueName: \"kubernetes.io/projected/8f3ed25f-2731-4916-8f3d-747570194aa3-kube-api-access-l4zwp\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:29.239597 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.239341    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f3ed25f-2731-4916-8f3d-747570194aa3-istio-podinfo\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:29.566009 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.565973    2562 generic.go:356] "Generic (PLEG): container finished" podID="8f3ed25f-2731-4916-8f3d-747570194aa3" containerID="7f75e5d3ea26d4d3ab7c510eade184f768674b44bd2cb16fab03b718fb2a4088" exitCode=0
Sep 09 14:35:29.566009 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.566013    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn" event={"ID":"8f3ed25f-2731-4916-8f3d-747570194aa3","Type":"ContainerDied","Data":"7f75e5d3ea26d4d3ab7c510eade184f768674b44bd2cb16fab03b718fb2a4088"}
Sep 09 14:35:29.566286 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.566029    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"
Sep 09 14:35:29.566286 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.566078    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn" event={"ID":"8f3ed25f-2731-4916-8f3d-747570194aa3","Type":"ContainerDied","Data":"87c4fe1799f2259f66106590d453748418d7c28f32f32a3cdb7cb7a5aa62552e"}
Sep 09 14:35:29.566286 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.566100    2562 scope.go:117] "RemoveContainer" containerID="7f75e5d3ea26d4d3ab7c510eade184f768674b44bd2cb16fab03b718fb2a4088"
Sep 09 14:35:29.575977 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.575959    2562 scope.go:117] "RemoveContainer" containerID="8aac56b8b6e4cd60d1070a938c690beb48de2e0d6589a354a23a4140f333d0c1"
Sep 09 14:35:29.584392 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.584373    2562 scope.go:117] "RemoveContainer" containerID="7f75e5d3ea26d4d3ab7c510eade184f768674b44bd2cb16fab03b718fb2a4088"
Sep 09 14:35:29.584646 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:35:29.584622    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f75e5d3ea26d4d3ab7c510eade184f768674b44bd2cb16fab03b718fb2a4088\": container with ID starting with 7f75e5d3ea26d4d3ab7c510eade184f768674b44bd2cb16fab03b718fb2a4088 not found: ID does not exist" containerID="7f75e5d3ea26d4d3ab7c510eade184f768674b44bd2cb16fab03b718fb2a4088"
Sep 09 14:35:29.584691 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.584658    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f75e5d3ea26d4d3ab7c510eade184f768674b44bd2cb16fab03b718fb2a4088"} err="failed to get container status \"7f75e5d3ea26d4d3ab7c510eade184f768674b44bd2cb16fab03b718fb2a4088\": rpc error: code = NotFound desc = could not find container \"7f75e5d3ea26d4d3ab7c510eade184f768674b44bd2cb16fab03b718fb2a4088\": container with ID starting with 7f75e5d3ea26d4d3ab7c510eade184f768674b44bd2cb16fab03b718fb2a4088 not found: ID does not exist"
Sep 09 14:35:29.584691 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.584679    2562 scope.go:117] "RemoveContainer" containerID="8aac56b8b6e4cd60d1070a938c690beb48de2e0d6589a354a23a4140f333d0c1"
Sep 09 14:35:29.585050 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:35:29.585018    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aac56b8b6e4cd60d1070a938c690beb48de2e0d6589a354a23a4140f333d0c1\": container with ID starting with 8aac56b8b6e4cd60d1070a938c690beb48de2e0d6589a354a23a4140f333d0c1 not found: ID does not exist" containerID="8aac56b8b6e4cd60d1070a938c690beb48de2e0d6589a354a23a4140f333d0c1"
Sep 09 14:35:29.585157 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.585057    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aac56b8b6e4cd60d1070a938c690beb48de2e0d6589a354a23a4140f333d0c1"} err="failed to get container status \"8aac56b8b6e4cd60d1070a938c690beb48de2e0d6589a354a23a4140f333d0c1\": rpc error: code = NotFound desc = could not find container \"8aac56b8b6e4cd60d1070a938c690beb48de2e0d6589a354a23a4140f333d0c1\": container with ID starting with 8aac56b8b6e4cd60d1070a938c690beb48de2e0d6589a354a23a4140f333d0c1 not found: ID does not exist"
Sep 09 14:35:29.588181 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.588149    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"]
Sep 09 14:35:29.591954 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.591932    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-4b83c2-openshift-default-68ddc94776-6t7gn"]
Sep 09 14:35:29.801546 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:29.801511    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f3ed25f-2731-4916-8f3d-747570194aa3" path="/var/lib/kubelet/pods/8f3ed25f-2731-4916-8f3d-747570194aa3/volumes"
Sep 09 14:35:30.815683 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:30.815652    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7384-c45287"]
Sep 09 14:35:30.816121 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:30.816106    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f3ed25f-2731-4916-8f3d-747570194aa3" containerName="istio-proxy"
Sep 09 14:35:30.816191 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:30.816122    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f3ed25f-2731-4916-8f3d-747570194aa3" containerName="istio-proxy"
Sep 09 14:35:30.816191 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:30.816151    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a641dd59-ed58-4ee5-9662-c0e18f91b9b6" containerName="revoke-keys"
Sep 09 14:35:30.816191 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:30.816157    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a641dd59-ed58-4ee5-9662-c0e18f91b9b6" containerName="revoke-keys"
Sep 09 14:35:30.816292 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:30.816260    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a641dd59-ed58-4ee5-9662-c0e18f91b9b6" containerName="revoke-keys"
Sep 09 14:35:30.816292 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:30.816270    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f3ed25f-2731-4916-8f3d-747570194aa3" containerName="istio-proxy"
Sep 09 14:35:30.816292 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:30.816277    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f3ed25f-2731-4916-8f3d-747570194aa3" containerName="istio-proxy"
Sep 09 14:35:30.821223 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:30.821059    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7384-c45287"
Sep 09 14:35:30.823124 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:30.823102    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-txzw7\""
Sep 09 14:35:30.824316 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:30.824289    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7384-c45287"]
Sep 09 14:35:30.953540 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:30.953509    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xw62\" (UniqueName: \"kubernetes.io/projected/a38ebc3b-54de-4cf5-92da-e9c1cfcae521-kube-api-access-4xw62\") pod \"mt-curl-7384-c45287\" (UID: \"a38ebc3b-54de-4cf5-92da-e9c1cfcae521\") " pod="opendatahub/mt-curl-7384-c45287"
Sep 09 14:35:31.054883 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:31.054850    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xw62\" (UniqueName: \"kubernetes.io/projected/a38ebc3b-54de-4cf5-92da-e9c1cfcae521-kube-api-access-4xw62\") pod \"mt-curl-7384-c45287\" (UID: \"a38ebc3b-54de-4cf5-92da-e9c1cfcae521\") " pod="opendatahub/mt-curl-7384-c45287"
Sep 09 14:35:31.063064 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:31.063035    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xw62\" (UniqueName: \"kubernetes.io/projected/a38ebc3b-54de-4cf5-92da-e9c1cfcae521-kube-api-access-4xw62\") pod \"mt-curl-7384-c45287\" (UID: \"a38ebc3b-54de-4cf5-92da-e9c1cfcae521\") " pod="opendatahub/mt-curl-7384-c45287"
Sep 09 14:35:31.132126 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:31.132047    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7384-c45287"
Sep 09 14:35:31.150363 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:31.150333    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:31.404478 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:31.404446    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7384-c45287"]
Sep 09 14:35:31.407104 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:35:31.407071    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda38ebc3b_54de_4cf5_92da_e9c1cfcae521.slice/crio-0965f3ee5e90ae0f3f0e8022810a635f346355fc73f90954b6934e2624f2927e WatchSource:0}: Error finding container 0965f3ee5e90ae0f3f0e8022810a635f346355fc73f90954b6934e2624f2927e: Status 404 returned error can't find the container with id 0965f3ee5e90ae0f3f0e8022810a635f346355fc73f90954b6934e2624f2927e
Sep 09 14:35:31.408486 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:31.408467    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 14:35:31.580061 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:31.580032    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7384-c45287" event={"ID":"a38ebc3b-54de-4cf5-92da-e9c1cfcae521","Type":"ContainerStarted","Data":"0965f3ee5e90ae0f3f0e8022810a635f346355fc73f90954b6934e2624f2927e"}
Sep 09 14:35:32.588064 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:32.588031    2562 generic.go:356] "Generic (PLEG): container finished" podID="a38ebc3b-54de-4cf5-92da-e9c1cfcae521" containerID="f6f5aca8d2f9ac07fe8734efd4c2139589c4d1c55dddb6657f22674652fe434b" exitCode=0
Sep 09 14:35:32.588458 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:32.588115    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7384-c45287" event={"ID":"a38ebc3b-54de-4cf5-92da-e9c1cfcae521","Type":"ContainerDied","Data":"f6f5aca8d2f9ac07fe8734efd4c2139589c4d1c55dddb6657f22674652fe434b"}
Sep 09 14:35:33.734679 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:33.734654    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7384-c45287"
Sep 09 14:35:33.754021 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:33.753992    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7384-c45287_a38ebc3b-54de-4cf5-92da-e9c1cfcae521/mt-curl-7384-c45287/0.log"
Sep 09 14:35:33.777992 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:33.777960    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7384-c45287"]
Sep 09 14:35:33.781364 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:33.781342    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7384-c45287"]
Sep 09 14:35:33.885320 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:33.885250    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xw62\" (UniqueName: \"kubernetes.io/projected/a38ebc3b-54de-4cf5-92da-e9c1cfcae521-kube-api-access-4xw62\") pod \"a38ebc3b-54de-4cf5-92da-e9c1cfcae521\" (UID: \"a38ebc3b-54de-4cf5-92da-e9c1cfcae521\") "
Sep 09 14:35:33.887333 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:33.887305    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a38ebc3b-54de-4cf5-92da-e9c1cfcae521-kube-api-access-4xw62" (OuterVolumeSpecName: "kube-api-access-4xw62") pod "a38ebc3b-54de-4cf5-92da-e9c1cfcae521" (UID: "a38ebc3b-54de-4cf5-92da-e9c1cfcae521"). InnerVolumeSpecName "kube-api-access-4xw62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:35:33.900216 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:33.900192    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7384-e6f1f8"]
Sep 09 14:35:33.900615 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:33.900602    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a38ebc3b-54de-4cf5-92da-e9c1cfcae521" containerName="mt-curl-7384-c45287"
Sep 09 14:35:33.900666 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:33.900617    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a38ebc3b-54de-4cf5-92da-e9c1cfcae521" containerName="mt-curl-7384-c45287"
Sep 09 14:35:33.900666 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:33.900635    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f3ed25f-2731-4916-8f3d-747570194aa3" containerName="istio-proxy"
Sep 09 14:35:33.900666 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:33.900641    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f3ed25f-2731-4916-8f3d-747570194aa3" containerName="istio-proxy"
Sep 09 14:35:33.900762 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:33.900737    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a38ebc3b-54de-4cf5-92da-e9c1cfcae521" containerName="mt-curl-7384-c45287"
Sep 09 14:35:33.903692 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:33.903677    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7384-e6f1f8"
Sep 09 14:35:33.910814 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:33.910755    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7384-e6f1f8"]
Sep 09 14:35:33.986977 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:33.986948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf5c4\" (UniqueName: \"kubernetes.io/projected/ad78a006-9967-419f-9c7f-c8b9a1b9148a-kube-api-access-hf5c4\") pod \"mt-curl-7384-e6f1f8\" (UID: \"ad78a006-9967-419f-9c7f-c8b9a1b9148a\") " pod="opendatahub/mt-curl-7384-e6f1f8"
Sep 09 14:35:33.987135 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:33.987119    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xw62\" (UniqueName: \"kubernetes.io/projected/a38ebc3b-54de-4cf5-92da-e9c1cfcae521-kube-api-access-4xw62\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:34.087785 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:34.087757    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf5c4\" (UniqueName: \"kubernetes.io/projected/ad78a006-9967-419f-9c7f-c8b9a1b9148a-kube-api-access-hf5c4\") pod \"mt-curl-7384-e6f1f8\" (UID: \"ad78a006-9967-419f-9c7f-c8b9a1b9148a\") " pod="opendatahub/mt-curl-7384-e6f1f8"
Sep 09 14:35:34.096269 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:34.096236    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf5c4\" (UniqueName: \"kubernetes.io/projected/ad78a006-9967-419f-9c7f-c8b9a1b9148a-kube-api-access-hf5c4\") pod \"mt-curl-7384-e6f1f8\" (UID: \"ad78a006-9967-419f-9c7f-c8b9a1b9148a\") " pod="opendatahub/mt-curl-7384-e6f1f8"
Sep 09 14:35:34.213564 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:34.213482    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7384-e6f1f8"
Sep 09 14:35:34.348135 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:34.348091    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:34.486006 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:34.485975    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7384-e6f1f8"]
Sep 09 14:35:34.487146 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:35:34.487121    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad78a006_9967_419f_9c7f_c8b9a1b9148a.slice/crio-a80e2f9e8515b13de72227827f040db61f6845940a77b42d8d9b123fc41ce1fe WatchSource:0}: Error finding container a80e2f9e8515b13de72227827f040db61f6845940a77b42d8d9b123fc41ce1fe: Status 404 returned error can't find the container with id a80e2f9e8515b13de72227827f040db61f6845940a77b42d8d9b123fc41ce1fe
Sep 09 14:35:34.601070 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:34.601046    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7384-c45287"
Sep 09 14:35:34.601225 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:34.601100    2562 scope.go:117] "RemoveContainer" containerID="f6f5aca8d2f9ac07fe8734efd4c2139589c4d1c55dddb6657f22674652fe434b"
Sep 09 14:35:34.602673 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:34.602645    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7384-e6f1f8" event={"ID":"ad78a006-9967-419f-9c7f-c8b9a1b9148a","Type":"ContainerStarted","Data":"a80e2f9e8515b13de72227827f040db61f6845940a77b42d8d9b123fc41ce1fe"}
Sep 09 14:35:35.610511 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:35.610470    2562 generic.go:356] "Generic (PLEG): container finished" podID="ad78a006-9967-419f-9c7f-c8b9a1b9148a" containerID="d4141c92414b2e1c49b8de9289bab8146b92ba730157af30e63fdb7a6f97e6a7" exitCode=0
Sep 09 14:35:35.610956 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:35.610559    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7384-e6f1f8" event={"ID":"ad78a006-9967-419f-9c7f-c8b9a1b9148a","Type":"ContainerDied","Data":"d4141c92414b2e1c49b8de9289bab8146b92ba730157af30e63fdb7a6f97e6a7"}
Sep 09 14:35:35.800940 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:35.800911    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a38ebc3b-54de-4cf5-92da-e9c1cfcae521" path="/var/lib/kubelet/pods/a38ebc3b-54de-4cf5-92da-e9c1cfcae521/volumes"
Sep 09 14:35:35.904193 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:35.904111    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:35:35.908535 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:35.908504    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:35:36.195849 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:36.195761    2562 scope.go:117] "RemoveContainer" containerID="b41299d9ed91469abf32e6d91f963ed834f79dcbf3d4d6006c3483cfd5d10c64"
Sep 09 14:35:36.744585 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:36.744556    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7384-e6f1f8"
Sep 09 14:35:36.763657 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:36.763625    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7384-e6f1f8_ad78a006-9967-419f-9c7f-c8b9a1b9148a/mt-curl-7384-e6f1f8/0.log"
Sep 09 14:35:36.785997 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:36.785973    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7384-e6f1f8"]
Sep 09 14:35:36.789397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:36.789374    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7384-e6f1f8"]
Sep 09 14:35:36.913440 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:36.913379    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hf5c4\" (UniqueName: \"kubernetes.io/projected/ad78a006-9967-419f-9c7f-c8b9a1b9148a-kube-api-access-hf5c4\") pod \"ad78a006-9967-419f-9c7f-c8b9a1b9148a\" (UID: \"ad78a006-9967-419f-9c7f-c8b9a1b9148a\") "
Sep 09 14:35:36.915470 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:36.915447    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad78a006-9967-419f-9c7f-c8b9a1b9148a-kube-api-access-hf5c4" (OuterVolumeSpecName: "kube-api-access-hf5c4") pod "ad78a006-9967-419f-9c7f-c8b9a1b9148a" (UID: "ad78a006-9967-419f-9c7f-c8b9a1b9148a"). InnerVolumeSpecName "kube-api-access-hf5c4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:35:37.014886 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:37.014857    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf5c4\" (UniqueName: \"kubernetes.io/projected/ad78a006-9967-419f-9c7f-c8b9a1b9148a-kube-api-access-hf5c4\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:37.623691 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:37.623660    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7384-e6f1f8"
Sep 09 14:35:37.623838 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:37.623666    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a80e2f9e8515b13de72227827f040db61f6845940a77b42d8d9b123fc41ce1fe"
Sep 09 14:35:37.632955 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:35:37.632930    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7384-e6f1f8\" is forbidden: User \"system:node:ip-10-0-140-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-6.ec2.internal' and this object" podUID="ad78a006-9967-419f-9c7f-c8b9a1b9148a" pod="opendatahub/mt-curl-7384-e6f1f8"
Sep 09 14:35:37.800298 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:37.800268    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad78a006-9967-419f-9c7f-c8b9a1b9148a" path="/var/lib/kubelet/pods/ad78a006-9967-419f-9c7f-c8b9a1b9148a/volumes"
Sep 09 14:35:39.086459 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:39.086416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:39.739857 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:39.739824    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:40.008773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.008665    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:40.027719 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.027687    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"]
Sep 09 14:35:40.027970 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.027940    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn" podUID="f19195f2-b991-4f6e-92a2-fc73524298a2" containerName="payload-pre-processing" containerID="cri-o://7ff7c0e370aa638aab18653128f935484adeb18ee2d3dc0fa69210ee98bce7a4" gracePeriod=30
Sep 09 14:35:40.031223 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.031191    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"]
Sep 09 14:35:40.031879 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.031384    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82" podUID="c73bb435-9751-4d0a-9eeb-2699159df57a" containerName="payload-processing" containerID="cri-o://a3dbc3aecd9e930d37ecf42e8e3c563977500b873a9ec70f7e88321ff4b1a084" gracePeriod=30
Sep 09 14:35:40.108522 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.108488    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:40.172337 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.172247    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a959bc-m79rs"]
Sep 09 14:35:40.173980 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.173935    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:40.175865 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.175843    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a959bc-m79rs"]
Sep 09 14:35:40.232102 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.232076    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:40.315688 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.315667    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"
Sep 09 14:35:40.318398 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.318380    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"
Sep 09 14:35:40.445659 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.445632    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c73bb435-9751-4d0a-9eeb-2699159df57a-plugins-config-volume\") pod \"c73bb435-9751-4d0a-9eeb-2699159df57a\" (UID: \"c73bb435-9751-4d0a-9eeb-2699159df57a\") "
Sep 09 14:35:40.445815 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.445695    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9z95\" (UniqueName: \"kubernetes.io/projected/f19195f2-b991-4f6e-92a2-fc73524298a2-kube-api-access-j9z95\") pod \"f19195f2-b991-4f6e-92a2-fc73524298a2\" (UID: \"f19195f2-b991-4f6e-92a2-fc73524298a2\") "
Sep 09 14:35:40.445815 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.445805    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f19195f2-b991-4f6e-92a2-fc73524298a2-plugins-config-volume\") pod \"f19195f2-b991-4f6e-92a2-fc73524298a2\" (UID: \"f19195f2-b991-4f6e-92a2-fc73524298a2\") "
Sep 09 14:35:40.445922 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.445888    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6z9d\" (UniqueName: \"kubernetes.io/projected/c73bb435-9751-4d0a-9eeb-2699159df57a-kube-api-access-t6z9d\") pod \"c73bb435-9751-4d0a-9eeb-2699159df57a\" (UID: \"c73bb435-9751-4d0a-9eeb-2699159df57a\") "
Sep 09 14:35:40.446058 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.446035    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c73bb435-9751-4d0a-9eeb-2699159df57a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c73bb435-9751-4d0a-9eeb-2699159df57a" (UID: "c73bb435-9751-4d0a-9eeb-2699159df57a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:35:40.446237 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.446217    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c73bb435-9751-4d0a-9eeb-2699159df57a-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:40.446321 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.446257    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f19195f2-b991-4f6e-92a2-fc73524298a2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f19195f2-b991-4f6e-92a2-fc73524298a2" (UID: "f19195f2-b991-4f6e-92a2-fc73524298a2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:35:40.447871 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.447847    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f19195f2-b991-4f6e-92a2-fc73524298a2-kube-api-access-j9z95" (OuterVolumeSpecName: "kube-api-access-j9z95") pod "f19195f2-b991-4f6e-92a2-fc73524298a2" (UID: "f19195f2-b991-4f6e-92a2-fc73524298a2"). InnerVolumeSpecName "kube-api-access-j9z95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:35:40.447961 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.447939    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c73bb435-9751-4d0a-9eeb-2699159df57a-kube-api-access-t6z9d" (OuterVolumeSpecName: "kube-api-access-t6z9d") pod "c73bb435-9751-4d0a-9eeb-2699159df57a" (UID: "c73bb435-9751-4d0a-9eeb-2699159df57a"). InnerVolumeSpecName "kube-api-access-t6z9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:35:40.532942 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.532909    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:40.547213 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.547132    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9z95\" (UniqueName: \"kubernetes.io/projected/f19195f2-b991-4f6e-92a2-fc73524298a2-kube-api-access-j9z95\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:40.547213 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.547165    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f19195f2-b991-4f6e-92a2-fc73524298a2-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:40.547213 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.547195    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6z9d\" (UniqueName: \"kubernetes.io/projected/c73bb435-9751-4d0a-9eeb-2699159df57a-kube-api-access-t6z9d\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:40.640992 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.640956    2562 generic.go:356] "Generic (PLEG): container finished" podID="c73bb435-9751-4d0a-9eeb-2699159df57a" containerID="a3dbc3aecd9e930d37ecf42e8e3c563977500b873a9ec70f7e88321ff4b1a084" exitCode=0
Sep 09 14:35:40.641165 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.641007    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"
Sep 09 14:35:40.641165 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.640999    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82" event={"ID":"c73bb435-9751-4d0a-9eeb-2699159df57a","Type":"ContainerDied","Data":"a3dbc3aecd9e930d37ecf42e8e3c563977500b873a9ec70f7e88321ff4b1a084"}
Sep 09 14:35:40.641165 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.641153    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82" event={"ID":"c73bb435-9751-4d0a-9eeb-2699159df57a","Type":"ContainerDied","Data":"2ff7c74dddcbcb3ceeb2680caa1f13e59749623c40c517d08603dfeab389abba"}
Sep 09 14:35:40.641341 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.641198    2562 scope.go:117] "RemoveContainer" containerID="a3dbc3aecd9e930d37ecf42e8e3c563977500b873a9ec70f7e88321ff4b1a084"
Sep 09 14:35:40.642724 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.642696    2562 generic.go:356] "Generic (PLEG): container finished" podID="f19195f2-b991-4f6e-92a2-fc73524298a2" containerID="7ff7c0e370aa638aab18653128f935484adeb18ee2d3dc0fa69210ee98bce7a4" exitCode=0
Sep 09 14:35:40.642841 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.642755    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"
Sep 09 14:35:40.642903 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.642759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn" event={"ID":"f19195f2-b991-4f6e-92a2-fc73524298a2","Type":"ContainerDied","Data":"7ff7c0e370aa638aab18653128f935484adeb18ee2d3dc0fa69210ee98bce7a4"}
Sep 09 14:35:40.642955 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.642919    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn" event={"ID":"f19195f2-b991-4f6e-92a2-fc73524298a2","Type":"ContainerDied","Data":"639e53744938768484c4a49284ec5d07ed21e9b102574d1e2e507552166249a5"}
Sep 09 14:35:40.652784 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.652770    2562 scope.go:117] "RemoveContainer" containerID="a3dbc3aecd9e930d37ecf42e8e3c563977500b873a9ec70f7e88321ff4b1a084"
Sep 09 14:35:40.653090 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:35:40.653062    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3dbc3aecd9e930d37ecf42e8e3c563977500b873a9ec70f7e88321ff4b1a084\": container with ID starting with a3dbc3aecd9e930d37ecf42e8e3c563977500b873a9ec70f7e88321ff4b1a084 not found: ID does not exist" containerID="a3dbc3aecd9e930d37ecf42e8e3c563977500b873a9ec70f7e88321ff4b1a084"
Sep 09 14:35:40.653164 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.653092    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3dbc3aecd9e930d37ecf42e8e3c563977500b873a9ec70f7e88321ff4b1a084"} err="failed to get container status \"a3dbc3aecd9e930d37ecf42e8e3c563977500b873a9ec70f7e88321ff4b1a084\": rpc error: code = NotFound desc = could not find container \"a3dbc3aecd9e930d37ecf42e8e3c563977500b873a9ec70f7e88321ff4b1a084\": container with ID starting with a3dbc3aecd9e930d37ecf42e8e3c563977500b873a9ec70f7e88321ff4b1a084 not found: ID does not exist"
Sep 09 14:35:40.653164 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.653127    2562 scope.go:117] "RemoveContainer" containerID="7ff7c0e370aa638aab18653128f935484adeb18ee2d3dc0fa69210ee98bce7a4"
Sep 09 14:35:40.661492 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.661475    2562 scope.go:117] "RemoveContainer" containerID="7ff7c0e370aa638aab18653128f935484adeb18ee2d3dc0fa69210ee98bce7a4"
Sep 09 14:35:40.661748 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:35:40.661730    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ff7c0e370aa638aab18653128f935484adeb18ee2d3dc0fa69210ee98bce7a4\": container with ID starting with 7ff7c0e370aa638aab18653128f935484adeb18ee2d3dc0fa69210ee98bce7a4 not found: ID does not exist" containerID="7ff7c0e370aa638aab18653128f935484adeb18ee2d3dc0fa69210ee98bce7a4"
Sep 09 14:35:40.661792 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.661754    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ff7c0e370aa638aab18653128f935484adeb18ee2d3dc0fa69210ee98bce7a4"} err="failed to get container status \"7ff7c0e370aa638aab18653128f935484adeb18ee2d3dc0fa69210ee98bce7a4\": rpc error: code = NotFound desc = could not find container \"7ff7c0e370aa638aab18653128f935484adeb18ee2d3dc0fa69210ee98bce7a4\": container with ID starting with 7ff7c0e370aa638aab18653128f935484adeb18ee2d3dc0fa69210ee98bce7a4 not found: ID does not exist"
Sep 09 14:35:40.666298 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.666276    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"]
Sep 09 14:35:40.668547 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.668527    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a959bc-f6c8fd7cf-p4q82"]
Sep 09 14:35:40.677124 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.677100    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"]
Sep 09 14:35:40.683263 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:40.683243    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a959bc-6bd494b9f8-cdtnn"]
Sep 09 14:35:41.800497 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:41.800466    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a641dd59-ed58-4ee5-9662-c0e18f91b9b6" path="/var/lib/kubelet/pods/a641dd59-ed58-4ee5-9662-c0e18f91b9b6/volumes"
Sep 09 14:35:41.800859 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:41.800813    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c73bb435-9751-4d0a-9eeb-2699159df57a" path="/var/lib/kubelet/pods/c73bb435-9751-4d0a-9eeb-2699159df57a/volumes"
Sep 09 14:35:41.801126 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:41.801113    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f19195f2-b991-4f6e-92a2-fc73524298a2" path="/var/lib/kubelet/pods/f19195f2-b991-4f6e-92a2-fc73524298a2/volumes"
Sep 09 14:35:46.612128 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:46.612091    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:46.714873 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:46.714835    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:46.874712 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:46.874619    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:47.226117 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.226038    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq"]
Sep 09 14:35:47.226485 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.226471    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad78a006-9967-419f-9c7f-c8b9a1b9148a" containerName="mt-curl-7384-e6f1f8"
Sep 09 14:35:47.226534 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.226487    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad78a006-9967-419f-9c7f-c8b9a1b9148a" containerName="mt-curl-7384-e6f1f8"
Sep 09 14:35:47.226534 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.226500    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c73bb435-9751-4d0a-9eeb-2699159df57a" containerName="payload-processing"
Sep 09 14:35:47.226534 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.226506    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c73bb435-9751-4d0a-9eeb-2699159df57a" containerName="payload-processing"
Sep 09 14:35:47.226534 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.226523    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f19195f2-b991-4f6e-92a2-fc73524298a2" containerName="payload-pre-processing"
Sep 09 14:35:47.226534 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.226529    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f19195f2-b991-4f6e-92a2-fc73524298a2" containerName="payload-pre-processing"
Sep 09 14:35:47.226679 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.226597    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad78a006-9967-419f-9c7f-c8b9a1b9148a" containerName="mt-curl-7384-e6f1f8"
Sep 09 14:35:47.226679 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.226606    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c73bb435-9751-4d0a-9eeb-2699159df57a" containerName="payload-processing"
Sep 09 14:35:47.226679 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.226611    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f19195f2-b991-4f6e-92a2-fc73524298a2" containerName="payload-pre-processing"
Sep 09 14:35:47.231025 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.231006    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq"
Sep 09 14:35:47.233249 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.233217    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:35:47.233249 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.233237    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:35:47.237753 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.237728    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq"]
Sep 09 14:35:47.299383 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.299349    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28f62fe8-3e7d-4ae5-8805-65e8248555ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq\" (UID: \"28f62fe8-3e7d-4ae5-8805-65e8248555ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq"
Sep 09 14:35:47.330432 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.330390    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:47.400607 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.400572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28f62fe8-3e7d-4ae5-8805-65e8248555ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq\" (UID: \"28f62fe8-3e7d-4ae5-8805-65e8248555ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq"
Sep 09 14:35:47.401236 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.401217    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28f62fe8-3e7d-4ae5-8805-65e8248555ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq\" (UID: \"28f62fe8-3e7d-4ae5-8805-65e8248555ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq"
Sep 09 14:35:47.546697 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.546594    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq"
Sep 09 14:35:47.722906 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.722866    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:47.820136 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:47.820110    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq"]
Sep 09 14:35:47.821853 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:35:47.821827    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f62fe8_3e7d_4ae5_8805_65e8248555ca.slice/crio-0a7046026092720a61b753168783db735031b1ef68d4cdbd96de20f01b1e5e82 WatchSource:0}: Error finding container 0a7046026092720a61b753168783db735031b1ef68d4cdbd96de20f01b1e5e82: Status 404 returned error can't find the container with id 0a7046026092720a61b753168783db735031b1ef68d4cdbd96de20f01b1e5e82
Sep 09 14:35:48.704497 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:48.704465    2562 generic.go:356] "Generic (PLEG): container finished" podID="28f62fe8-3e7d-4ae5-8805-65e8248555ca" containerID="0569eb759a4e71a43d76f39f52a3f258c43907eb0d808c1f7ed59ce21854e3e5" exitCode=0
Sep 09 14:35:48.704624 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:48.704547    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq" event={"ID":"28f62fe8-3e7d-4ae5-8805-65e8248555ca","Type":"ContainerDied","Data":"0569eb759a4e71a43d76f39f52a3f258c43907eb0d808c1f7ed59ce21854e3e5"}
Sep 09 14:35:48.704668 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:48.704624    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq" event={"ID":"28f62fe8-3e7d-4ae5-8805-65e8248555ca","Type":"ContainerStarted","Data":"0a7046026092720a61b753168783db735031b1ef68d4cdbd96de20f01b1e5e82"}
Sep 09 14:35:49.862348 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:49.862322    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq"
Sep 09 14:35:49.936378 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:49.936346    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28f62fe8-3e7d-4ae5-8805-65e8248555ca-maas-api-service-ca\") pod \"28f62fe8-3e7d-4ae5-8805-65e8248555ca\" (UID: \"28f62fe8-3e7d-4ae5-8805-65e8248555ca\") "
Sep 09 14:35:49.936667 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:49.936642    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28f62fe8-3e7d-4ae5-8805-65e8248555ca-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "28f62fe8-3e7d-4ae5-8805-65e8248555ca" (UID: "28f62fe8-3e7d-4ae5-8805-65e8248555ca"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:35:50.037289 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:50.037158    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28f62fe8-3e7d-4ae5-8805-65e8248555ca-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:50.717942 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:50.717912    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq"
Sep 09 14:35:50.718113 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:50.717947    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq" event={"ID":"28f62fe8-3e7d-4ae5-8805-65e8248555ca","Type":"ContainerDied","Data":"0a7046026092720a61b753168783db735031b1ef68d4cdbd96de20f01b1e5e82"}
Sep 09 14:35:50.718113 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:50.718000    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a7046026092720a61b753168783db735031b1ef68d4cdbd96de20f01b1e5e82"
Sep 09 14:35:51.044926 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:51.044834    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:57.678734 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:57.678700    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"]
Sep 09 14:35:57.679277 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:57.679213    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9" podUID="80ba21a3-6730-4448-bf83-235b12821726" containerName="payload-processing" containerID="cri-o://2ad8c0e99538a21261eb590f4ba4208aab50d7539ed5bd45c01c353f9e6dc616" gracePeriod=30
Sep 09 14:35:57.686334 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:57.686306    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"]
Sep 09 14:35:57.686579 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:57.686528    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf" podUID="c31a0cf7-23fc-4ed0-b36a-542c90ca6324" containerName="payload-pre-processing" containerID="cri-o://299d42db3ed62fdf96557df73432b6a516358c3bc2b8487b1a91da35ba54abc8" gracePeriod=30
Sep 09 14:35:57.830063 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:57.829969    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq"]
Sep 09 14:35:57.832363 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:57.832333    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-cbb7fb-qhpjq"]
Sep 09 14:35:57.974873 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:57.974850    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"
Sep 09 14:35:57.977460 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:57.977443    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"
Sep 09 14:35:57.993763 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:57.993617    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7rm5\" (UniqueName: \"kubernetes.io/projected/80ba21a3-6730-4448-bf83-235b12821726-kube-api-access-f7rm5\") pod \"80ba21a3-6730-4448-bf83-235b12821726\" (UID: \"80ba21a3-6730-4448-bf83-235b12821726\") "
Sep 09 14:35:57.993763 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:57.993673    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80ba21a3-6730-4448-bf83-235b12821726-plugins-config-volume\") pod \"80ba21a3-6730-4448-bf83-235b12821726\" (UID: \"80ba21a3-6730-4448-bf83-235b12821726\") "
Sep 09 14:35:57.993763 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:57.993728    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spbm5\" (UniqueName: \"kubernetes.io/projected/c31a0cf7-23fc-4ed0-b36a-542c90ca6324-kube-api-access-spbm5\") pod \"c31a0cf7-23fc-4ed0-b36a-542c90ca6324\" (UID: \"c31a0cf7-23fc-4ed0-b36a-542c90ca6324\") "
Sep 09 14:35:57.993961 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:57.993781    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c31a0cf7-23fc-4ed0-b36a-542c90ca6324-plugins-config-volume\") pod \"c31a0cf7-23fc-4ed0-b36a-542c90ca6324\" (UID: \"c31a0cf7-23fc-4ed0-b36a-542c90ca6324\") "
Sep 09 14:35:57.994478 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:57.994366    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80ba21a3-6730-4448-bf83-235b12821726-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "80ba21a3-6730-4448-bf83-235b12821726" (UID: "80ba21a3-6730-4448-bf83-235b12821726"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:35:57.994478 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:57.994398    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c31a0cf7-23fc-4ed0-b36a-542c90ca6324-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c31a0cf7-23fc-4ed0-b36a-542c90ca6324" (UID: "c31a0cf7-23fc-4ed0-b36a-542c90ca6324"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:35:57.996042 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:57.996015    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80ba21a3-6730-4448-bf83-235b12821726-kube-api-access-f7rm5" (OuterVolumeSpecName: "kube-api-access-f7rm5") pod "80ba21a3-6730-4448-bf83-235b12821726" (UID: "80ba21a3-6730-4448-bf83-235b12821726"). InnerVolumeSpecName "kube-api-access-f7rm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:35:57.996218 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:57.996189    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c31a0cf7-23fc-4ed0-b36a-542c90ca6324-kube-api-access-spbm5" (OuterVolumeSpecName: "kube-api-access-spbm5") pod "c31a0cf7-23fc-4ed0-b36a-542c90ca6324" (UID: "c31a0cf7-23fc-4ed0-b36a-542c90ca6324"). InnerVolumeSpecName "kube-api-access-spbm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:35:58.095013 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.094946    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c31a0cf7-23fc-4ed0-b36a-542c90ca6324-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:58.095013 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.094973    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7rm5\" (UniqueName: \"kubernetes.io/projected/80ba21a3-6730-4448-bf83-235b12821726-kube-api-access-f7rm5\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:58.095013 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.094982    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80ba21a3-6730-4448-bf83-235b12821726-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:58.095013 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.094992    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spbm5\" (UniqueName: \"kubernetes.io/projected/c31a0cf7-23fc-4ed0-b36a-542c90ca6324-kube-api-access-spbm5\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:35:58.760028 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.759999    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:58.766788 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.766759    2562 generic.go:356] "Generic (PLEG): container finished" podID="80ba21a3-6730-4448-bf83-235b12821726" containerID="2ad8c0e99538a21261eb590f4ba4208aab50d7539ed5bd45c01c353f9e6dc616" exitCode=0
Sep 09 14:35:58.766932 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.766804    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"
Sep 09 14:35:58.766932 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.766843    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9" event={"ID":"80ba21a3-6730-4448-bf83-235b12821726","Type":"ContainerDied","Data":"2ad8c0e99538a21261eb590f4ba4208aab50d7539ed5bd45c01c353f9e6dc616"}
Sep 09 14:35:58.766932 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.766898    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9" event={"ID":"80ba21a3-6730-4448-bf83-235b12821726","Type":"ContainerDied","Data":"bc2b118994dd00b82c094cf1e046d320871a52d579345d3ac57365f2586d6297"}
Sep 09 14:35:58.766932 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.766925    2562 scope.go:117] "RemoveContainer" containerID="2ad8c0e99538a21261eb590f4ba4208aab50d7539ed5bd45c01c353f9e6dc616"
Sep 09 14:35:58.768317 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.768294    2562 generic.go:356] "Generic (PLEG): container finished" podID="c31a0cf7-23fc-4ed0-b36a-542c90ca6324" containerID="299d42db3ed62fdf96557df73432b6a516358c3bc2b8487b1a91da35ba54abc8" exitCode=0
Sep 09 14:35:58.768431 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.768343    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"
Sep 09 14:35:58.768431 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.768359    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf" event={"ID":"c31a0cf7-23fc-4ed0-b36a-542c90ca6324","Type":"ContainerDied","Data":"299d42db3ed62fdf96557df73432b6a516358c3bc2b8487b1a91da35ba54abc8"}
Sep 09 14:35:58.768431 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.768399    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf" event={"ID":"c31a0cf7-23fc-4ed0-b36a-542c90ca6324","Type":"ContainerDied","Data":"2d0e3cecd890c5bc1fe53350e649d83274307f68305c92da89771fc6ea1569a9"}
Sep 09 14:35:58.777979 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.777963    2562 scope.go:117] "RemoveContainer" containerID="2ad8c0e99538a21261eb590f4ba4208aab50d7539ed5bd45c01c353f9e6dc616"
Sep 09 14:35:58.778221 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:35:58.778206    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ad8c0e99538a21261eb590f4ba4208aab50d7539ed5bd45c01c353f9e6dc616\": container with ID starting with 2ad8c0e99538a21261eb590f4ba4208aab50d7539ed5bd45c01c353f9e6dc616 not found: ID does not exist" containerID="2ad8c0e99538a21261eb590f4ba4208aab50d7539ed5bd45c01c353f9e6dc616"
Sep 09 14:35:58.778278 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.778229    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ad8c0e99538a21261eb590f4ba4208aab50d7539ed5bd45c01c353f9e6dc616"} err="failed to get container status \"2ad8c0e99538a21261eb590f4ba4208aab50d7539ed5bd45c01c353f9e6dc616\": rpc error: code = NotFound desc = could not find container \"2ad8c0e99538a21261eb590f4ba4208aab50d7539ed5bd45c01c353f9e6dc616\": container with ID starting with 2ad8c0e99538a21261eb590f4ba4208aab50d7539ed5bd45c01c353f9e6dc616 not found: ID does not exist"
Sep 09 14:35:58.778278 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.778243    2562 scope.go:117] "RemoveContainer" containerID="299d42db3ed62fdf96557df73432b6a516358c3bc2b8487b1a91da35ba54abc8"
Sep 09 14:35:58.786471 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.786456    2562 scope.go:117] "RemoveContainer" containerID="299d42db3ed62fdf96557df73432b6a516358c3bc2b8487b1a91da35ba54abc8"
Sep 09 14:35:58.786763 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:35:58.786744    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"299d42db3ed62fdf96557df73432b6a516358c3bc2b8487b1a91da35ba54abc8\": container with ID starting with 299d42db3ed62fdf96557df73432b6a516358c3bc2b8487b1a91da35ba54abc8 not found: ID does not exist" containerID="299d42db3ed62fdf96557df73432b6a516358c3bc2b8487b1a91da35ba54abc8"
Sep 09 14:35:58.786810 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.786771    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"299d42db3ed62fdf96557df73432b6a516358c3bc2b8487b1a91da35ba54abc8"} err="failed to get container status \"299d42db3ed62fdf96557df73432b6a516358c3bc2b8487b1a91da35ba54abc8\": rpc error: code = NotFound desc = could not find container \"299d42db3ed62fdf96557df73432b6a516358c3bc2b8487b1a91da35ba54abc8\": container with ID starting with 299d42db3ed62fdf96557df73432b6a516358c3bc2b8487b1a91da35ba54abc8 not found: ID does not exist"
Sep 09 14:35:58.788914 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.788887    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"]
Sep 09 14:35:58.799999 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.799976    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-cbb7fb-5b95bc49bf-vmnj9"]
Sep 09 14:35:58.816142 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.816118    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"]
Sep 09 14:35:58.820003 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.819978    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb7fb-6ddcf45c78-w78xf"]
Sep 09 14:35:58.827550 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:58.827530    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:35:59.800069 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:59.800030    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28f62fe8-3e7d-4ae5-8805-65e8248555ca" path="/var/lib/kubelet/pods/28f62fe8-3e7d-4ae5-8805-65e8248555ca/volumes"
Sep 09 14:35:59.800449 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:59.800391    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80ba21a3-6730-4448-bf83-235b12821726" path="/var/lib/kubelet/pods/80ba21a3-6730-4448-bf83-235b12821726/volumes"
Sep 09 14:35:59.800705 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:35:59.800692    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c31a0cf7-23fc-4ed0-b36a-542c90ca6324" path="/var/lib/kubelet/pods/c31a0cf7-23fc-4ed0-b36a-542c90ca6324/volumes"
Sep 09 14:36:01.480492 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:01.480458    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:04.178286 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.178257    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:04.256954 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.256920    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:04.439263 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.439159    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:04.790639 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.790554    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq"]
Sep 09 14:36:04.791022 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.791003    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c31a0cf7-23fc-4ed0-b36a-542c90ca6324" containerName="payload-pre-processing"
Sep 09 14:36:04.791115 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.791024    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c31a0cf7-23fc-4ed0-b36a-542c90ca6324" containerName="payload-pre-processing"
Sep 09 14:36:04.791115 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.791036    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80ba21a3-6730-4448-bf83-235b12821726" containerName="payload-processing"
Sep 09 14:36:04.791115 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.791045    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="80ba21a3-6730-4448-bf83-235b12821726" containerName="payload-processing"
Sep 09 14:36:04.791115 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.791057    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28f62fe8-3e7d-4ae5-8805-65e8248555ca" containerName="revoke-keys"
Sep 09 14:36:04.791115 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.791065    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="28f62fe8-3e7d-4ae5-8805-65e8248555ca" containerName="revoke-keys"
Sep 09 14:36:04.791392 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.791205    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="28f62fe8-3e7d-4ae5-8805-65e8248555ca" containerName="revoke-keys"
Sep 09 14:36:04.791392 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.791223    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c31a0cf7-23fc-4ed0-b36a-542c90ca6324" containerName="payload-pre-processing"
Sep 09 14:36:04.791392 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.791232    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="80ba21a3-6730-4448-bf83-235b12821726" containerName="payload-processing"
Sep 09 14:36:04.796077 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.796055    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq"
Sep 09 14:36:04.799767 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.799742    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:36:04.799884 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.799804    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:36:04.814230 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.814205    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq"]
Sep 09 14:36:04.843192 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.842641    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b21e023c-04c7-470c-bd1e-b554698b1121-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq\" (UID: \"b21e023c-04c7-470c-bd1e-b554698b1121\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq"
Sep 09 14:36:04.944113 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.944083    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b21e023c-04c7-470c-bd1e-b554698b1121-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq\" (UID: \"b21e023c-04c7-470c-bd1e-b554698b1121\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq"
Sep 09 14:36:04.944825 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:04.944802    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b21e023c-04c7-470c-bd1e-b554698b1121-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq\" (UID: \"b21e023c-04c7-470c-bd1e-b554698b1121\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq"
Sep 09 14:36:05.028688 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:05.028653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:05.105858 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:05.105825    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq"
Sep 09 14:36:05.376672 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:05.376649    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq"]
Sep 09 14:36:05.378347 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:36:05.378314    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb21e023c_04c7_470c_bd1e_b554698b1121.slice/crio-cfec59886c6dd0e8c5ea950254a0d55615d07c2e5eea3e8b52e3872f7c2d2e8d WatchSource:0}: Error finding container cfec59886c6dd0e8c5ea950254a0d55615d07c2e5eea3e8b52e3872f7c2d2e8d: Status 404 returned error can't find the container with id cfec59886c6dd0e8c5ea950254a0d55615d07c2e5eea3e8b52e3872f7c2d2e8d
Sep 09 14:36:05.816158 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:05.816121    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq" event={"ID":"b21e023c-04c7-470c-bd1e-b554698b1121","Type":"ContainerStarted","Data":"6684c84574ddb2035e5e206b0e989f14086f3d905c13060a207f37145b7be03b"}
Sep 09 14:36:05.816326 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:05.816193    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq" event={"ID":"b21e023c-04c7-470c-bd1e-b554698b1121","Type":"ContainerStarted","Data":"cfec59886c6dd0e8c5ea950254a0d55615d07c2e5eea3e8b52e3872f7c2d2e8d"}
Sep 09 14:36:05.831533 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:05.831475    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq" podStartSLOduration=1.8314623270000001 podStartE2EDuration="1.831462327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:36:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:36:05.829746904 +0000 UTC m=+1530.556287005" watchObservedRunningTime="2026-09-09 14:36:05.831462327 +0000 UTC m=+1530.558002425"
Sep 09 14:36:06.823004 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:06.822974    2562 generic.go:356] "Generic (PLEG): container finished" podID="b21e023c-04c7-470c-bd1e-b554698b1121" containerID="6684c84574ddb2035e5e206b0e989f14086f3d905c13060a207f37145b7be03b" exitCode=0
Sep 09 14:36:06.823357 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:06.823051    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq" event={"ID":"b21e023c-04c7-470c-bd1e-b554698b1121","Type":"ContainerDied","Data":"6684c84574ddb2035e5e206b0e989f14086f3d905c13060a207f37145b7be03b"}
Sep 09 14:36:07.960647 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:07.960625    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq"
Sep 09 14:36:07.968820 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:07.968800    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b21e023c-04c7-470c-bd1e-b554698b1121-maas-api-service-ca\") pod \"b21e023c-04c7-470c-bd1e-b554698b1121\" (UID: \"b21e023c-04c7-470c-bd1e-b554698b1121\") "
Sep 09 14:36:07.969100 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:07.969080    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b21e023c-04c7-470c-bd1e-b554698b1121-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b21e023c-04c7-470c-bd1e-b554698b1121" (UID: "b21e023c-04c7-470c-bd1e-b554698b1121"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:36:08.069401 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:08.069374    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b21e023c-04c7-470c-bd1e-b554698b1121-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:36:08.835046 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:08.835018    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq"
Sep 09 14:36:08.835237 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:08.835053    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq" event={"ID":"b21e023c-04c7-470c-bd1e-b554698b1121","Type":"ContainerDied","Data":"cfec59886c6dd0e8c5ea950254a0d55615d07c2e5eea3e8b52e3872f7c2d2e8d"}
Sep 09 14:36:08.835237 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:08.835099    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfec59886c6dd0e8c5ea950254a0d55615d07c2e5eea3e8b52e3872f7c2d2e8d"
Sep 09 14:36:10.713071 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:10.713037    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:12.048149 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:12.048112    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:15.452839 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.452802    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:15.482325 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.482284    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"]
Sep 09 14:36:15.482548 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.482524    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds" podUID="1fa335c5-f581-46f3-97ab-6259347ff1fc" containerName="payload-pre-processing" containerID="cri-o://794c40d16c149849fca013beca97eb456f33e2c32ab0cfa56ae847783dca9cc2" gracePeriod=30
Sep 09 14:36:15.528920 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.528885    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:15.637899 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.637576    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:15.639451 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.639424    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq"]
Sep 09 14:36:15.641772 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.641749    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fecaf9-cf8cq"]
Sep 09 14:36:15.747861 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.747838    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"
Sep 09 14:36:15.800871 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.800840    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b21e023c-04c7-470c-bd1e-b554698b1121" path="/var/lib/kubelet/pods/b21e023c-04c7-470c-bd1e-b554698b1121/volumes"
Sep 09 14:36:15.828991 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.828966    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vcjs\" (UniqueName: \"kubernetes.io/projected/1fa335c5-f581-46f3-97ab-6259347ff1fc-kube-api-access-6vcjs\") pod \"1fa335c5-f581-46f3-97ab-6259347ff1fc\" (UID: \"1fa335c5-f581-46f3-97ab-6259347ff1fc\") "
Sep 09 14:36:15.829118 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.829014    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa335c5-f581-46f3-97ab-6259347ff1fc-plugins-config-volume\") pod \"1fa335c5-f581-46f3-97ab-6259347ff1fc\" (UID: \"1fa335c5-f581-46f3-97ab-6259347ff1fc\") "
Sep 09 14:36:15.829407 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.829386    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fa335c5-f581-46f3-97ab-6259347ff1fc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1fa335c5-f581-46f3-97ab-6259347ff1fc" (UID: "1fa335c5-f581-46f3-97ab-6259347ff1fc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:36:15.830963 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.830942    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fa335c5-f581-46f3-97ab-6259347ff1fc-kube-api-access-6vcjs" (OuterVolumeSpecName: "kube-api-access-6vcjs") pod "1fa335c5-f581-46f3-97ab-6259347ff1fc" (UID: "1fa335c5-f581-46f3-97ab-6259347ff1fc"). InnerVolumeSpecName "kube-api-access-6vcjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:36:15.875891 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.875865    2562 generic.go:356] "Generic (PLEG): container finished" podID="1fa335c5-f581-46f3-97ab-6259347ff1fc" containerID="794c40d16c149849fca013beca97eb456f33e2c32ab0cfa56ae847783dca9cc2" exitCode=0
Sep 09 14:36:15.875989 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.875907    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"
Sep 09 14:36:15.875989 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.875921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds" event={"ID":"1fa335c5-f581-46f3-97ab-6259347ff1fc","Type":"ContainerDied","Data":"794c40d16c149849fca013beca97eb456f33e2c32ab0cfa56ae847783dca9cc2"}
Sep 09 14:36:15.875989 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.875960    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds" event={"ID":"1fa335c5-f581-46f3-97ab-6259347ff1fc","Type":"ContainerDied","Data":"7b583fc96f350413a42787668dca0e11f9511f86bd0dee67982ed9db033891e7"}
Sep 09 14:36:15.875989 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.875983    2562 scope.go:117] "RemoveContainer" containerID="794c40d16c149849fca013beca97eb456f33e2c32ab0cfa56ae847783dca9cc2"
Sep 09 14:36:15.885790 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.885774    2562 scope.go:117] "RemoveContainer" containerID="794c40d16c149849fca013beca97eb456f33e2c32ab0cfa56ae847783dca9cc2"
Sep 09 14:36:15.886032 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:36:15.886013    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"794c40d16c149849fca013beca97eb456f33e2c32ab0cfa56ae847783dca9cc2\": container with ID starting with 794c40d16c149849fca013beca97eb456f33e2c32ab0cfa56ae847783dca9cc2 not found: ID does not exist" containerID="794c40d16c149849fca013beca97eb456f33e2c32ab0cfa56ae847783dca9cc2"
Sep 09 14:36:15.886092 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.886039    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"794c40d16c149849fca013beca97eb456f33e2c32ab0cfa56ae847783dca9cc2"} err="failed to get container status \"794c40d16c149849fca013beca97eb456f33e2c32ab0cfa56ae847783dca9cc2\": rpc error: code = NotFound desc = could not find container \"794c40d16c149849fca013beca97eb456f33e2c32ab0cfa56ae847783dca9cc2\": container with ID starting with 794c40d16c149849fca013beca97eb456f33e2c32ab0cfa56ae847783dca9cc2 not found: ID does not exist"
Sep 09 14:36:15.897057 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.897033    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"]
Sep 09 14:36:15.901212 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.901191    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-fecaf9-7fd6748994-94vds"]
Sep 09 14:36:15.930022 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.929999    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vcjs\" (UniqueName: \"kubernetes.io/projected/1fa335c5-f581-46f3-97ab-6259347ff1fc-kube-api-access-6vcjs\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:36:15.930022 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:15.930020    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fa335c5-f581-46f3-97ab-6259347ff1fc-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:36:16.057988 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:16.057955    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:16.161422 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:16.161387    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:17.800578 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:17.800545    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fa335c5-f581-46f3-97ab-6259347ff1fc" path="/var/lib/kubelet/pods/1fa335c5-f581-46f3-97ab-6259347ff1fc/volumes"
Sep 09 14:36:22.190668 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:22.190630    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:22.258971 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:22.258941    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:22.457993 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:22.457894    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:36.229798 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:36.229769    2562 scope.go:117] "RemoveContainer" containerID="fe707682a7d2721dc0e55838b23b016bdafa13573c0d2e8a4027e4ae053c7809"
Sep 09 14:36:36.238254 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:36.238233    2562 scope.go:117] "RemoveContainer" containerID="c3d30f7bbefc4681578ecdfaa30d645846af1661abf467afb79fc3b95ac3bff2"
Sep 09 14:36:48.653634 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:48.653599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:49.540957 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:49.540918    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:50.012215 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.012151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:50.327762 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.327729    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"]
Sep 09 14:36:50.328118 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.328106    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b21e023c-04c7-470c-bd1e-b554698b1121" containerName="revoke-keys"
Sep 09 14:36:50.328200 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.328119    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b21e023c-04c7-470c-bd1e-b554698b1121" containerName="revoke-keys"
Sep 09 14:36:50.328200 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.328130    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fa335c5-f581-46f3-97ab-6259347ff1fc" containerName="payload-pre-processing"
Sep 09 14:36:50.328200 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.328136    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fa335c5-f581-46f3-97ab-6259347ff1fc" containerName="payload-pre-processing"
Sep 09 14:36:50.328311 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.328221    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b21e023c-04c7-470c-bd1e-b554698b1121" containerName="revoke-keys"
Sep 09 14:36:50.328311 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.328233    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fa335c5-f581-46f3-97ab-6259347ff1fc" containerName="payload-pre-processing"
Sep 09 14:36:50.331348 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.331330    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.334263 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.334246    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-ea13e2-openshift-default-dockercfg-blfqt\""
Sep 09 14:36:50.344939 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.344916    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"]
Sep 09 14:36:50.358006 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.357965    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:50.399513 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.399487    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-istio-data\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.399606 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.399519    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-istio-envoy\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.399606 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.399543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-workload-socket\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.399606 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.399593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-credential-socket\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.399726 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.399640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw4bp\" (UniqueName: \"kubernetes.io/projected/97160bab-f356-4603-a0f8-c19a615123a8-kube-api-access-qw4bp\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.399726 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.399696    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-workload-certs\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.399793 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.399736    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97160bab-f356-4603-a0f8-c19a615123a8-istio-podinfo\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.399793 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.399753    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97160bab-f356-4603-a0f8-c19a615123a8-istiod-ca-cert\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.399793 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.399778    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97160bab-f356-4603-a0f8-c19a615123a8-istio-token\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.501001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.500970    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-istio-envoy\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.501001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.501009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-workload-socket\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.501267 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.501032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-credential-socket\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.501267 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.501072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw4bp\" (UniqueName: \"kubernetes.io/projected/97160bab-f356-4603-a0f8-c19a615123a8-kube-api-access-qw4bp\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.501267 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.501140    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-workload-certs\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.501267 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.501198    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97160bab-f356-4603-a0f8-c19a615123a8-istio-podinfo\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.501267 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.501222    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97160bab-f356-4603-a0f8-c19a615123a8-istiod-ca-cert\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.501267 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.501249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97160bab-f356-4603-a0f8-c19a615123a8-istio-token\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.501587 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.501284    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-istio-data\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.501587 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.501489    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-workload-socket\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.501990 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.501961    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-workload-certs\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.502117 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.501989    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-credential-socket\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.502117 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.502017    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97160bab-f356-4603-a0f8-c19a615123a8-istiod-ca-cert\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.502117 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.501994    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-istio-data\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.503349 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.503327    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-istio-envoy\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.503681 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.503660    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97160bab-f356-4603-a0f8-c19a615123a8-istio-podinfo\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.509581 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.509553    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97160bab-f356-4603-a0f8-c19a615123a8-istio-token\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.510694 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.510666    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw4bp\" (UniqueName: \"kubernetes.io/projected/97160bab-f356-4603-a0f8-c19a615123a8-kube-api-access-qw4bp\") pod \"e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") " pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.642726 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.642670    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:50.904160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.904078    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:50.921210 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.921185    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"]
Sep 09 14:36:50.922492 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:36:50.922467    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97160bab_f356_4603_a0f8_c19a615123a8.slice/crio-4c4c8305a65158c2078d3823350737eebf54146859cf79ae3f3ab484816f7a7c WatchSource:0}: Error finding container 4c4c8305a65158c2078d3823350737eebf54146859cf79ae3f3ab484816f7a7c: Status 404 returned error can't find the container with id 4c4c8305a65158c2078d3823350737eebf54146859cf79ae3f3ab484816f7a7c
Sep 09 14:36:50.924900 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.924870    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:36:50.924974 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.924930    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:36:50.924974 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:50.924965    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:36:51.083936 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:51.083899    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn" event={"ID":"97160bab-f356-4603-a0f8-c19a615123a8","Type":"ContainerStarted","Data":"817dd7773f00d3013a1b4945eecdfbcc7b4c471be1de882fbf713998b2bb09fa"}
Sep 09 14:36:51.084328 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:51.083979    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn" event={"ID":"97160bab-f356-4603-a0f8-c19a615123a8","Type":"ContainerStarted","Data":"4c4c8305a65158c2078d3823350737eebf54146859cf79ae3f3ab484816f7a7c"}
Sep 09 14:36:51.106833 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:51.106789    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn" podStartSLOduration=1.1067736 podStartE2EDuration="1.1067736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:36:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:36:51.104665903 +0000 UTC m=+1575.831206002" watchObservedRunningTime="2026-09-09 14:36:51.1067736 +0000 UTC m=+1575.833313761"
Sep 09 14:36:51.643817 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:51.643775    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:51.649996 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:51.649970    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:52.089001 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:52.088970    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:52.089894 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:52.089872    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:36:53.198090 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:53.198052    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:53.301602 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:53.301566    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:54.450146 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:54.450081    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:54.512809 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:54.512775    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:54.614534 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:54.614491    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:54.938414 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:54.938381    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:54.997429 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:54.997401    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"]
Sep 09 14:36:55.001224 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:55.001203    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"
Sep 09 14:36:55.003606 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:55.003511    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-ea13e2-dockercfg-m7qvl\""
Sep 09 14:36:55.003606 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:55.003569    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-ea13e2\""
Sep 09 14:36:55.011832 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:55.011810    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"]
Sep 09 14:36:55.014696 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:55.014666    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:36:55.140727 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:55.140692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda1b754-aca5-477d-8a81-f574cd04c6b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw\" (UID: \"dda1b754-aca5-477d-8a81-f574cd04c6b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"
Sep 09 14:36:55.140914 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:55.140833    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdvps\" (UniqueName: \"kubernetes.io/projected/dda1b754-aca5-477d-8a81-f574cd04c6b7-kube-api-access-gdvps\") pod \"payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw\" (UID: \"dda1b754-aca5-477d-8a81-f574cd04c6b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"
Sep 09 14:36:55.242327 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:55.242237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdvps\" (UniqueName: \"kubernetes.io/projected/dda1b754-aca5-477d-8a81-f574cd04c6b7-kube-api-access-gdvps\") pod \"payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw\" (UID: \"dda1b754-aca5-477d-8a81-f574cd04c6b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"
Sep 09 14:36:55.242327 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:55.242298    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda1b754-aca5-477d-8a81-f574cd04c6b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw\" (UID: \"dda1b754-aca5-477d-8a81-f574cd04c6b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"
Sep 09 14:36:55.242955 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:55.242935    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda1b754-aca5-477d-8a81-f574cd04c6b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw\" (UID: \"dda1b754-aca5-477d-8a81-f574cd04c6b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"
Sep 09 14:36:55.250312 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:55.250286    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdvps\" (UniqueName: \"kubernetes.io/projected/dda1b754-aca5-477d-8a81-f574cd04c6b7-kube-api-access-gdvps\") pod \"payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw\" (UID: \"dda1b754-aca5-477d-8a81-f574cd04c6b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"
Sep 09 14:36:55.313076 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:55.313045    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"
Sep 09 14:36:55.587412 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:55.587388    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"]
Sep 09 14:36:55.590703 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:36:55.590676    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda1b754_aca5_477d_8a81_f574cd04c6b7.slice/crio-a710253ab0d66efbc270a4d0e94902d8d211ecca41413242505d735f08c71455 WatchSource:0}: Error finding container a710253ab0d66efbc270a4d0e94902d8d211ecca41413242505d735f08c71455: Status 404 returned error can't find the container with id a710253ab0d66efbc270a4d0e94902d8d211ecca41413242505d735f08c71455
Sep 09 14:36:56.118020 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:56.117987    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw" event={"ID":"dda1b754-aca5-477d-8a81-f574cd04c6b7","Type":"ContainerStarted","Data":"3f1069a444d37efeff5dcfe991366d4986bb85ddd5d0a68f6bd8703a43f186c1"}
Sep 09 14:36:56.118212 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:56.118046    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw" event={"ID":"dda1b754-aca5-477d-8a81-f574cd04c6b7","Type":"ContainerStarted","Data":"a710253ab0d66efbc270a4d0e94902d8d211ecca41413242505d735f08c71455"}
Sep 09 14:36:56.118212 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:56.118071    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"
Sep 09 14:36:56.136099 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:56.136049    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw" podStartSLOduration=2.136036379 podStartE2EDuration="2.136036379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:36:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:36:56.133605419 +0000 UTC m=+1580.860145521" watchObservedRunningTime="2026-09-09 14:36:56.136036379 +0000 UTC m=+1580.862576480"
Sep 09 14:36:58.154013 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:36:58.153977    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:37:07.125787 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:07.125755    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"
Sep 09 14:37:07.832846 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:07.832769    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": read tcp 10.132.0.2:54170->10.132.0.100:15021: read: connection reset by peer" start-of-body=
Sep 09 14:37:07.832846 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:07.832835    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn" podUID="97160bab-f356-4603-a0f8-c19a615123a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": read tcp 10.132.0.2:54170->10.132.0.100:15021: read: connection reset by peer"
Sep 09 14:37:08.199659 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:08.199593    2562 generic.go:356] "Generic (PLEG): container finished" podID="97160bab-f356-4603-a0f8-c19a615123a8" containerID="817dd7773f00d3013a1b4945eecdfbcc7b4c471be1de882fbf713998b2bb09fa" exitCode=0
Sep 09 14:37:08.199659 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:08.199640    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn" event={"ID":"97160bab-f356-4603-a0f8-c19a615123a8","Type":"ContainerDied","Data":"817dd7773f00d3013a1b4945eecdfbcc7b4c471be1de882fbf713998b2bb09fa"}
Sep 09 14:37:08.200096 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:08.200064    2562 scope.go:117] "RemoveContainer" containerID="817dd7773f00d3013a1b4945eecdfbcc7b4c471be1de882fbf713998b2bb09fa"
Sep 09 14:37:08.201232 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:08.201197    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:37:08.201331 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:08.201273    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:37:08.201331 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:08.201308    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:37:09.206719 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:09.206685    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn" event={"ID":"97160bab-f356-4603-a0f8-c19a615123a8","Type":"ContainerStarted","Data":"85af4eaa5d6b81c7da98a1e3aa48f910580282ad0769b465be39fdb1bb107332"}
Sep 09 14:37:09.643521 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:09.643486    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:37:09.643819 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:09.643785    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Sep 09 14:37:09.643911 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:09.643863    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn" podUID="97160bab-f356-4603-a0f8-c19a615123a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Sep 09 14:37:10.643505 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:10.643458    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Sep 09 14:37:10.643984 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:10.643546    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn" podUID="97160bab-f356-4603-a0f8-c19a615123a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Sep 09 14:37:11.643866 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:11.643829    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Sep 09 14:37:11.644450 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:11.644418    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn" podUID="97160bab-f356-4603-a0f8-c19a615123a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Sep 09 14:37:12.643135 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:12.643096    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Sep 09 14:37:12.644237 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:12.644203    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn" podUID="97160bab-f356-4603-a0f8-c19a615123a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Sep 09 14:37:13.405378 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:13.405343    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:37:13.475141 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:13.475107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:37:13.644042 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:13.644007    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Sep 09 14:37:13.644331 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:13.644304    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn" podUID="97160bab-f356-4603-a0f8-c19a615123a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Sep 09 14:37:14.646471 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:14.646438    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:37:14.646896 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:14.646823    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:37:14.647395 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:14.647377    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:37:18.254516 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:18.254473    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:37:19.009140 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:19.009099    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:37:19.350931 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:19.350893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:37:19.837281 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:19.837239    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:37:22.170603 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:22.170566    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:37:22.262400 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:22.262368    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:37:23.302065 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:23.302029    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:37:23.404778 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:23.404738    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:37:23.897510 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:23.897477    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:37:23.999802 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:23.999766    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:37:24.008486 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:24.008461    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"]
Sep 09 14:37:24.013054 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:24.013032    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"
Sep 09 14:37:24.015375 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:24.015357    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-f583d9-dockercfg-hwwvx\""
Sep 09 14:37:24.015477 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:24.015398    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-f583d9\""
Sep 09 14:37:24.022434 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:24.022412    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"]
Sep 09 14:37:24.079326 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:24.079298    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74dgl\" (UniqueName: \"kubernetes.io/projected/b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b-kube-api-access-74dgl\") pod \"payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc\" (UID: \"b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"
Sep 09 14:37:24.079450 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:24.079434    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc\" (UID: \"b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"
Sep 09 14:37:24.180533 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:24.180441    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc\" (UID: \"b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"
Sep 09 14:37:24.180533 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:24.180500    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74dgl\" (UniqueName: \"kubernetes.io/projected/b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b-kube-api-access-74dgl\") pod \"payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc\" (UID: \"b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"
Sep 09 14:37:24.181165 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:24.181145    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc\" (UID: \"b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"
Sep 09 14:37:24.188767 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:24.188734    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74dgl\" (UniqueName: \"kubernetes.io/projected/b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b-kube-api-access-74dgl\") pod \"payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc\" (UID: \"b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"
Sep 09 14:37:24.324361 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:24.324327    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"
Sep 09 14:37:24.598682 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:24.598652    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"]
Sep 09 14:37:24.599931 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:37:24.599904    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb98b8ac7_6f07_4cf8_963e_52d88e7d5f9b.slice/crio-3a64829958c354c126e2911f68ddd6120abe72a06251d1a8fcc23f99714db70c WatchSource:0}: Error finding container 3a64829958c354c126e2911f68ddd6120abe72a06251d1a8fcc23f99714db70c: Status 404 returned error can't find the container with id 3a64829958c354c126e2911f68ddd6120abe72a06251d1a8fcc23f99714db70c
Sep 09 14:37:25.298948 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:25.298916    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc" event={"ID":"b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b","Type":"ContainerStarted","Data":"12ff8b3d2c48893be3d4748e2143d33a720d81ceb15939012e7313a1d326da5b"}
Sep 09 14:37:25.299111 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:25.298975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc" event={"ID":"b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b","Type":"ContainerStarted","Data":"3a64829958c354c126e2911f68ddd6120abe72a06251d1a8fcc23f99714db70c"}
Sep 09 14:37:25.299111 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:25.298998    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"
Sep 09 14:37:25.316889 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:25.316839    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc" podStartSLOduration=2.316825925 podStartE2EDuration="2.316825925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:37:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:37:25.314819941 +0000 UTC m=+1610.041360042" watchObservedRunningTime="2026-09-09 14:37:25.316825925 +0000 UTC m=+1610.043366025"
Sep 09 14:37:36.306226 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:36.306133    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"
Sep 09 14:37:47.209960 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:47.209927    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:37:52.413129 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:37:52.413097    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sslq8_add57211-b174-481b-b9b7-d75980ab301c/payload-processing/0.log"
Sep 09 14:38:01.756112 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:01.756060    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:38:36.290855 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:36.290823    2562 scope.go:117] "RemoveContainer" containerID="072e46ba5e401fc457e87001f7104a9a5203ec288615d2798c2aee830ce2b3ee"
Sep 09 14:38:38.492501 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:38.492467    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sslq8_add57211-b174-481b-b9b7-d75980ab301c/payload-processing/0.log"
Sep 09 14:38:38.892330 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:38.892295    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:38:39.165195 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.165096    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"]
Sep 09 14:38:39.168677 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.168660    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.171195 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.171150    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-b37ae4-openshift-default-dockercfg-wzcxt\""
Sep 09 14:38:39.178804 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.178776    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"]
Sep 09 14:38:39.195421 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.195394    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:38:39.235545 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.235511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-istio-data\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.235645 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.235555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af3321dd-e561-41e3-8a9c-48b16202389c-istio-token\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.235696 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.235639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-istio-envoy\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.235696 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.235665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-workload-certs\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.235796 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.235698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af3321dd-e561-41e3-8a9c-48b16202389c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.235796 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.235777    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-workload-socket\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.235902 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.235822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af3321dd-e561-41e3-8a9c-48b16202389c-istio-podinfo\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.235902 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.235857    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgqdv\" (UniqueName: \"kubernetes.io/projected/af3321dd-e561-41e3-8a9c-48b16202389c-kube-api-access-kgqdv\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.235902 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.235897    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-credential-socket\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.336869 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.336836    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-workload-socket\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.337074 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.336875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af3321dd-e561-41e3-8a9c-48b16202389c-istio-podinfo\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.337074 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.336900    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgqdv\" (UniqueName: \"kubernetes.io/projected/af3321dd-e561-41e3-8a9c-48b16202389c-kube-api-access-kgqdv\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.337074 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.337034    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-credential-socket\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.337302 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.337113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-istio-data\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.337302 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.337141    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af3321dd-e561-41e3-8a9c-48b16202389c-istio-token\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.337302 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.337237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-istio-envoy\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.337302 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.337267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-workload-certs\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.337523 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.337310    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af3321dd-e561-41e3-8a9c-48b16202389c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.337523 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.337335    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-workload-socket\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.337523 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.337397    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-credential-socket\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.337523 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.337483    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-istio-data\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.337736 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.337666    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-workload-certs\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.338032 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.338008    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af3321dd-e561-41e3-8a9c-48b16202389c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.339470 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.339443    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-istio-envoy\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.339840 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.339818    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af3321dd-e561-41e3-8a9c-48b16202389c-istio-podinfo\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.344416 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.344392    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgqdv\" (UniqueName: \"kubernetes.io/projected/af3321dd-e561-41e3-8a9c-48b16202389c-kube-api-access-kgqdv\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.344498 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.344442    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af3321dd-e561-41e3-8a9c-48b16202389c-istio-token\") pod \"e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") " pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.426243 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.426136    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:38:39.479508 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.479485    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:39.755235 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.755208    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"]
Sep 09 14:38:39.756686 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:38:39.756664    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf3321dd_e561_41e3_8a9c_48b16202389c.slice/crio-cd46ed167a64a45840e341d61a13875760d68cf521c33c0c10c0a22a0597bfc3 WatchSource:0}: Error finding container cd46ed167a64a45840e341d61a13875760d68cf521c33c0c10c0a22a0597bfc3: Status 404 returned error can't find the container with id cd46ed167a64a45840e341d61a13875760d68cf521c33c0c10c0a22a0597bfc3
Sep 09 14:38:39.759199 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.759154    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:38:39.759279 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.759230    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:38:39.759279 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:39.759260    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:38:40.734875 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:40.734833    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw" event={"ID":"af3321dd-e561-41e3-8a9c-48b16202389c","Type":"ContainerStarted","Data":"0c2906ed0223eff289350be3d2be03cf04e132cb39259ab14e7b10d60d01683e"}
Sep 09 14:38:40.735035 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:40.734896    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw" event={"ID":"af3321dd-e561-41e3-8a9c-48b16202389c","Type":"ContainerStarted","Data":"cd46ed167a64a45840e341d61a13875760d68cf521c33c0c10c0a22a0597bfc3"}
Sep 09 14:38:40.758002 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:40.757958    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw" podStartSLOduration=1.7579399740000001 podStartE2EDuration="1.757939974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:38:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:38:40.757124263 +0000 UTC m=+1685.483664390" watchObservedRunningTime="2026-09-09 14:38:40.757939974 +0000 UTC m=+1685.484480075"
Sep 09 14:38:41.479904 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:41.479872    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:41.484925 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:41.484898    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:41.741046 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:41.740964    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:41.742020 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:41.741998    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:38:42.686273 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:42.686238    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:38:42.812975 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:42.812940    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:38:43.950914 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:43.950876    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:38:44.506988 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:44.506951    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"]
Sep 09 14:38:44.510771 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:44.510748    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"
Sep 09 14:38:44.512782 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:44.512753    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-b37ae4\""
Sep 09 14:38:44.512782 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:44.512758    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-b37ae4-dockercfg-drpfk\""
Sep 09 14:38:44.520134 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:44.520110    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"]
Sep 09 14:38:44.583388 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:44.583358    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j9rv\" (UniqueName: \"kubernetes.io/projected/5d5fbb93-1f17-4496-b0a1-11732d7397dd-kube-api-access-4j9rv\") pod \"payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj\" (UID: \"5d5fbb93-1f17-4496-b0a1-11732d7397dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"
Sep 09 14:38:44.583528 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:44.583395    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d5fbb93-1f17-4496-b0a1-11732d7397dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj\" (UID: \"5d5fbb93-1f17-4496-b0a1-11732d7397dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"
Sep 09 14:38:44.684288 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:44.684246    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j9rv\" (UniqueName: \"kubernetes.io/projected/5d5fbb93-1f17-4496-b0a1-11732d7397dd-kube-api-access-4j9rv\") pod \"payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj\" (UID: \"5d5fbb93-1f17-4496-b0a1-11732d7397dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"
Sep 09 14:38:44.684288 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:44.684292    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d5fbb93-1f17-4496-b0a1-11732d7397dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj\" (UID: \"5d5fbb93-1f17-4496-b0a1-11732d7397dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"
Sep 09 14:38:44.684991 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:44.684972    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d5fbb93-1f17-4496-b0a1-11732d7397dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj\" (UID: \"5d5fbb93-1f17-4496-b0a1-11732d7397dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"
Sep 09 14:38:44.692824 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:44.692793    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j9rv\" (UniqueName: \"kubernetes.io/projected/5d5fbb93-1f17-4496-b0a1-11732d7397dd-kube-api-access-4j9rv\") pod \"payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj\" (UID: \"5d5fbb93-1f17-4496-b0a1-11732d7397dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"
Sep 09 14:38:44.823488 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:44.823464    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"
Sep 09 14:38:45.097266 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:45.097240    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"]
Sep 09 14:38:45.098879 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:38:45.098857    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d5fbb93_1f17_4496_b0a1_11732d7397dd.slice/crio-28b04cb7e96c1978d564c069183a707625ac6591c0282dc1d56842eeb6e4431c WatchSource:0}: Error finding container 28b04cb7e96c1978d564c069183a707625ac6591c0282dc1d56842eeb6e4431c: Status 404 returned error can't find the container with id 28b04cb7e96c1978d564c069183a707625ac6591c0282dc1d56842eeb6e4431c
Sep 09 14:38:45.768243 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:45.768206    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj" event={"ID":"5d5fbb93-1f17-4496-b0a1-11732d7397dd","Type":"ContainerStarted","Data":"45a4fce3001cfa134e038af55f8cc7abf8d4667b0ec8609c41875b1af7c170a6"}
Sep 09 14:38:45.768405 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:45.768267    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj" event={"ID":"5d5fbb93-1f17-4496-b0a1-11732d7397dd","Type":"ContainerStarted","Data":"28b04cb7e96c1978d564c069183a707625ac6591c0282dc1d56842eeb6e4431c"}
Sep 09 14:38:45.768405 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:45.768308    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"
Sep 09 14:38:45.783744 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:45.783692    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj" podStartSLOduration=1.7836783710000002 podStartE2EDuration="1.783678371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:38:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:38:45.783254393 +0000 UTC m=+1690.509794494" watchObservedRunningTime="2026-09-09 14:38:45.783678371 +0000 UTC m=+1690.510218472"
Sep 09 14:38:46.543333 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:46.543280    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:38:46.644749 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:46.644718    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:38:56.777142 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:38:56.777108    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"
Sep 09 14:39:01.871197 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:01.871137    2562 generic.go:356] "Generic (PLEG): container finished" podID="af3321dd-e561-41e3-8a9c-48b16202389c" containerID="0c2906ed0223eff289350be3d2be03cf04e132cb39259ab14e7b10d60d01683e" exitCode=0
Sep 09 14:39:01.871622 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:01.871216    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw" event={"ID":"af3321dd-e561-41e3-8a9c-48b16202389c","Type":"ContainerDied","Data":"0c2906ed0223eff289350be3d2be03cf04e132cb39259ab14e7b10d60d01683e"}
Sep 09 14:39:01.871622 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:01.871577    2562 scope.go:117] "RemoveContainer" containerID="0c2906ed0223eff289350be3d2be03cf04e132cb39259ab14e7b10d60d01683e"
Sep 09 14:39:01.872619 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:01.872590    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:39:01.872707 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:01.872650    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:39:01.872707 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:01.872680    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 09 14:39:02.879018 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:02.878986    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw" event={"ID":"af3321dd-e561-41e3-8a9c-48b16202389c","Type":"ContainerStarted","Data":"d9db3c7710f94e77a405e82eea8ac58b7ae9db555a4c2f46180251db368543cd"}
Sep 09 14:39:03.480328 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:03.480292    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:39:03.480502 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:03.480475    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Sep 09 14:39:03.480547 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:03.480522    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw" podUID="af3321dd-e561-41e3-8a9c-48b16202389c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Sep 09 14:39:04.480775 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:04.480734    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Sep 09 14:39:04.481129 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:04.480799    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw" podUID="af3321dd-e561-41e3-8a9c-48b16202389c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Sep 09 14:39:05.480682 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:05.480635    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Sep 09 14:39:05.480882 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:05.480698    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw" podUID="af3321dd-e561-41e3-8a9c-48b16202389c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Sep 09 14:39:06.480143 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:06.480106    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Sep 09 14:39:06.480364 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:06.480190    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw" podUID="af3321dd-e561-41e3-8a9c-48b16202389c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Sep 09 14:39:07.480431 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:07.480389    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Sep 09 14:39:07.480954 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:07.480462    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw" podUID="af3321dd-e561-41e3-8a9c-48b16202389c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Sep 09 14:39:07.728591 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:07.728554    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:08.375323 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:08.375289    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4"]
Sep 09 14:39:08.377731 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:08.377716    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4"
Sep 09 14:39:08.379919 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:08.379897    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:39:08.380071 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:08.379926    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:39:08.386644 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:08.386608    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4"]
Sep 09 14:39:08.398152 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:08.398125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a428d757-4777-47fb-a0bc-b75ae32417ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4\" (UID: \"a428d757-4777-47fb-a0bc-b75ae32417ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4"
Sep 09 14:39:08.484030 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:08.484008    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:39:08.484401 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:08.484384    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:39:08.485018 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:08.485002    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:39:08.499367 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:08.499344    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a428d757-4777-47fb-a0bc-b75ae32417ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4\" (UID: \"a428d757-4777-47fb-a0bc-b75ae32417ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4"
Sep 09 14:39:08.500138 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:08.500120    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a428d757-4777-47fb-a0bc-b75ae32417ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4\" (UID: \"a428d757-4777-47fb-a0bc-b75ae32417ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4"
Sep 09 14:39:08.689831 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:08.689757    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4"
Sep 09 14:39:08.961798 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:08.961771    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4"]
Sep 09 14:39:08.962889 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:39:08.962865    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda428d757_4777_47fb_a0bc_b75ae32417ce.slice/crio-2ab04b82c4c6ed2bf062a96c7a13d09cbf0397f3ef323330f93b5afc6e14ea4e WatchSource:0}: Error finding container 2ab04b82c4c6ed2bf062a96c7a13d09cbf0397f3ef323330f93b5afc6e14ea4e: Status 404 returned error can't find the container with id 2ab04b82c4c6ed2bf062a96c7a13d09cbf0397f3ef323330f93b5afc6e14ea4e
Sep 09 14:39:09.920906 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:09.920874    2562 generic.go:356] "Generic (PLEG): container finished" podID="a428d757-4777-47fb-a0bc-b75ae32417ce" containerID="02ecf12fa866709babd81becec1ea05c1061d79029ecf8bc5142c62c4c9eda38" exitCode=0
Sep 09 14:39:09.921309 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:09.920956    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4" event={"ID":"a428d757-4777-47fb-a0bc-b75ae32417ce","Type":"ContainerDied","Data":"02ecf12fa866709babd81becec1ea05c1061d79029ecf8bc5142c62c4c9eda38"}
Sep 09 14:39:09.921309 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:09.921006    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4" event={"ID":"a428d757-4777-47fb-a0bc-b75ae32417ce","Type":"ContainerStarted","Data":"2ab04b82c4c6ed2bf062a96c7a13d09cbf0397f3ef323330f93b5afc6e14ea4e"}
Sep 09 14:39:11.067500 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:11.067472    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4"
Sep 09 14:39:11.120477 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:11.120453    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a428d757-4777-47fb-a0bc-b75ae32417ce-maas-api-service-ca\") pod \"a428d757-4777-47fb-a0bc-b75ae32417ce\" (UID: \"a428d757-4777-47fb-a0bc-b75ae32417ce\") "
Sep 09 14:39:11.120754 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:11.120731    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a428d757-4777-47fb-a0bc-b75ae32417ce-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a428d757-4777-47fb-a0bc-b75ae32417ce" (UID: "a428d757-4777-47fb-a0bc-b75ae32417ce"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:39:11.221353 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:11.221290    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a428d757-4777-47fb-a0bc-b75ae32417ce-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:39:11.935042 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:11.934926    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4"
Sep 09 14:39:11.935042 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:11.934953    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4" event={"ID":"a428d757-4777-47fb-a0bc-b75ae32417ce","Type":"ContainerDied","Data":"2ab04b82c4c6ed2bf062a96c7a13d09cbf0397f3ef323330f93b5afc6e14ea4e"}
Sep 09 14:39:11.935042 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:11.935016    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ab04b82c4c6ed2bf062a96c7a13d09cbf0397f3ef323330f93b5afc6e14ea4e"
Sep 09 14:39:14.345415 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.345378    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:14.364380 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.364348    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"]
Sep 09 14:39:14.364612 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.364579    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj" podUID="5d5fbb93-1f17-4496-b0a1-11732d7397dd" containerName="payload-pre-processing" containerID="cri-o://45a4fce3001cfa134e038af55f8cc7abf8d4667b0ec8609c41875b1af7c170a6" gracePeriod=30
Sep 09 14:39:14.445144 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.445108    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:14.518749 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.518706    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4"]
Sep 09 14:39:14.520836 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.520807    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:14.521971 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.521947    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-b37ae4-wr9s4"]
Sep 09 14:39:14.589894 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.589857    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:14.641716 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.641393    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"
Sep 09 14:39:14.645529 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.645501    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d5fbb93-1f17-4496-b0a1-11732d7397dd-plugins-config-volume\") pod \"5d5fbb93-1f17-4496-b0a1-11732d7397dd\" (UID: \"5d5fbb93-1f17-4496-b0a1-11732d7397dd\") "
Sep 09 14:39:14.645686 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.645564    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4j9rv\" (UniqueName: \"kubernetes.io/projected/5d5fbb93-1f17-4496-b0a1-11732d7397dd-kube-api-access-4j9rv\") pod \"5d5fbb93-1f17-4496-b0a1-11732d7397dd\" (UID: \"5d5fbb93-1f17-4496-b0a1-11732d7397dd\") "
Sep 09 14:39:14.645933 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.645908    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d5fbb93-1f17-4496-b0a1-11732d7397dd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5d5fbb93-1f17-4496-b0a1-11732d7397dd" (UID: "5d5fbb93-1f17-4496-b0a1-11732d7397dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:39:14.647768 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.647735    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d5fbb93-1f17-4496-b0a1-11732d7397dd-kube-api-access-4j9rv" (OuterVolumeSpecName: "kube-api-access-4j9rv") pod "5d5fbb93-1f17-4496-b0a1-11732d7397dd" (UID: "5d5fbb93-1f17-4496-b0a1-11732d7397dd"). InnerVolumeSpecName "kube-api-access-4j9rv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:39:14.746851 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.746825    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d5fbb93-1f17-4496-b0a1-11732d7397dd-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:39:14.746851 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.746850    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4j9rv\" (UniqueName: \"kubernetes.io/projected/5d5fbb93-1f17-4496-b0a1-11732d7397dd-kube-api-access-4j9rv\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:39:14.943363 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.943280    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:14.954653 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.954623    2562 generic.go:356] "Generic (PLEG): container finished" podID="5d5fbb93-1f17-4496-b0a1-11732d7397dd" containerID="45a4fce3001cfa134e038af55f8cc7abf8d4667b0ec8609c41875b1af7c170a6" exitCode=0
Sep 09 14:39:14.954769 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.954658    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"
Sep 09 14:39:14.954769 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.954709    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj" event={"ID":"5d5fbb93-1f17-4496-b0a1-11732d7397dd","Type":"ContainerDied","Data":"45a4fce3001cfa134e038af55f8cc7abf8d4667b0ec8609c41875b1af7c170a6"}
Sep 09 14:39:14.954769 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.954752    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj" event={"ID":"5d5fbb93-1f17-4496-b0a1-11732d7397dd","Type":"ContainerDied","Data":"28b04cb7e96c1978d564c069183a707625ac6591c0282dc1d56842eeb6e4431c"}
Sep 09 14:39:14.954922 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.954774    2562 scope.go:117] "RemoveContainer" containerID="45a4fce3001cfa134e038af55f8cc7abf8d4667b0ec8609c41875b1af7c170a6"
Sep 09 14:39:14.964101 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.964085    2562 scope.go:117] "RemoveContainer" containerID="45a4fce3001cfa134e038af55f8cc7abf8d4667b0ec8609c41875b1af7c170a6"
Sep 09 14:39:14.964374 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:39:14.964355    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45a4fce3001cfa134e038af55f8cc7abf8d4667b0ec8609c41875b1af7c170a6\": container with ID starting with 45a4fce3001cfa134e038af55f8cc7abf8d4667b0ec8609c41875b1af7c170a6 not found: ID does not exist" containerID="45a4fce3001cfa134e038af55f8cc7abf8d4667b0ec8609c41875b1af7c170a6"
Sep 09 14:39:14.964418 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.964383    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a4fce3001cfa134e038af55f8cc7abf8d4667b0ec8609c41875b1af7c170a6"} err="failed to get container status \"45a4fce3001cfa134e038af55f8cc7abf8d4667b0ec8609c41875b1af7c170a6\": rpc error: code = NotFound desc = could not find container \"45a4fce3001cfa134e038af55f8cc7abf8d4667b0ec8609c41875b1af7c170a6\": container with ID starting with 45a4fce3001cfa134e038af55f8cc7abf8d4667b0ec8609c41875b1af7c170a6 not found: ID does not exist"
Sep 09 14:39:14.975729 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.975706    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"]
Sep 09 14:39:14.980024 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:14.980002    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b37ae4-79f5c67d58-rbrwj"]
Sep 09 14:39:15.806502 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:15.806470    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d5fbb93-1f17-4496-b0a1-11732d7397dd" path="/var/lib/kubelet/pods/5d5fbb93-1f17-4496-b0a1-11732d7397dd/volumes"
Sep 09 14:39:15.806835 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:15.806784    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a428d757-4777-47fb-a0bc-b75ae32417ce" path="/var/lib/kubelet/pods/a428d757-4777-47fb-a0bc-b75ae32417ce/volumes"
Sep 09 14:39:21.158419 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:21.158390    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:21.259578 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:21.259548    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:21.397979 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:21.397946    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"]
Sep 09 14:39:21.398262 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:21.398236    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw" podUID="af3321dd-e561-41e3-8a9c-48b16202389c" containerName="istio-proxy" containerID="cri-o://d9db3c7710f94e77a405e82eea8ac58b7ae9db555a4c2f46180251db368543cd" gracePeriod=30
Sep 09 14:39:21.429957 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:21.429865    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:23.486511 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:23.486469    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 14:39:23.486874 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:23.486529    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw" podUID="af3321dd-e561-41e3-8a9c-48b16202389c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 14:39:24.971388 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:24.971355    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8"]
Sep 09 14:39:24.971763 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:24.971751    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a428d757-4777-47fb-a0bc-b75ae32417ce" containerName="revoke-keys"
Sep 09 14:39:24.971763 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:24.971764    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a428d757-4777-47fb-a0bc-b75ae32417ce" containerName="revoke-keys"
Sep 09 14:39:24.971849 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:24.971786    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d5fbb93-1f17-4496-b0a1-11732d7397dd" containerName="payload-pre-processing"
Sep 09 14:39:24.971849 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:24.971792    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d5fbb93-1f17-4496-b0a1-11732d7397dd" containerName="payload-pre-processing"
Sep 09 14:39:24.971911 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:24.971856    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d5fbb93-1f17-4496-b0a1-11732d7397dd" containerName="payload-pre-processing"
Sep 09 14:39:24.971911 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:24.971866    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a428d757-4777-47fb-a0bc-b75ae32417ce" containerName="revoke-keys"
Sep 09 14:39:24.974562 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:24.974547    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8"
Sep 09 14:39:24.976918 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:24.976888    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:39:24.976918 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:24.976916    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:39:24.982759 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:24.982572    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8"]
Sep 09 14:39:25.030029 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:25.029998    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd21e080-a738-4de3-81c3-860b4dfacd2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8\" (UID: \"fd21e080-a738-4de3-81c3-860b4dfacd2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8"
Sep 09 14:39:25.131430 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:25.131395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd21e080-a738-4de3-81c3-860b4dfacd2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8\" (UID: \"fd21e080-a738-4de3-81c3-860b4dfacd2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8"
Sep 09 14:39:25.132204 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:25.132164    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd21e080-a738-4de3-81c3-860b4dfacd2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8\" (UID: \"fd21e080-a738-4de3-81c3-860b4dfacd2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8"
Sep 09 14:39:25.216087 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:25.216044    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:25.287862 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:25.287773    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8"
Sep 09 14:39:25.559673 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:25.559650    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8"]
Sep 09 14:39:25.561489 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:39:25.561461    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd21e080_a738_4de3_81c3_860b4dfacd2e.slice/crio-d9a760d2a3dca47dbf91caed579eff36c012c34e681b6ac176c6702f1edc111f WatchSource:0}: Error finding container d9a760d2a3dca47dbf91caed579eff36c012c34e681b6ac176c6702f1edc111f: Status 404 returned error can't find the container with id d9a760d2a3dca47dbf91caed579eff36c012c34e681b6ac176c6702f1edc111f
Sep 09 14:39:26.018038 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.018008    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8" event={"ID":"fd21e080-a738-4de3-81c3-860b4dfacd2e","Type":"ContainerStarted","Data":"a82e02e217e0386cc4e75d9ad3d7533392e9304e8f8ce81593fcb8260f92970e"}
Sep 09 14:39:26.018373 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.018066    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8" event={"ID":"fd21e080-a738-4de3-81c3-860b4dfacd2e","Type":"ContainerStarted","Data":"d9a760d2a3dca47dbf91caed579eff36c012c34e681b6ac176c6702f1edc111f"}
Sep 09 14:39:26.035015 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.034972    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8" podStartSLOduration=2.034957694 podStartE2EDuration="2.034957694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:39:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:39:26.033071874 +0000 UTC m=+1730.759611977" watchObservedRunningTime="2026-09-09 14:39:26.034957694 +0000 UTC m=+1730.761497794"
Sep 09 14:39:26.647950 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.647926    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:39:26.749099 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.749073    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgqdv\" (UniqueName: \"kubernetes.io/projected/af3321dd-e561-41e3-8a9c-48b16202389c-kube-api-access-kgqdv\") pod \"af3321dd-e561-41e3-8a9c-48b16202389c\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") "
Sep 09 14:39:26.749250 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.749107    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af3321dd-e561-41e3-8a9c-48b16202389c-istio-podinfo\") pod \"af3321dd-e561-41e3-8a9c-48b16202389c\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") "
Sep 09 14:39:26.749250 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.749134    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af3321dd-e561-41e3-8a9c-48b16202389c-istiod-ca-cert\") pod \"af3321dd-e561-41e3-8a9c-48b16202389c\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") "
Sep 09 14:39:26.749374 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.749324    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-credential-socket\") pod \"af3321dd-e561-41e3-8a9c-48b16202389c\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") "
Sep 09 14:39:26.749442 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.749428    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-istio-envoy\") pod \"af3321dd-e561-41e3-8a9c-48b16202389c\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") "
Sep 09 14:39:26.749498 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.749467    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-workload-certs\") pod \"af3321dd-e561-41e3-8a9c-48b16202389c\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") "
Sep 09 14:39:26.749549 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.749501    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af3321dd-e561-41e3-8a9c-48b16202389c-istio-token\") pod \"af3321dd-e561-41e3-8a9c-48b16202389c\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") "
Sep 09 14:39:26.749549 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.749529    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-istio-data\") pod \"af3321dd-e561-41e3-8a9c-48b16202389c\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") "
Sep 09 14:39:26.749657 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.749552    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-workload-socket\") pod \"af3321dd-e561-41e3-8a9c-48b16202389c\" (UID: \"af3321dd-e561-41e3-8a9c-48b16202389c\") "
Sep 09 14:39:26.749657 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.749591    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "af3321dd-e561-41e3-8a9c-48b16202389c" (UID: "af3321dd-e561-41e3-8a9c-48b16202389c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:39:26.749825 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.749797    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "af3321dd-e561-41e3-8a9c-48b16202389c" (UID: "af3321dd-e561-41e3-8a9c-48b16202389c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:39:26.749890 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.749829    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-istio-data" (OuterVolumeSpecName: "istio-data") pod "af3321dd-e561-41e3-8a9c-48b16202389c" (UID: "af3321dd-e561-41e3-8a9c-48b16202389c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:39:26.749947 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.749908    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-workload-certs\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:39:26.749947 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.749925    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-istio-data\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:39:26.749947 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.749939    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-credential-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:39:26.750140 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.750013    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af3321dd-e561-41e3-8a9c-48b16202389c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "af3321dd-e561-41e3-8a9c-48b16202389c" (UID: "af3321dd-e561-41e3-8a9c-48b16202389c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:39:26.750140 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.750037    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "af3321dd-e561-41e3-8a9c-48b16202389c" (UID: "af3321dd-e561-41e3-8a9c-48b16202389c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:39:26.751489 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.751466    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af3321dd-e561-41e3-8a9c-48b16202389c-kube-api-access-kgqdv" (OuterVolumeSpecName: "kube-api-access-kgqdv") pod "af3321dd-e561-41e3-8a9c-48b16202389c" (UID: "af3321dd-e561-41e3-8a9c-48b16202389c"). InnerVolumeSpecName "kube-api-access-kgqdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:39:26.751754 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.751730    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af3321dd-e561-41e3-8a9c-48b16202389c-istio-token" (OuterVolumeSpecName: "istio-token") pod "af3321dd-e561-41e3-8a9c-48b16202389c" (UID: "af3321dd-e561-41e3-8a9c-48b16202389c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:39:26.751842 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.751819    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af3321dd-e561-41e3-8a9c-48b16202389c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "af3321dd-e561-41e3-8a9c-48b16202389c" (UID: "af3321dd-e561-41e3-8a9c-48b16202389c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:39:26.751904 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.751889    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "af3321dd-e561-41e3-8a9c-48b16202389c" (UID: "af3321dd-e561-41e3-8a9c-48b16202389c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:39:26.851303 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.851277    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-istio-envoy\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:39:26.851303 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.851300    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af3321dd-e561-41e3-8a9c-48b16202389c-istio-token\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:39:26.851447 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.851309    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af3321dd-e561-41e3-8a9c-48b16202389c-workload-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:39:26.851447 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.851318    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgqdv\" (UniqueName: \"kubernetes.io/projected/af3321dd-e561-41e3-8a9c-48b16202389c-kube-api-access-kgqdv\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:39:26.851447 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.851328    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af3321dd-e561-41e3-8a9c-48b16202389c-istio-podinfo\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:39:26.851447 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:26.851336    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af3321dd-e561-41e3-8a9c-48b16202389c-istiod-ca-cert\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:39:27.025303 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:27.025272    2562 generic.go:356] "Generic (PLEG): container finished" podID="af3321dd-e561-41e3-8a9c-48b16202389c" containerID="d9db3c7710f94e77a405e82eea8ac58b7ae9db555a4c2f46180251db368543cd" exitCode=0
Sep 09 14:39:27.025645 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:27.025324    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"
Sep 09 14:39:27.025645 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:27.025357    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw" event={"ID":"af3321dd-e561-41e3-8a9c-48b16202389c","Type":"ContainerDied","Data":"d9db3c7710f94e77a405e82eea8ac58b7ae9db555a4c2f46180251db368543cd"}
Sep 09 14:39:27.025645 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:27.025404    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw" event={"ID":"af3321dd-e561-41e3-8a9c-48b16202389c","Type":"ContainerDied","Data":"cd46ed167a64a45840e341d61a13875760d68cf521c33c0c10c0a22a0597bfc3"}
Sep 09 14:39:27.025645 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:27.025431    2562 scope.go:117] "RemoveContainer" containerID="d9db3c7710f94e77a405e82eea8ac58b7ae9db555a4c2f46180251db368543cd"
Sep 09 14:39:27.027085 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:27.027067    2562 generic.go:356] "Generic (PLEG): container finished" podID="fd21e080-a738-4de3-81c3-860b4dfacd2e" containerID="a82e02e217e0386cc4e75d9ad3d7533392e9304e8f8ce81593fcb8260f92970e" exitCode=0
Sep 09 14:39:27.027197 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:27.027155    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8" event={"ID":"fd21e080-a738-4de3-81c3-860b4dfacd2e","Type":"ContainerDied","Data":"a82e02e217e0386cc4e75d9ad3d7533392e9304e8f8ce81593fcb8260f92970e"}
Sep 09 14:39:27.034875 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:27.034858    2562 scope.go:117] "RemoveContainer" containerID="0c2906ed0223eff289350be3d2be03cf04e132cb39259ab14e7b10d60d01683e"
Sep 09 14:39:27.045366 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:27.045305    2562 scope.go:117] "RemoveContainer" containerID="d9db3c7710f94e77a405e82eea8ac58b7ae9db555a4c2f46180251db368543cd"
Sep 09 14:39:27.046266 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:39:27.046234    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9db3c7710f94e77a405e82eea8ac58b7ae9db555a4c2f46180251db368543cd\": container with ID starting with d9db3c7710f94e77a405e82eea8ac58b7ae9db555a4c2f46180251db368543cd not found: ID does not exist" containerID="d9db3c7710f94e77a405e82eea8ac58b7ae9db555a4c2f46180251db368543cd"
Sep 09 14:39:27.046379 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:27.046276    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9db3c7710f94e77a405e82eea8ac58b7ae9db555a4c2f46180251db368543cd"} err="failed to get container status \"d9db3c7710f94e77a405e82eea8ac58b7ae9db555a4c2f46180251db368543cd\": rpc error: code = NotFound desc = could not find container \"d9db3c7710f94e77a405e82eea8ac58b7ae9db555a4c2f46180251db368543cd\": container with ID starting with d9db3c7710f94e77a405e82eea8ac58b7ae9db555a4c2f46180251db368543cd not found: ID does not exist"
Sep 09 14:39:27.046379 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:27.046300    2562 scope.go:117] "RemoveContainer" containerID="0c2906ed0223eff289350be3d2be03cf04e132cb39259ab14e7b10d60d01683e"
Sep 09 14:39:27.046771 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:39:27.046749    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c2906ed0223eff289350be3d2be03cf04e132cb39259ab14e7b10d60d01683e\": container with ID starting with 0c2906ed0223eff289350be3d2be03cf04e132cb39259ab14e7b10d60d01683e not found: ID does not exist" containerID="0c2906ed0223eff289350be3d2be03cf04e132cb39259ab14e7b10d60d01683e"
Sep 09 14:39:27.046853 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:27.046776    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c2906ed0223eff289350be3d2be03cf04e132cb39259ab14e7b10d60d01683e"} err="failed to get container status \"0c2906ed0223eff289350be3d2be03cf04e132cb39259ab14e7b10d60d01683e\": rpc error: code = NotFound desc = could not find container \"0c2906ed0223eff289350be3d2be03cf04e132cb39259ab14e7b10d60d01683e\": container with ID starting with 0c2906ed0223eff289350be3d2be03cf04e132cb39259ab14e7b10d60d01683e not found: ID does not exist"
Sep 09 14:39:27.060069 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:27.060048    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"]
Sep 09 14:39:27.066380 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:27.066357    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-b37ae4-openshift-default-688f58f544-hprzw"]
Sep 09 14:39:27.800615 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:27.800579    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af3321dd-e561-41e3-8a9c-48b16202389c" path="/var/lib/kubelet/pods/af3321dd-e561-41e3-8a9c-48b16202389c/volumes"
Sep 09 14:39:28.172547 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:28.172521    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8"
Sep 09 14:39:28.264705 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:28.264679    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd21e080-a738-4de3-81c3-860b4dfacd2e-maas-api-service-ca\") pod \"fd21e080-a738-4de3-81c3-860b4dfacd2e\" (UID: \"fd21e080-a738-4de3-81c3-860b4dfacd2e\") "
Sep 09 14:39:28.264963 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:28.264945    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd21e080-a738-4de3-81c3-860b4dfacd2e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fd21e080-a738-4de3-81c3-860b4dfacd2e" (UID: "fd21e080-a738-4de3-81c3-860b4dfacd2e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:39:28.365610 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:28.365547    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd21e080-a738-4de3-81c3-860b4dfacd2e-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:39:29.042181 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:29.042145    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8"
Sep 09 14:39:29.042347 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:29.042193    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8" event={"ID":"fd21e080-a738-4de3-81c3-860b4dfacd2e","Type":"ContainerDied","Data":"d9a760d2a3dca47dbf91caed579eff36c012c34e681b6ac176c6702f1edc111f"}
Sep 09 14:39:29.042347 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:29.042239    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9a760d2a3dca47dbf91caed579eff36c012c34e681b6ac176c6702f1edc111f"
Sep 09 14:39:33.549125 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:33.549086    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:35.254519 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:35.254460    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:36.311208 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:36.311155    2562 scope.go:117] "RemoveContainer" containerID="cd94451719337f147cf555c784106a249c301c1eb1fbc1258474668adff4d7a5"
Sep 09 14:39:40.824450 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:40.824412    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:40.851684 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:40.851648    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"]
Sep 09 14:39:40.851955 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:40.851888    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw" podUID="dda1b754-aca5-477d-8a81-f574cd04c6b7" containerName="payload-pre-processing" containerID="cri-o://3f1069a444d37efeff5dcfe991366d4986bb85ddd5d0a68f6bd8703a43f186c1" gracePeriod=30
Sep 09 14:39:40.924648 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:40.924615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:40.998872 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:40.998837    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8"]
Sep 09 14:39:41.000664 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:41.000619    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:41.001245 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:41.001201    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ea13e2-4n5n8"]
Sep 09 14:39:41.068631 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:41.068553    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:41.125634 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:41.125600    2562 generic.go:356] "Generic (PLEG): container finished" podID="dda1b754-aca5-477d-8a81-f574cd04c6b7" containerID="3f1069a444d37efeff5dcfe991366d4986bb85ddd5d0a68f6bd8703a43f186c1" exitCode=0
Sep 09 14:39:41.125782 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:41.125652    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw" event={"ID":"dda1b754-aca5-477d-8a81-f574cd04c6b7","Type":"ContainerDied","Data":"3f1069a444d37efeff5dcfe991366d4986bb85ddd5d0a68f6bd8703a43f186c1"}
Sep 09 14:39:41.125782 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:41.125768    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw" event={"ID":"dda1b754-aca5-477d-8a81-f574cd04c6b7","Type":"ContainerDied","Data":"a710253ab0d66efbc270a4d0e94902d8d211ecca41413242505d735f08c71455"}
Sep 09 14:39:41.125945 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:41.125787    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a710253ab0d66efbc270a4d0e94902d8d211ecca41413242505d735f08c71455"
Sep 09 14:39:41.129726 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:41.129707    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"
Sep 09 14:39:41.274715 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:41.274679    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda1b754-aca5-477d-8a81-f574cd04c6b7-plugins-config-volume\") pod \"dda1b754-aca5-477d-8a81-f574cd04c6b7\" (UID: \"dda1b754-aca5-477d-8a81-f574cd04c6b7\") "
Sep 09 14:39:41.274874 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:41.274738    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdvps\" (UniqueName: \"kubernetes.io/projected/dda1b754-aca5-477d-8a81-f574cd04c6b7-kube-api-access-gdvps\") pod \"dda1b754-aca5-477d-8a81-f574cd04c6b7\" (UID: \"dda1b754-aca5-477d-8a81-f574cd04c6b7\") "
Sep 09 14:39:41.275055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:41.275033    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dda1b754-aca5-477d-8a81-f574cd04c6b7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dda1b754-aca5-477d-8a81-f574cd04c6b7" (UID: "dda1b754-aca5-477d-8a81-f574cd04c6b7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:39:41.276697 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:41.276678    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dda1b754-aca5-477d-8a81-f574cd04c6b7-kube-api-access-gdvps" (OuterVolumeSpecName: "kube-api-access-gdvps") pod "dda1b754-aca5-477d-8a81-f574cd04c6b7" (UID: "dda1b754-aca5-477d-8a81-f574cd04c6b7"). InnerVolumeSpecName "kube-api-access-gdvps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:39:41.375580 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:41.375515    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dda1b754-aca5-477d-8a81-f574cd04c6b7-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:39:41.375580 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:41.375536    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdvps\" (UniqueName: \"kubernetes.io/projected/dda1b754-aca5-477d-8a81-f574cd04c6b7-kube-api-access-gdvps\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:39:41.380965 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:41.380931    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:41.801666 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:41.801582    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd21e080-a738-4de3-81c3-860b4dfacd2e" path="/var/lib/kubelet/pods/fd21e080-a738-4de3-81c3-860b4dfacd2e/volumes"
Sep 09 14:39:42.131090 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:42.131045    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"
Sep 09 14:39:42.147724 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:42.147698    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"]
Sep 09 14:39:42.151649 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:42.151628    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ea13e2-7f558c8f66-9b2mw"]
Sep 09 14:39:43.800070 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:43.800036    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dda1b754-aca5-477d-8a81-f574cd04c6b7" path="/var/lib/kubelet/pods/dda1b754-aca5-477d-8a81-f574cd04c6b7/volumes"
Sep 09 14:39:46.456830 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:46.456793    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:39:53.172723 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:39:53.172687    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:02.827200 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:02.827145    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:22.509941 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:22.509899    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:23.638702 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:23.638663    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:28.553527 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:28.553444    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:29.723881 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:29.723843    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:35.408892 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:35.408857    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:35.470156 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:35.470110    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:35.692992 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:35.692908    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"]
Sep 09 14:40:35.693231 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:35.693195    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn" podUID="97160bab-f356-4603-a0f8-c19a615123a8" containerName="istio-proxy" containerID="cri-o://85af4eaa5d6b81c7da98a1e3aa48f910580282ad0769b465be39fdb1bb107332" gracePeriod=30
Sep 09 14:40:35.714579 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:35.714540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:35.950793 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:35.950707    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:40:35.957143 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:35.957115    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:40:36.118206 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.118152    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj"]
Sep 09 14:40:36.118839 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.118819    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd21e080-a738-4de3-81c3-860b4dfacd2e" containerName="revoke-keys"
Sep 09 14:40:36.118885 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.118845    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd21e080-a738-4de3-81c3-860b4dfacd2e" containerName="revoke-keys"
Sep 09 14:40:36.118885 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.118857    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dda1b754-aca5-477d-8a81-f574cd04c6b7" containerName="payload-pre-processing"
Sep 09 14:40:36.118885 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.118866    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dda1b754-aca5-477d-8a81-f574cd04c6b7" containerName="payload-pre-processing"
Sep 09 14:40:36.118981 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.118885    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af3321dd-e561-41e3-8a9c-48b16202389c" containerName="istio-proxy"
Sep 09 14:40:36.118981 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.118893    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="af3321dd-e561-41e3-8a9c-48b16202389c" containerName="istio-proxy"
Sep 09 14:40:36.118981 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.118923    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af3321dd-e561-41e3-8a9c-48b16202389c" containerName="istio-proxy"
Sep 09 14:40:36.118981 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.118932    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="af3321dd-e561-41e3-8a9c-48b16202389c" containerName="istio-proxy"
Sep 09 14:40:36.119102 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.119038    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="af3321dd-e561-41e3-8a9c-48b16202389c" containerName="istio-proxy"
Sep 09 14:40:36.119102 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.119048    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd21e080-a738-4de3-81c3-860b4dfacd2e" containerName="revoke-keys"
Sep 09 14:40:36.119102 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.119058    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dda1b754-aca5-477d-8a81-f574cd04c6b7" containerName="payload-pre-processing"
Sep 09 14:40:36.119102 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.119066    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="af3321dd-e561-41e3-8a9c-48b16202389c" containerName="istio-proxy"
Sep 09 14:40:36.122762 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.122740    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj"
Sep 09 14:40:36.125564 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.125534    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:40:36.125938 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.125543    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:40:36.128055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.128029    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj"]
Sep 09 14:40:36.223817 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.223730    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6543ac7d-7a29-4f65-866a-13b8c2488846-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj\" (UID: \"6543ac7d-7a29-4f65-866a-13b8c2488846\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj"
Sep 09 14:40:36.224531 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.224505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:36.324817 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.324783    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6543ac7d-7a29-4f65-866a-13b8c2488846-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj\" (UID: \"6543ac7d-7a29-4f65-866a-13b8c2488846\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj"
Sep 09 14:40:36.325427 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.325404    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6543ac7d-7a29-4f65-866a-13b8c2488846-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj\" (UID: \"6543ac7d-7a29-4f65-866a-13b8c2488846\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj"
Sep 09 14:40:36.436547 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.436516    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj"
Sep 09 14:40:36.713502 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:36.713476    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj"]
Sep 09 14:40:36.715886 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:40:36.715854    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6543ac7d_7a29_4f65_866a_13b8c2488846.slice/crio-0123c6b7b69662e6a5b9448054196404e07180c30b282d624c837dfb0433bddf WatchSource:0}: Error finding container 0123c6b7b69662e6a5b9448054196404e07180c30b282d624c837dfb0433bddf: Status 404 returned error can't find the container with id 0123c6b7b69662e6a5b9448054196404e07180c30b282d624c837dfb0433bddf
Sep 09 14:40:37.452388 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:37.452355    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj" event={"ID":"6543ac7d-7a29-4f65-866a-13b8c2488846","Type":"ContainerStarted","Data":"98cea834c620c3ae2f114c7adb3903f4ba0687df7c21e2e2fe2aa01161549b6b"}
Sep 09 14:40:37.452860 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:37.452415    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj" event={"ID":"6543ac7d-7a29-4f65-866a-13b8c2488846","Type":"ContainerStarted","Data":"0123c6b7b69662e6a5b9448054196404e07180c30b282d624c837dfb0433bddf"}
Sep 09 14:40:37.468856 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:37.468810    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj" podStartSLOduration=1.468796747 podStartE2EDuration="1.468796747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:40:37.46650067 +0000 UTC m=+1802.193040771" watchObservedRunningTime="2026-09-09 14:40:37.468796747 +0000 UTC m=+1802.195336850"
Sep 09 14:40:38.459292 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:38.459255    2562 generic.go:356] "Generic (PLEG): container finished" podID="6543ac7d-7a29-4f65-866a-13b8c2488846" containerID="98cea834c620c3ae2f114c7adb3903f4ba0687df7c21e2e2fe2aa01161549b6b" exitCode=0
Sep 09 14:40:38.459659 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:38.459329    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj" event={"ID":"6543ac7d-7a29-4f65-866a-13b8c2488846","Type":"ContainerDied","Data":"98cea834c620c3ae2f114c7adb3903f4ba0687df7c21e2e2fe2aa01161549b6b"}
Sep 09 14:40:39.591895 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:39.591870    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj"
Sep 09 14:40:39.653128 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:39.653102    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6543ac7d-7a29-4f65-866a-13b8c2488846-maas-api-service-ca\") pod \"6543ac7d-7a29-4f65-866a-13b8c2488846\" (UID: \"6543ac7d-7a29-4f65-866a-13b8c2488846\") "
Sep 09 14:40:39.653456 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:39.653435    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6543ac7d-7a29-4f65-866a-13b8c2488846-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6543ac7d-7a29-4f65-866a-13b8c2488846" (UID: "6543ac7d-7a29-4f65-866a-13b8c2488846"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:40:39.754649 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:39.754553    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6543ac7d-7a29-4f65-866a-13b8c2488846-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:40:40.471863 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:40.471835    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj"
Sep 09 14:40:40.472046 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:40.471870    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj" event={"ID":"6543ac7d-7a29-4f65-866a-13b8c2488846","Type":"ContainerDied","Data":"0123c6b7b69662e6a5b9448054196404e07180c30b282d624c837dfb0433bddf"}
Sep 09 14:40:40.472046 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:40.471918    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0123c6b7b69662e6a5b9448054196404e07180c30b282d624c837dfb0433bddf"
Sep 09 14:40:40.947769 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:40.947745    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:40:41.069671 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.069572    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-workload-socket\") pod \"97160bab-f356-4603-a0f8-c19a615123a8\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") "
Sep 09 14:40:41.069671 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.069610    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-workload-certs\") pod \"97160bab-f356-4603-a0f8-c19a615123a8\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") "
Sep 09 14:40:41.069671 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.069629    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97160bab-f356-4603-a0f8-c19a615123a8-istio-podinfo\") pod \"97160bab-f356-4603-a0f8-c19a615123a8\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") "
Sep 09 14:40:41.069960 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.069678    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-credential-socket\") pod \"97160bab-f356-4603-a0f8-c19a615123a8\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") "
Sep 09 14:40:41.069960 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.069712    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-istio-envoy\") pod \"97160bab-f356-4603-a0f8-c19a615123a8\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") "
Sep 09 14:40:41.069960 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.069756    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97160bab-f356-4603-a0f8-c19a615123a8-istiod-ca-cert\") pod \"97160bab-f356-4603-a0f8-c19a615123a8\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") "
Sep 09 14:40:41.069960 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.069846    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qw4bp\" (UniqueName: \"kubernetes.io/projected/97160bab-f356-4603-a0f8-c19a615123a8-kube-api-access-qw4bp\") pod \"97160bab-f356-4603-a0f8-c19a615123a8\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") "
Sep 09 14:40:41.069960 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.069877    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97160bab-f356-4603-a0f8-c19a615123a8-istio-token\") pod \"97160bab-f356-4603-a0f8-c19a615123a8\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") "
Sep 09 14:40:41.069960 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.069904    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-istio-data\") pod \"97160bab-f356-4603-a0f8-c19a615123a8\" (UID: \"97160bab-f356-4603-a0f8-c19a615123a8\") "
Sep 09 14:40:41.069960 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.069923    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "97160bab-f356-4603-a0f8-c19a615123a8" (UID: "97160bab-f356-4603-a0f8-c19a615123a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:40:41.070377 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.070016    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "97160bab-f356-4603-a0f8-c19a615123a8" (UID: "97160bab-f356-4603-a0f8-c19a615123a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:40:41.070377 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.070278    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-workload-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:40:41.070377 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.070298    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-workload-certs\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:40:41.070377 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.070282    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "97160bab-f356-4603-a0f8-c19a615123a8" (UID: "97160bab-f356-4603-a0f8-c19a615123a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:40:41.070377 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.070301    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "97160bab-f356-4603-a0f8-c19a615123a8" (UID: "97160bab-f356-4603-a0f8-c19a615123a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:40:41.070631 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.070412    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97160bab-f356-4603-a0f8-c19a615123a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "97160bab-f356-4603-a0f8-c19a615123a8" (UID: "97160bab-f356-4603-a0f8-c19a615123a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:40:41.072006 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.071982    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97160bab-f356-4603-a0f8-c19a615123a8-kube-api-access-qw4bp" (OuterVolumeSpecName: "kube-api-access-qw4bp") pod "97160bab-f356-4603-a0f8-c19a615123a8" (UID: "97160bab-f356-4603-a0f8-c19a615123a8"). InnerVolumeSpecName "kube-api-access-qw4bp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:40:41.072134 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.072111    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97160bab-f356-4603-a0f8-c19a615123a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "97160bab-f356-4603-a0f8-c19a615123a8" (UID: "97160bab-f356-4603-a0f8-c19a615123a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:40:41.072212 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.072122    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "97160bab-f356-4603-a0f8-c19a615123a8" (UID: "97160bab-f356-4603-a0f8-c19a615123a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:40:41.072212 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.072130    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/97160bab-f356-4603-a0f8-c19a615123a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "97160bab-f356-4603-a0f8-c19a615123a8" (UID: "97160bab-f356-4603-a0f8-c19a615123a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:40:41.171517 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.171484    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qw4bp\" (UniqueName: \"kubernetes.io/projected/97160bab-f356-4603-a0f8-c19a615123a8-kube-api-access-qw4bp\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:40:41.171517 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.171511    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97160bab-f356-4603-a0f8-c19a615123a8-istio-token\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:40:41.171517 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.171520    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-istio-data\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:40:41.171517 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.171528    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97160bab-f356-4603-a0f8-c19a615123a8-istio-podinfo\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:40:41.171794 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.171536    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-credential-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:40:41.171794 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.171543    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97160bab-f356-4603-a0f8-c19a615123a8-istio-envoy\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:40:41.171794 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.171551    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97160bab-f356-4603-a0f8-c19a615123a8-istiod-ca-cert\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:40:41.478768 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.478686    2562 generic.go:356] "Generic (PLEG): container finished" podID="97160bab-f356-4603-a0f8-c19a615123a8" containerID="85af4eaa5d6b81c7da98a1e3aa48f910580282ad0769b465be39fdb1bb107332" exitCode=0
Sep 09 14:40:41.478768 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.478735    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"
Sep 09 14:40:41.478948 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.478738    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn" event={"ID":"97160bab-f356-4603-a0f8-c19a615123a8","Type":"ContainerDied","Data":"85af4eaa5d6b81c7da98a1e3aa48f910580282ad0769b465be39fdb1bb107332"}
Sep 09 14:40:41.478948 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.478865    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn" event={"ID":"97160bab-f356-4603-a0f8-c19a615123a8","Type":"ContainerDied","Data":"4c4c8305a65158c2078d3823350737eebf54146859cf79ae3f3ab484816f7a7c"}
Sep 09 14:40:41.478948 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.478895    2562 scope.go:117] "RemoveContainer" containerID="85af4eaa5d6b81c7da98a1e3aa48f910580282ad0769b465be39fdb1bb107332"
Sep 09 14:40:41.488815 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.488800    2562 scope.go:117] "RemoveContainer" containerID="817dd7773f00d3013a1b4945eecdfbcc7b4c471be1de882fbf713998b2bb09fa"
Sep 09 14:40:41.496973 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.496952    2562 scope.go:117] "RemoveContainer" containerID="85af4eaa5d6b81c7da98a1e3aa48f910580282ad0769b465be39fdb1bb107332"
Sep 09 14:40:41.497246 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:40:41.497226    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85af4eaa5d6b81c7da98a1e3aa48f910580282ad0769b465be39fdb1bb107332\": container with ID starting with 85af4eaa5d6b81c7da98a1e3aa48f910580282ad0769b465be39fdb1bb107332 not found: ID does not exist" containerID="85af4eaa5d6b81c7da98a1e3aa48f910580282ad0769b465be39fdb1bb107332"
Sep 09 14:40:41.497306 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.497255    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85af4eaa5d6b81c7da98a1e3aa48f910580282ad0769b465be39fdb1bb107332"} err="failed to get container status \"85af4eaa5d6b81c7da98a1e3aa48f910580282ad0769b465be39fdb1bb107332\": rpc error: code = NotFound desc = could not find container \"85af4eaa5d6b81c7da98a1e3aa48f910580282ad0769b465be39fdb1bb107332\": container with ID starting with 85af4eaa5d6b81c7da98a1e3aa48f910580282ad0769b465be39fdb1bb107332 not found: ID does not exist"
Sep 09 14:40:41.497306 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.497275    2562 scope.go:117] "RemoveContainer" containerID="817dd7773f00d3013a1b4945eecdfbcc7b4c471be1de882fbf713998b2bb09fa"
Sep 09 14:40:41.497565 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:40:41.497534    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"817dd7773f00d3013a1b4945eecdfbcc7b4c471be1de882fbf713998b2bb09fa\": container with ID starting with 817dd7773f00d3013a1b4945eecdfbcc7b4c471be1de882fbf713998b2bb09fa not found: ID does not exist" containerID="817dd7773f00d3013a1b4945eecdfbcc7b4c471be1de882fbf713998b2bb09fa"
Sep 09 14:40:41.497666 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.497572    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"817dd7773f00d3013a1b4945eecdfbcc7b4c471be1de882fbf713998b2bb09fa"} err="failed to get container status \"817dd7773f00d3013a1b4945eecdfbcc7b4c471be1de882fbf713998b2bb09fa\": rpc error: code = NotFound desc = could not find container \"817dd7773f00d3013a1b4945eecdfbcc7b4c471be1de882fbf713998b2bb09fa\": container with ID starting with 817dd7773f00d3013a1b4945eecdfbcc7b4c471be1de882fbf713998b2bb09fa not found: ID does not exist"
Sep 09 14:40:41.500349 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.500329    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"]
Sep 09 14:40:41.505017 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.504996    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-ea13e2-openshift-default-75fd8c4d4-d4whn"]
Sep 09 14:40:41.801676 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:41.801597    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97160bab-f356-4603-a0f8-c19a615123a8" path="/var/lib/kubelet/pods/97160bab-f356-4603-a0f8-c19a615123a8/volumes"
Sep 09 14:40:46.592604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:46.592565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:46.687509 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:46.687470    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"]
Sep 09 14:40:46.687760 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:46.687712    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc" podUID="b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b" containerName="payload-pre-processing" containerID="cri-o://12ff8b3d2c48893be3d4748e2143d33a720d81ceb15939012e7313a1d326da5b" gracePeriod=30
Sep 09 14:40:46.709370 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:46.709342    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:46.807615 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:46.807588    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:46.837642 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:46.837597    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj"]
Sep 09 14:40:46.842875 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:46.842751    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f583d9-vkpbj"]
Sep 09 14:40:46.908717 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:46.908680    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:46.948627 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:46.948600    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"
Sep 09 14:40:47.025161 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.025127    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b-plugins-config-volume\") pod \"b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b\" (UID: \"b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b\") "
Sep 09 14:40:47.025161 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.025195    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74dgl\" (UniqueName: \"kubernetes.io/projected/b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b-kube-api-access-74dgl\") pod \"b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b\" (UID: \"b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b\") "
Sep 09 14:40:47.025512 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.025488    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b" (UID: "b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:40:47.027350 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.027325    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b-kube-api-access-74dgl" (OuterVolumeSpecName: "kube-api-access-74dgl") pod "b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b" (UID: "b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b"). InnerVolumeSpecName "kube-api-access-74dgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:40:47.126790 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.126692    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:40:47.126790 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.126732    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74dgl\" (UniqueName: \"kubernetes.io/projected/b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b-kube-api-access-74dgl\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:40:47.515219 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.515127    2562 generic.go:356] "Generic (PLEG): container finished" podID="b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b" containerID="12ff8b3d2c48893be3d4748e2143d33a720d81ceb15939012e7313a1d326da5b" exitCode=0
Sep 09 14:40:47.515219 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.515181    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"
Sep 09 14:40:47.515219 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.515206    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc" event={"ID":"b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b","Type":"ContainerDied","Data":"12ff8b3d2c48893be3d4748e2143d33a720d81ceb15939012e7313a1d326da5b"}
Sep 09 14:40:47.515440 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.515249    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc" event={"ID":"b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b","Type":"ContainerDied","Data":"3a64829958c354c126e2911f68ddd6120abe72a06251d1a8fcc23f99714db70c"}
Sep 09 14:40:47.515440 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.515272    2562 scope.go:117] "RemoveContainer" containerID="12ff8b3d2c48893be3d4748e2143d33a720d81ceb15939012e7313a1d326da5b"
Sep 09 14:40:47.524497 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.524473    2562 scope.go:117] "RemoveContainer" containerID="12ff8b3d2c48893be3d4748e2143d33a720d81ceb15939012e7313a1d326da5b"
Sep 09 14:40:47.524752 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:40:47.524736    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12ff8b3d2c48893be3d4748e2143d33a720d81ceb15939012e7313a1d326da5b\": container with ID starting with 12ff8b3d2c48893be3d4748e2143d33a720d81ceb15939012e7313a1d326da5b not found: ID does not exist" containerID="12ff8b3d2c48893be3d4748e2143d33a720d81ceb15939012e7313a1d326da5b"
Sep 09 14:40:47.524810 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.524760    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12ff8b3d2c48893be3d4748e2143d33a720d81ceb15939012e7313a1d326da5b"} err="failed to get container status \"12ff8b3d2c48893be3d4748e2143d33a720d81ceb15939012e7313a1d326da5b\": rpc error: code = NotFound desc = could not find container \"12ff8b3d2c48893be3d4748e2143d33a720d81ceb15939012e7313a1d326da5b\": container with ID starting with 12ff8b3d2c48893be3d4748e2143d33a720d81ceb15939012e7313a1d326da5b not found: ID does not exist"
Sep 09 14:40:47.537204 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.537152    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"]
Sep 09 14:40:47.541422 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.541398    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f583d9-689f5f78f8-kv8zc"]
Sep 09 14:40:47.800817 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.800736    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6543ac7d-7a29-4f65-866a-13b8c2488846" path="/var/lib/kubelet/pods/6543ac7d-7a29-4f65-866a-13b8c2488846/volumes"
Sep 09 14:40:47.801157 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:47.801094    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b" path="/var/lib/kubelet/pods/b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b/volumes"
Sep 09 14:40:50.534194 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:50.534136    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:53.629684 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:53.629645    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:53.973909 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:53.973798    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:54.270589 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.270500    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:54.352369 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.352333    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v"]
Sep 09 14:40:54.352745 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.352729    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6543ac7d-7a29-4f65-866a-13b8c2488846" containerName="revoke-keys"
Sep 09 14:40:54.352829 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.352747    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6543ac7d-7a29-4f65-866a-13b8c2488846" containerName="revoke-keys"
Sep 09 14:40:54.352829 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.352763    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97160bab-f356-4603-a0f8-c19a615123a8" containerName="istio-proxy"
Sep 09 14:40:54.352829 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.352770    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="97160bab-f356-4603-a0f8-c19a615123a8" containerName="istio-proxy"
Sep 09 14:40:54.352829 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.352790    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b" containerName="payload-pre-processing"
Sep 09 14:40:54.352829 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.352796    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b" containerName="payload-pre-processing"
Sep 09 14:40:54.353083 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.352852    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b98b8ac7-6f07-4cf8-963e-52d88e7d5f9b" containerName="payload-pre-processing"
Sep 09 14:40:54.353083 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.352862    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="97160bab-f356-4603-a0f8-c19a615123a8" containerName="istio-proxy"
Sep 09 14:40:54.353083 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.352869    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6543ac7d-7a29-4f65-866a-13b8c2488846" containerName="revoke-keys"
Sep 09 14:40:54.357301 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.357281    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v"
Sep 09 14:40:54.359766 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.359721    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:40:54.359877 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.359750    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 14:40:54.364357 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.364304    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v"]
Sep 09 14:40:54.497659 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.497627    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/801dc825-08c9-46b0-acd5-dc37b906621d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v\" (UID: \"801dc825-08c9-46b0-acd5-dc37b906621d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v"
Sep 09 14:40:54.598541 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.598507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/801dc825-08c9-46b0-acd5-dc37b906621d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v\" (UID: \"801dc825-08c9-46b0-acd5-dc37b906621d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v"
Sep 09 14:40:54.599121 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.599101    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/801dc825-08c9-46b0-acd5-dc37b906621d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v\" (UID: \"801dc825-08c9-46b0-acd5-dc37b906621d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v"
Sep 09 14:40:54.623180 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.623137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:40:54.670969 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.670937    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v"
Sep 09 14:40:54.944685 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:54.944608    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v"]
Sep 09 14:40:54.945235 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:40:54.945207    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801dc825_08c9_46b0_acd5_dc37b906621d.slice/crio-497332fe55d4684e20b9c40977400a161a9166de842e2a0fbcde1ebc1607aa93 WatchSource:0}: Error finding container 497332fe55d4684e20b9c40977400a161a9166de842e2a0fbcde1ebc1607aa93: Status 404 returned error can't find the container with id 497332fe55d4684e20b9c40977400a161a9166de842e2a0fbcde1ebc1607aa93
Sep 09 14:40:55.566206 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:55.566155    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v" event={"ID":"801dc825-08c9-46b0-acd5-dc37b906621d","Type":"ContainerStarted","Data":"87671a64c44d513b04cafefcb9481ce638917aaf329dfda960e87bff937c5389"}
Sep 09 14:40:55.566368 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:55.566249    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v" event={"ID":"801dc825-08c9-46b0-acd5-dc37b906621d","Type":"ContainerStarted","Data":"497332fe55d4684e20b9c40977400a161a9166de842e2a0fbcde1ebc1607aa93"}
Sep 09 14:40:55.580545 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:55.580504    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v" podStartSLOduration=1.580490489 podStartE2EDuration="1.580490489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:40:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:40:55.579836231 +0000 UTC m=+1820.306376333" watchObservedRunningTime="2026-09-09 14:40:55.580490489 +0000 UTC m=+1820.307030590"
Sep 09 14:40:56.573811 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:56.573774    2562 generic.go:356] "Generic (PLEG): container finished" podID="801dc825-08c9-46b0-acd5-dc37b906621d" containerID="87671a64c44d513b04cafefcb9481ce638917aaf329dfda960e87bff937c5389" exitCode=0
Sep 09 14:40:56.574222 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:56.573819    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v" event={"ID":"801dc825-08c9-46b0-acd5-dc37b906621d","Type":"ContainerDied","Data":"87671a64c44d513b04cafefcb9481ce638917aaf329dfda960e87bff937c5389"}
Sep 09 14:40:57.715115 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:57.715090    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v"
Sep 09 14:40:57.828778 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:57.828752    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/801dc825-08c9-46b0-acd5-dc37b906621d-maas-api-service-ca\") pod \"801dc825-08c9-46b0-acd5-dc37b906621d\" (UID: \"801dc825-08c9-46b0-acd5-dc37b906621d\") "
Sep 09 14:40:57.829098 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:57.829077    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/801dc825-08c9-46b0-acd5-dc37b906621d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "801dc825-08c9-46b0-acd5-dc37b906621d" (UID: "801dc825-08c9-46b0-acd5-dc37b906621d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:40:57.929402 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:57.929339    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/801dc825-08c9-46b0-acd5-dc37b906621d-maas-api-service-ca\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:40:58.587069 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:58.587039    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v"
Sep 09 14:40:58.587264 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:58.587076    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v" event={"ID":"801dc825-08c9-46b0-acd5-dc37b906621d","Type":"ContainerDied","Data":"497332fe55d4684e20b9c40977400a161a9166de842e2a0fbcde1ebc1607aa93"}
Sep 09 14:40:58.587264 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:40:58.587122    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="497332fe55d4684e20b9c40977400a161a9166de842e2a0fbcde1ebc1607aa93"
Sep 09 14:41:04.884807 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:04.884769    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-e565aa-29816070-45lgd"]
Sep 09 14:41:04.889094 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:04.889066    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-e565aa-29816070-45lgd"]
Sep 09 14:41:04.895687 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:04.895655    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:04.913049 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:04.913015    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"]
Sep 09 14:41:04.914071 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:04.913856    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492" podUID="e7286859-9823-434e-8986-f4bb5ec86cee" containerName="payload-processing" containerID="cri-o://42840753620efcb560ca0060e36376a04b03d49ded8bf8b7a011e93ac6ed6a2b" gracePeriod=30
Sep 09 14:41:04.995841 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:04.995799    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:05.059664 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.059596    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v"]
Sep 09 14:41:05.062706 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.062678    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-e565aa-ngv6v"]
Sep 09 14:41:05.065652 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.065621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:05.150193 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.150083    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:05.182035 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.182010    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"
Sep 09 14:41:05.205904 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.205879    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7286859-9823-434e-8986-f4bb5ec86cee-plugins-config-volume\") pod \"e7286859-9823-434e-8986-f4bb5ec86cee\" (UID: \"e7286859-9823-434e-8986-f4bb5ec86cee\") "
Sep 09 14:41:05.206066 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.205920    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xq7j\" (UniqueName: \"kubernetes.io/projected/e7286859-9823-434e-8986-f4bb5ec86cee-kube-api-access-9xq7j\") pod \"e7286859-9823-434e-8986-f4bb5ec86cee\" (UID: \"e7286859-9823-434e-8986-f4bb5ec86cee\") "
Sep 09 14:41:05.206386 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.206357    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7286859-9823-434e-8986-f4bb5ec86cee-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e7286859-9823-434e-8986-f4bb5ec86cee" (UID: "e7286859-9823-434e-8986-f4bb5ec86cee"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:41:05.208032 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.208012    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7286859-9823-434e-8986-f4bb5ec86cee-kube-api-access-9xq7j" (OuterVolumeSpecName: "kube-api-access-9xq7j") pod "e7286859-9823-434e-8986-f4bb5ec86cee" (UID: "e7286859-9823-434e-8986-f4bb5ec86cee"). InnerVolumeSpecName "kube-api-access-9xq7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:41:05.306686 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.306648    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e7286859-9823-434e-8986-f4bb5ec86cee-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:41:05.306686 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.306678    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xq7j\" (UniqueName: \"kubernetes.io/projected/e7286859-9823-434e-8986-f4bb5ec86cee-kube-api-access-9xq7j\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:41:05.614723 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.614690    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:05.624586 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.624557    2562 generic.go:356] "Generic (PLEG): container finished" podID="e7286859-9823-434e-8986-f4bb5ec86cee" containerID="42840753620efcb560ca0060e36376a04b03d49ded8bf8b7a011e93ac6ed6a2b" exitCode=0
Sep 09 14:41:05.624753 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.624596    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"
Sep 09 14:41:05.624753 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.624624    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492" event={"ID":"e7286859-9823-434e-8986-f4bb5ec86cee","Type":"ContainerDied","Data":"42840753620efcb560ca0060e36376a04b03d49ded8bf8b7a011e93ac6ed6a2b"}
Sep 09 14:41:05.624753 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.624665    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492" event={"ID":"e7286859-9823-434e-8986-f4bb5ec86cee","Type":"ContainerDied","Data":"5ee2090e68dc0f44ea1b3ce1387e245c0fe789a6020f1a1ffd2ec3fc3bab37c6"}
Sep 09 14:41:05.624753 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.624685    2562 scope.go:117] "RemoveContainer" containerID="42840753620efcb560ca0060e36376a04b03d49ded8bf8b7a011e93ac6ed6a2b"
Sep 09 14:41:05.634287 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.634268    2562 scope.go:117] "RemoveContainer" containerID="42840753620efcb560ca0060e36376a04b03d49ded8bf8b7a011e93ac6ed6a2b"
Sep 09 14:41:05.634530 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:41:05.634508    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42840753620efcb560ca0060e36376a04b03d49ded8bf8b7a011e93ac6ed6a2b\": container with ID starting with 42840753620efcb560ca0060e36376a04b03d49ded8bf8b7a011e93ac6ed6a2b not found: ID does not exist" containerID="42840753620efcb560ca0060e36376a04b03d49ded8bf8b7a011e93ac6ed6a2b"
Sep 09 14:41:05.634596 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.634539    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42840753620efcb560ca0060e36376a04b03d49ded8bf8b7a011e93ac6ed6a2b"} err="failed to get container status \"42840753620efcb560ca0060e36376a04b03d49ded8bf8b7a011e93ac6ed6a2b\": rpc error: code = NotFound desc = could not find container \"42840753620efcb560ca0060e36376a04b03d49ded8bf8b7a011e93ac6ed6a2b\": container with ID starting with 42840753620efcb560ca0060e36376a04b03d49ded8bf8b7a011e93ac6ed6a2b not found: ID does not exist"
Sep 09 14:41:05.646041 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.646018    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"]
Sep 09 14:41:05.649633 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.649608    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-e565aa-75df66dd5c-wn492"]
Sep 09 14:41:05.800457 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.800428    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="801dc825-08c9-46b0-acd5-dc37b906621d" path="/var/lib/kubelet/pods/801dc825-08c9-46b0-acd5-dc37b906621d/volumes"
Sep 09 14:41:05.800773 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.800760    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7286859-9823-434e-8986-f4bb5ec86cee" path="/var/lib/kubelet/pods/e7286859-9823-434e-8986-f4bb5ec86cee/volumes"
Sep 09 14:41:05.801010 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:05.800999    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7943fbc-2220-44f7-82df-3d844d5550cd" path="/var/lib/kubelet/pods/f7943fbc-2220-44f7-82df-3d844d5550cd/volumes"
Sep 09 14:41:11.859230 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:11.859191    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:11.960379 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:11.960335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:12.138709 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:12.138632    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"]
Sep 09 14:41:12.138907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:12.138878    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l" podUID="49674920-0231-4c9e-b0b7-8250892a22bd" containerName="istio-proxy" containerID="cri-o://b47641bceb1acebb08aa4db1144d3405c46b96b5f408b944bd39160433fafa16" gracePeriod=30
Sep 09 14:41:12.159134 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:12.159099    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:13.510797 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:13.510760    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:17.389531 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.389507    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:41:17.409936 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.409870    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-workload-socket\") pod \"49674920-0231-4c9e-b0b7-8250892a22bd\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") "
Sep 09 14:41:17.409936 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.409903    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-istio-envoy\") pod \"49674920-0231-4c9e-b0b7-8250892a22bd\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") "
Sep 09 14:41:17.409936 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.409928    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49674920-0231-4c9e-b0b7-8250892a22bd-istio-token\") pod \"49674920-0231-4c9e-b0b7-8250892a22bd\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") "
Sep 09 14:41:17.410127 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.409979    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgqtc\" (UniqueName: \"kubernetes.io/projected/49674920-0231-4c9e-b0b7-8250892a22bd-kube-api-access-kgqtc\") pod \"49674920-0231-4c9e-b0b7-8250892a22bd\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") "
Sep 09 14:41:17.410127 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.410037    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-workload-certs\") pod \"49674920-0231-4c9e-b0b7-8250892a22bd\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") "
Sep 09 14:41:17.410127 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.410070    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49674920-0231-4c9e-b0b7-8250892a22bd-istio-podinfo\") pod \"49674920-0231-4c9e-b0b7-8250892a22bd\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") "
Sep 09 14:41:17.410127 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.410105    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49674920-0231-4c9e-b0b7-8250892a22bd-istiod-ca-cert\") pod \"49674920-0231-4c9e-b0b7-8250892a22bd\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") "
Sep 09 14:41:17.410365 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.410154    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-credential-socket\") pod \"49674920-0231-4c9e-b0b7-8250892a22bd\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") "
Sep 09 14:41:17.410365 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.410201    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-istio-data\") pod \"49674920-0231-4c9e-b0b7-8250892a22bd\" (UID: \"49674920-0231-4c9e-b0b7-8250892a22bd\") "
Sep 09 14:41:17.410365 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.410198    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "49674920-0231-4c9e-b0b7-8250892a22bd" (UID: "49674920-0231-4c9e-b0b7-8250892a22bd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:41:17.410530 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.410364    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "49674920-0231-4c9e-b0b7-8250892a22bd" (UID: "49674920-0231-4c9e-b0b7-8250892a22bd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:41:17.410530 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.410520    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "49674920-0231-4c9e-b0b7-8250892a22bd" (UID: "49674920-0231-4c9e-b0b7-8250892a22bd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:41:17.410638 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.410587    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-workload-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:41:17.410638 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.410608    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-workload-certs\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:41:17.410638 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.410583    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-istio-data" (OuterVolumeSpecName: "istio-data") pod "49674920-0231-4c9e-b0b7-8250892a22bd" (UID: "49674920-0231-4c9e-b0b7-8250892a22bd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:41:17.410813 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.410632    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49674920-0231-4c9e-b0b7-8250892a22bd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "49674920-0231-4c9e-b0b7-8250892a22bd" (UID: "49674920-0231-4c9e-b0b7-8250892a22bd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:41:17.412206 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.412164    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49674920-0231-4c9e-b0b7-8250892a22bd-istio-token" (OuterVolumeSpecName: "istio-token") pod "49674920-0231-4c9e-b0b7-8250892a22bd" (UID: "49674920-0231-4c9e-b0b7-8250892a22bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:41:17.412316 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.412220    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49674920-0231-4c9e-b0b7-8250892a22bd-kube-api-access-kgqtc" (OuterVolumeSpecName: "kube-api-access-kgqtc") pod "49674920-0231-4c9e-b0b7-8250892a22bd" (UID: "49674920-0231-4c9e-b0b7-8250892a22bd"). InnerVolumeSpecName "kube-api-access-kgqtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:41:17.412316 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.412253    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "49674920-0231-4c9e-b0b7-8250892a22bd" (UID: "49674920-0231-4c9e-b0b7-8250892a22bd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:41:17.412467 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.412447    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/49674920-0231-4c9e-b0b7-8250892a22bd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "49674920-0231-4c9e-b0b7-8250892a22bd" (UID: "49674920-0231-4c9e-b0b7-8250892a22bd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 14:41:17.511821 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.511789    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-istio-data\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:41:17.511821 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.511817    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-istio-envoy\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:41:17.511821 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.511827    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49674920-0231-4c9e-b0b7-8250892a22bd-istio-token\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:41:17.512052 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.511835    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgqtc\" (UniqueName: \"kubernetes.io/projected/49674920-0231-4c9e-b0b7-8250892a22bd-kube-api-access-kgqtc\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:41:17.512052 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.511844    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49674920-0231-4c9e-b0b7-8250892a22bd-istio-podinfo\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:41:17.512052 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.511851    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49674920-0231-4c9e-b0b7-8250892a22bd-istiod-ca-cert\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:41:17.512052 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.511860    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49674920-0231-4c9e-b0b7-8250892a22bd-credential-socket\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:41:17.695003 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.694914    2562 generic.go:356] "Generic (PLEG): container finished" podID="49674920-0231-4c9e-b0b7-8250892a22bd" containerID="b47641bceb1acebb08aa4db1144d3405c46b96b5f408b944bd39160433fafa16" exitCode=0
Sep 09 14:41:17.695003 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.694965    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"
Sep 09 14:41:17.695200 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.695004    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l" event={"ID":"49674920-0231-4c9e-b0b7-8250892a22bd","Type":"ContainerDied","Data":"b47641bceb1acebb08aa4db1144d3405c46b96b5f408b944bd39160433fafa16"}
Sep 09 14:41:17.695200 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.695061    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l" event={"ID":"49674920-0231-4c9e-b0b7-8250892a22bd","Type":"ContainerDied","Data":"0f920e88f0fcaeb4511d790b39594849d4980aa1e670b4636a8bcb62f78a7627"}
Sep 09 14:41:17.695200 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.695089    2562 scope.go:117] "RemoveContainer" containerID="b47641bceb1acebb08aa4db1144d3405c46b96b5f408b944bd39160433fafa16"
Sep 09 14:41:17.704487 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.704470    2562 scope.go:117] "RemoveContainer" containerID="cd0efc15bf63edd0bb8dc1f7272151a55a66523dfdc4e45d596da4a0f4157e68"
Sep 09 14:41:17.712510 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.712493    2562 scope.go:117] "RemoveContainer" containerID="b47641bceb1acebb08aa4db1144d3405c46b96b5f408b944bd39160433fafa16"
Sep 09 14:41:17.712800 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:41:17.712783    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b47641bceb1acebb08aa4db1144d3405c46b96b5f408b944bd39160433fafa16\": container with ID starting with b47641bceb1acebb08aa4db1144d3405c46b96b5f408b944bd39160433fafa16 not found: ID does not exist" containerID="b47641bceb1acebb08aa4db1144d3405c46b96b5f408b944bd39160433fafa16"
Sep 09 14:41:17.712842 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.712806    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b47641bceb1acebb08aa4db1144d3405c46b96b5f408b944bd39160433fafa16"} err="failed to get container status \"b47641bceb1acebb08aa4db1144d3405c46b96b5f408b944bd39160433fafa16\": rpc error: code = NotFound desc = could not find container \"b47641bceb1acebb08aa4db1144d3405c46b96b5f408b944bd39160433fafa16\": container with ID starting with b47641bceb1acebb08aa4db1144d3405c46b96b5f408b944bd39160433fafa16 not found: ID does not exist"
Sep 09 14:41:17.712842 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.712822    2562 scope.go:117] "RemoveContainer" containerID="cd0efc15bf63edd0bb8dc1f7272151a55a66523dfdc4e45d596da4a0f4157e68"
Sep 09 14:41:17.713073 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:41:17.713053    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd0efc15bf63edd0bb8dc1f7272151a55a66523dfdc4e45d596da4a0f4157e68\": container with ID starting with cd0efc15bf63edd0bb8dc1f7272151a55a66523dfdc4e45d596da4a0f4157e68 not found: ID does not exist" containerID="cd0efc15bf63edd0bb8dc1f7272151a55a66523dfdc4e45d596da4a0f4157e68"
Sep 09 14:41:17.713124 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.713080    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd0efc15bf63edd0bb8dc1f7272151a55a66523dfdc4e45d596da4a0f4157e68"} err="failed to get container status \"cd0efc15bf63edd0bb8dc1f7272151a55a66523dfdc4e45d596da4a0f4157e68\": rpc error: code = NotFound desc = could not find container \"cd0efc15bf63edd0bb8dc1f7272151a55a66523dfdc4e45d596da4a0f4157e68\": container with ID starting with cd0efc15bf63edd0bb8dc1f7272151a55a66523dfdc4e45d596da4a0f4157e68 not found: ID does not exist"
Sep 09 14:41:17.716377 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.716354    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"]
Sep 09 14:41:17.724321 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.724298    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-e565aa-openshift-default-66fdc6f99d-wnm4l"]
Sep 09 14:41:17.800037 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:17.800004    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49674920-0231-4c9e-b0b7-8250892a22bd" path="/var/lib/kubelet/pods/49674920-0231-4c9e-b0b7-8250892a22bd/volumes"
Sep 09 14:41:23.037127 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.037095    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c5e2d3-29816070-rnqnh"]
Sep 09 14:41:23.044873 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.044840    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-c5e2d3-29816070-rnqnh"]
Sep 09 14:41:23.048834 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.048807    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:23.069525 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.069494    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"]
Sep 09 14:41:23.069788 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.069762    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc" podUID="6f859cfb-6b52-4296-bd31-37f48dd28653" containerName="payload-processing" containerID="cri-o://55fb2dc970786b54c7e223c9d0e3f6a708fef73fc9708f234865ec282098b623" gracePeriod=30
Sep 09 14:41:23.147493 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.147459    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:23.247279 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.247231    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:23.335380 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.335355    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"
Sep 09 14:41:23.339535 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.339507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:23.456977 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.456944    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlch5\" (UniqueName: \"kubernetes.io/projected/6f859cfb-6b52-4296-bd31-37f48dd28653-kube-api-access-dlch5\") pod \"6f859cfb-6b52-4296-bd31-37f48dd28653\" (UID: \"6f859cfb-6b52-4296-bd31-37f48dd28653\") "
Sep 09 14:41:23.457180 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.457031    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f859cfb-6b52-4296-bd31-37f48dd28653-plugins-config-volume\") pod \"6f859cfb-6b52-4296-bd31-37f48dd28653\" (UID: \"6f859cfb-6b52-4296-bd31-37f48dd28653\") "
Sep 09 14:41:23.457428 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.457402    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f859cfb-6b52-4296-bd31-37f48dd28653-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6f859cfb-6b52-4296-bd31-37f48dd28653" (UID: "6f859cfb-6b52-4296-bd31-37f48dd28653"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 14:41:23.459042 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.459016    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f859cfb-6b52-4296-bd31-37f48dd28653-kube-api-access-dlch5" (OuterVolumeSpecName: "kube-api-access-dlch5") pod "6f859cfb-6b52-4296-bd31-37f48dd28653" (UID: "6f859cfb-6b52-4296-bd31-37f48dd28653"). InnerVolumeSpecName "kube-api-access-dlch5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:41:23.557982 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.557949    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f859cfb-6b52-4296-bd31-37f48dd28653-plugins-config-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:41:23.557982 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.557975    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlch5\" (UniqueName: \"kubernetes.io/projected/6f859cfb-6b52-4296-bd31-37f48dd28653-kube-api-access-dlch5\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:41:23.731484 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.731407    2562 generic.go:356] "Generic (PLEG): container finished" podID="6f859cfb-6b52-4296-bd31-37f48dd28653" containerID="55fb2dc970786b54c7e223c9d0e3f6a708fef73fc9708f234865ec282098b623" exitCode=0
Sep 09 14:41:23.731484 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.731449    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"
Sep 09 14:41:23.731663 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.731491    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc" event={"ID":"6f859cfb-6b52-4296-bd31-37f48dd28653","Type":"ContainerDied","Data":"55fb2dc970786b54c7e223c9d0e3f6a708fef73fc9708f234865ec282098b623"}
Sep 09 14:41:23.731663 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.731544    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc" event={"ID":"6f859cfb-6b52-4296-bd31-37f48dd28653","Type":"ContainerDied","Data":"1af88ae0af8328d928a1fab8cc18f67804a8592c18fc82086754e5536778e8d4"}
Sep 09 14:41:23.731663 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.731568    2562 scope.go:117] "RemoveContainer" containerID="55fb2dc970786b54c7e223c9d0e3f6a708fef73fc9708f234865ec282098b623"
Sep 09 14:41:23.741303 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.741273    2562 scope.go:117] "RemoveContainer" containerID="55fb2dc970786b54c7e223c9d0e3f6a708fef73fc9708f234865ec282098b623"
Sep 09 14:41:23.741580 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:41:23.741556    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55fb2dc970786b54c7e223c9d0e3f6a708fef73fc9708f234865ec282098b623\": container with ID starting with 55fb2dc970786b54c7e223c9d0e3f6a708fef73fc9708f234865ec282098b623 not found: ID does not exist" containerID="55fb2dc970786b54c7e223c9d0e3f6a708fef73fc9708f234865ec282098b623"
Sep 09 14:41:23.741656 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.741583    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55fb2dc970786b54c7e223c9d0e3f6a708fef73fc9708f234865ec282098b623"} err="failed to get container status \"55fb2dc970786b54c7e223c9d0e3f6a708fef73fc9708f234865ec282098b623\": rpc error: code = NotFound desc = could not find container \"55fb2dc970786b54c7e223c9d0e3f6a708fef73fc9708f234865ec282098b623\": container with ID starting with 55fb2dc970786b54c7e223c9d0e3f6a708fef73fc9708f234865ec282098b623 not found: ID does not exist"
Sep 09 14:41:23.746728 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.746706    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:23.752057 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.752032    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"]
Sep 09 14:41:23.758868 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.758846    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc"]
Sep 09 14:41:23.800251 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.800226    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f859cfb-6b52-4296-bd31-37f48dd28653" path="/var/lib/kubelet/pods/6f859cfb-6b52-4296-bd31-37f48dd28653/volumes"
Sep 09 14:41:23.800504 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:23.800493    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8182e43c-0b31-4c67-b02a-41f4cef27865" path="/var/lib/kubelet/pods/8182e43c-0b31-4c67-b02a-41f4cef27865/volumes"
Sep 09 14:41:24.248071 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:24.248019    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-c5e2d3-64d6684f7c-hl4pc" podUID="6f859cfb-6b52-4296-bd31-37f48dd28653" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.76:9004: i/o timeout"
Sep 09 14:41:28.139931 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:28.139887    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:28.238748 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:28.238715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:30.030996 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:30.030840    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:30.131119 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:30.131085    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:30.371985 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:30.371950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:41:33.935141 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:33.935110    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b7c47c475-6h2pb"]
Sep 09 14:41:33.935647 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:33.935339    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7b7c47c475-6h2pb" podUID="8b19ca93-87ab-4c75-abb5-dcd8f89650bf" containerName="manager" containerID="cri-o://4cbeb1e8a68576ec625c6051fb57f408c045c64fb18788c9469a6bb2923b5a58" gracePeriod=30
Sep 09 14:41:34.172082 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.172060    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b7c47c475-6h2pb"
Sep 09 14:41:34.253147 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.253078    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-webhook-cert\") pod \"8b19ca93-87ab-4c75-abb5-dcd8f89650bf\" (UID: \"8b19ca93-87ab-4c75-abb5-dcd8f89650bf\") "
Sep 09 14:41:34.253147 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.253131    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-metrics-certs\") pod \"8b19ca93-87ab-4c75-abb5-dcd8f89650bf\" (UID: \"8b19ca93-87ab-4c75-abb5-dcd8f89650bf\") "
Sep 09 14:41:34.253351 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.253194    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4hr5\" (UniqueName: \"kubernetes.io/projected/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-kube-api-access-w4hr5\") pod \"8b19ca93-87ab-4c75-abb5-dcd8f89650bf\" (UID: \"8b19ca93-87ab-4c75-abb5-dcd8f89650bf\") "
Sep 09 14:41:34.255123 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.255081    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8b19ca93-87ab-4c75-abb5-dcd8f89650bf" (UID: "8b19ca93-87ab-4c75-abb5-dcd8f89650bf"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:41:34.255123 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.255099    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-kube-api-access-w4hr5" (OuterVolumeSpecName: "kube-api-access-w4hr5") pod "8b19ca93-87ab-4c75-abb5-dcd8f89650bf" (UID: "8b19ca93-87ab-4c75-abb5-dcd8f89650bf"). InnerVolumeSpecName "kube-api-access-w4hr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:41:34.255303 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.255120    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8b19ca93-87ab-4c75-abb5-dcd8f89650bf" (UID: "8b19ca93-87ab-4c75-abb5-dcd8f89650bf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:41:34.353805 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.353775    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-webhook-cert\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:41:34.353948 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.353801    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-metrics-certs\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:41:34.353948 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.353824    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4hr5\" (UniqueName: \"kubernetes.io/projected/8b19ca93-87ab-4c75-abb5-dcd8f89650bf-kube-api-access-w4hr5\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:41:34.794882 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.794851    2562 generic.go:356] "Generic (PLEG): container finished" podID="8b19ca93-87ab-4c75-abb5-dcd8f89650bf" containerID="4cbeb1e8a68576ec625c6051fb57f408c045c64fb18788c9469a6bb2923b5a58" exitCode=0
Sep 09 14:41:34.795038 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.794893    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b7c47c475-6h2pb"
Sep 09 14:41:34.795038 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.794936    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b7c47c475-6h2pb" event={"ID":"8b19ca93-87ab-4c75-abb5-dcd8f89650bf","Type":"ContainerDied","Data":"4cbeb1e8a68576ec625c6051fb57f408c045c64fb18788c9469a6bb2923b5a58"}
Sep 09 14:41:34.795038 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.794974    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b7c47c475-6h2pb" event={"ID":"8b19ca93-87ab-4c75-abb5-dcd8f89650bf","Type":"ContainerDied","Data":"80799027e3d5b195ce23bd96bc69bc7bbdef3264fbb150e4ce1b9efaaa123268"}
Sep 09 14:41:34.795038 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.794996    2562 scope.go:117] "RemoveContainer" containerID="4cbeb1e8a68576ec625c6051fb57f408c045c64fb18788c9469a6bb2923b5a58"
Sep 09 14:41:34.811212 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.811190    2562 scope.go:117] "RemoveContainer" containerID="4cbeb1e8a68576ec625c6051fb57f408c045c64fb18788c9469a6bb2923b5a58"
Sep 09 14:41:34.811502 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:41:34.811481    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cbeb1e8a68576ec625c6051fb57f408c045c64fb18788c9469a6bb2923b5a58\": container with ID starting with 4cbeb1e8a68576ec625c6051fb57f408c045c64fb18788c9469a6bb2923b5a58 not found: ID does not exist" containerID="4cbeb1e8a68576ec625c6051fb57f408c045c64fb18788c9469a6bb2923b5a58"
Sep 09 14:41:34.811548 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.811510    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cbeb1e8a68576ec625c6051fb57f408c045c64fb18788c9469a6bb2923b5a58"} err="failed to get container status \"4cbeb1e8a68576ec625c6051fb57f408c045c64fb18788c9469a6bb2923b5a58\": rpc error: code = NotFound desc = could not find container \"4cbeb1e8a68576ec625c6051fb57f408c045c64fb18788c9469a6bb2923b5a58\": container with ID starting with 4cbeb1e8a68576ec625c6051fb57f408c045c64fb18788c9469a6bb2923b5a58 not found: ID does not exist"
Sep 09 14:41:34.820397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.820372    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b7c47c475-6h2pb"]
Sep 09 14:41:34.822091 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:34.822071    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7b7c47c475-6h2pb"]
Sep 09 14:41:35.802540 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:35.802505    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b19ca93-87ab-4c75-abb5-dcd8f89650bf" path="/var/lib/kubelet/pods/8b19ca93-87ab-4c75-abb5-dcd8f89650bf/volumes"
Sep 09 14:41:36.348608 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:36.348574    2562 scope.go:117] "RemoveContainer" containerID="919224175b5fe63bd904f77a8ecbe09ba12836eff1974bc4bc7d432df2df61c1"
Sep 09 14:41:36.357456 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:36.357435    2562 scope.go:117] "RemoveContainer" containerID="d4141c92414b2e1c49b8de9289bab8146b92ba730157af30e63fdb7a6f97e6a7"
Sep 09 14:41:36.365675 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:36.365647    2562 scope.go:117] "RemoveContainer" containerID="428d1d412300c8b5f50569165a2b6fa2e629aff152937bf77a414008209faa59"
Sep 09 14:41:36.373879 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:36.373860    2562 scope.go:117] "RemoveContainer" containerID="b96b4467dbaf9bb19f97e600a7427e083f1ac840f3c57ec3cc5396fbaf24b8ac"
Sep 09 14:41:36.381949 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:36.381928    2562 scope.go:117] "RemoveContainer" containerID="48ff73a9880717ebe236fac07c3f011eab477564245f309a2b17c25d26818b43"
Sep 09 14:41:41.257482 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:41:41.257439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:42:35.750402 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.750364    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b7c47c475-k7ckn"]
Sep 09 14:42:35.750880 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.750862    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7286859-9823-434e-8986-f4bb5ec86cee" containerName="payload-processing"
Sep 09 14:42:35.750925 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.750883    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7286859-9823-434e-8986-f4bb5ec86cee" containerName="payload-processing"
Sep 09 14:42:35.750925 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.750893    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97160bab-f356-4603-a0f8-c19a615123a8" containerName="istio-proxy"
Sep 09 14:42:35.750925 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.750898    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="97160bab-f356-4603-a0f8-c19a615123a8" containerName="istio-proxy"
Sep 09 14:42:35.750925 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.750913    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49674920-0231-4c9e-b0b7-8250892a22bd" containerName="istio-proxy"
Sep 09 14:42:35.750925 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.750920    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="49674920-0231-4c9e-b0b7-8250892a22bd" containerName="istio-proxy"
Sep 09 14:42:35.750925 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.750926    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="801dc825-08c9-46b0-acd5-dc37b906621d" containerName="revoke-keys"
Sep 09 14:42:35.751103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.750932    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="801dc825-08c9-46b0-acd5-dc37b906621d" containerName="revoke-keys"
Sep 09 14:42:35.751103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.750940    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b19ca93-87ab-4c75-abb5-dcd8f89650bf" containerName="manager"
Sep 09 14:42:35.751103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.750945    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b19ca93-87ab-4c75-abb5-dcd8f89650bf" containerName="manager"
Sep 09 14:42:35.751103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.750953    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49674920-0231-4c9e-b0b7-8250892a22bd" containerName="istio-proxy"
Sep 09 14:42:35.751103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.750959    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="49674920-0231-4c9e-b0b7-8250892a22bd" containerName="istio-proxy"
Sep 09 14:42:35.751103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.750971    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f859cfb-6b52-4296-bd31-37f48dd28653" containerName="payload-processing"
Sep 09 14:42:35.751103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.750977    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f859cfb-6b52-4296-bd31-37f48dd28653" containerName="payload-processing"
Sep 09 14:42:35.751103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.751030    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b19ca93-87ab-4c75-abb5-dcd8f89650bf" containerName="manager"
Sep 09 14:42:35.751103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.751039    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="801dc825-08c9-46b0-acd5-dc37b906621d" containerName="revoke-keys"
Sep 09 14:42:35.751103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.751045    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="97160bab-f356-4603-a0f8-c19a615123a8" containerName="istio-proxy"
Sep 09 14:42:35.751103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.751052    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="49674920-0231-4c9e-b0b7-8250892a22bd" containerName="istio-proxy"
Sep 09 14:42:35.751103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.751057    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f859cfb-6b52-4296-bd31-37f48dd28653" containerName="payload-processing"
Sep 09 14:42:35.751103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.751064    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7286859-9823-434e-8986-f4bb5ec86cee" containerName="payload-processing"
Sep 09 14:42:35.754047 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.754030    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b7c47c475-k7ckn"
Sep 09 14:42:35.756377 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.756352    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 14:42:35.756552 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.756531    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 14:42:35.757386 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.757369    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mb8vb\""
Sep 09 14:42:35.757463 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.757413    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 14:42:35.762206 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.762137    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b7c47c475-k7ckn"]
Sep 09 14:42:35.839551 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.839505    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cfvc\" (UniqueName: \"kubernetes.io/projected/d99ede34-e72b-4660-886c-8b615fd7d532-kube-api-access-2cfvc\") pod \"maas-controller-7b7c47c475-k7ckn\" (UID: \"d99ede34-e72b-4660-886c-8b615fd7d532\") " pod="opendatahub/maas-controller-7b7c47c475-k7ckn"
Sep 09 14:42:35.839551 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.839572    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d99ede34-e72b-4660-886c-8b615fd7d532-webhook-cert\") pod \"maas-controller-7b7c47c475-k7ckn\" (UID: \"d99ede34-e72b-4660-886c-8b615fd7d532\") " pod="opendatahub/maas-controller-7b7c47c475-k7ckn"
Sep 09 14:42:35.839774 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.839687    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d99ede34-e72b-4660-886c-8b615fd7d532-metrics-certs\") pod \"maas-controller-7b7c47c475-k7ckn\" (UID: \"d99ede34-e72b-4660-886c-8b615fd7d532\") " pod="opendatahub/maas-controller-7b7c47c475-k7ckn"
Sep 09 14:42:35.940570 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.940536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d99ede34-e72b-4660-886c-8b615fd7d532-metrics-certs\") pod \"maas-controller-7b7c47c475-k7ckn\" (UID: \"d99ede34-e72b-4660-886c-8b615fd7d532\") " pod="opendatahub/maas-controller-7b7c47c475-k7ckn"
Sep 09 14:42:35.940725 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.940608    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cfvc\" (UniqueName: \"kubernetes.io/projected/d99ede34-e72b-4660-886c-8b615fd7d532-kube-api-access-2cfvc\") pod \"maas-controller-7b7c47c475-k7ckn\" (UID: \"d99ede34-e72b-4660-886c-8b615fd7d532\") " pod="opendatahub/maas-controller-7b7c47c475-k7ckn"
Sep 09 14:42:35.940725 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.940645    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d99ede34-e72b-4660-886c-8b615fd7d532-webhook-cert\") pod \"maas-controller-7b7c47c475-k7ckn\" (UID: \"d99ede34-e72b-4660-886c-8b615fd7d532\") " pod="opendatahub/maas-controller-7b7c47c475-k7ckn"
Sep 09 14:42:35.943127 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.943096    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d99ede34-e72b-4660-886c-8b615fd7d532-metrics-certs\") pod \"maas-controller-7b7c47c475-k7ckn\" (UID: \"d99ede34-e72b-4660-886c-8b615fd7d532\") " pod="opendatahub/maas-controller-7b7c47c475-k7ckn"
Sep 09 14:42:35.943283 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.943100    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d99ede34-e72b-4660-886c-8b615fd7d532-webhook-cert\") pod \"maas-controller-7b7c47c475-k7ckn\" (UID: \"d99ede34-e72b-4660-886c-8b615fd7d532\") " pod="opendatahub/maas-controller-7b7c47c475-k7ckn"
Sep 09 14:42:35.949064 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:35.949040    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cfvc\" (UniqueName: \"kubernetes.io/projected/d99ede34-e72b-4660-886c-8b615fd7d532-kube-api-access-2cfvc\") pod \"maas-controller-7b7c47c475-k7ckn\" (UID: \"d99ede34-e72b-4660-886c-8b615fd7d532\") " pod="opendatahub/maas-controller-7b7c47c475-k7ckn"
Sep 09 14:42:36.065324 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:36.065292    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b7c47c475-k7ckn"
Sep 09 14:42:36.355532 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:36.355508    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b7c47c475-k7ckn"]
Sep 09 14:42:36.357206 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:42:36.357163    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd99ede34_e72b_4660_886c_8b615fd7d532.slice/crio-4846d7a67c4f90830d13c9efde1f32079069aa783f138ede19da3944a8e224d3 WatchSource:0}: Error finding container 4846d7a67c4f90830d13c9efde1f32079069aa783f138ede19da3944a8e224d3: Status 404 returned error can't find the container with id 4846d7a67c4f90830d13c9efde1f32079069aa783f138ede19da3944a8e224d3
Sep 09 14:42:36.358430 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:36.358411    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 14:42:36.439055 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:36.439022    2562 scope.go:117] "RemoveContainer" containerID="6684c84574ddb2035e5e206b0e989f14086f3d905c13060a207f37145b7be03b"
Sep 09 14:42:36.447412 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:36.447394    2562 scope.go:117] "RemoveContainer" containerID="0569eb759a4e71a43d76f39f52a3f258c43907eb0d808c1f7ed59ce21854e3e5"
Sep 09 14:42:37.141576 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:37.141529    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b7c47c475-k7ckn" event={"ID":"d99ede34-e72b-4660-886c-8b615fd7d532","Type":"ContainerStarted","Data":"eeea5829e8cb9169a7b142d616dd193e9c762d1759f66385809120c3ce4b325d"}
Sep 09 14:42:37.141956 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:37.141600    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b7c47c475-k7ckn" event={"ID":"d99ede34-e72b-4660-886c-8b615fd7d532","Type":"ContainerStarted","Data":"4846d7a67c4f90830d13c9efde1f32079069aa783f138ede19da3944a8e224d3"}
Sep 09 14:42:37.141956 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:37.141640    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b7c47c475-k7ckn"
Sep 09 14:42:37.159022 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:37.158965    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b7c47c475-k7ckn" podStartSLOduration=1.597568487 podStartE2EDuration="2.158944975s" totalImagesPullingTime="561.376488ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:42:37.158356712 +0000 UTC m=+1921.884896837" watchObservedRunningTime="2026-09-09 14:42:37.158944975 +0000 UTC m=+1921.885485073"
Sep 09 14:42:48.149553 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:48.149512    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b7c47c475-k7ckn"
Sep 09 14:42:54.189230 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:54.189188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:42:54.252730 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:54.252692    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:42:56.538944 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:56.538903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:42:57.370577 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:57.370541    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:42:57.482022 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:57.481975    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b7c47c475-k7ckn"]
Sep 09 14:42:57.482288 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:57.482257    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7b7c47c475-k7ckn" podUID="d99ede34-e72b-4660-886c-8b615fd7d532" containerName="manager" containerID="cri-o://eeea5829e8cb9169a7b142d616dd193e9c762d1759f66385809120c3ce4b325d" gracePeriod=30
Sep 09 14:42:57.730835 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:57.730809    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b7c47c475-k7ckn"
Sep 09 14:42:57.842118 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:57.842083    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d99ede34-e72b-4660-886c-8b615fd7d532-metrics-certs\") pod \"d99ede34-e72b-4660-886c-8b615fd7d532\" (UID: \"d99ede34-e72b-4660-886c-8b615fd7d532\") "
Sep 09 14:42:57.842118 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:57.842122    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d99ede34-e72b-4660-886c-8b615fd7d532-webhook-cert\") pod \"d99ede34-e72b-4660-886c-8b615fd7d532\" (UID: \"d99ede34-e72b-4660-886c-8b615fd7d532\") "
Sep 09 14:42:57.842381 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:57.842161    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cfvc\" (UniqueName: \"kubernetes.io/projected/d99ede34-e72b-4660-886c-8b615fd7d532-kube-api-access-2cfvc\") pod \"d99ede34-e72b-4660-886c-8b615fd7d532\" (UID: \"d99ede34-e72b-4660-886c-8b615fd7d532\") "
Sep 09 14:42:57.844263 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:57.844231    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d99ede34-e72b-4660-886c-8b615fd7d532-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d99ede34-e72b-4660-886c-8b615fd7d532" (UID: "d99ede34-e72b-4660-886c-8b615fd7d532"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:42:57.844393 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:57.844295    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d99ede34-e72b-4660-886c-8b615fd7d532-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d99ede34-e72b-4660-886c-8b615fd7d532" (UID: "d99ede34-e72b-4660-886c-8b615fd7d532"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 14:42:57.844393 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:57.844309    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d99ede34-e72b-4660-886c-8b615fd7d532-kube-api-access-2cfvc" (OuterVolumeSpecName: "kube-api-access-2cfvc") pod "d99ede34-e72b-4660-886c-8b615fd7d532" (UID: "d99ede34-e72b-4660-886c-8b615fd7d532"). InnerVolumeSpecName "kube-api-access-2cfvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:42:57.943748 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:57.943636    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d99ede34-e72b-4660-886c-8b615fd7d532-metrics-certs\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:42:57.943748 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:57.943667    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d99ede34-e72b-4660-886c-8b615fd7d532-webhook-cert\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:42:57.943748 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:57.943681    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cfvc\" (UniqueName: \"kubernetes.io/projected/d99ede34-e72b-4660-886c-8b615fd7d532-kube-api-access-2cfvc\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:42:58.253394 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:58.253296    2562 generic.go:356] "Generic (PLEG): container finished" podID="d99ede34-e72b-4660-886c-8b615fd7d532" containerID="eeea5829e8cb9169a7b142d616dd193e9c762d1759f66385809120c3ce4b325d" exitCode=0
Sep 09 14:42:58.253394 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:58.253357    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b7c47c475-k7ckn" event={"ID":"d99ede34-e72b-4660-886c-8b615fd7d532","Type":"ContainerDied","Data":"eeea5829e8cb9169a7b142d616dd193e9c762d1759f66385809120c3ce4b325d"}
Sep 09 14:42:58.253656 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:58.253406    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b7c47c475-k7ckn" event={"ID":"d99ede34-e72b-4660-886c-8b615fd7d532","Type":"ContainerDied","Data":"4846d7a67c4f90830d13c9efde1f32079069aa783f138ede19da3944a8e224d3"}
Sep 09 14:42:58.253656 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:58.253359    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b7c47c475-k7ckn"
Sep 09 14:42:58.253656 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:58.253434    2562 scope.go:117] "RemoveContainer" containerID="eeea5829e8cb9169a7b142d616dd193e9c762d1759f66385809120c3ce4b325d"
Sep 09 14:42:58.264947 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:58.264924    2562 scope.go:117] "RemoveContainer" containerID="eeea5829e8cb9169a7b142d616dd193e9c762d1759f66385809120c3ce4b325d"
Sep 09 14:42:58.265328 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:42:58.265291    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeea5829e8cb9169a7b142d616dd193e9c762d1759f66385809120c3ce4b325d\": container with ID starting with eeea5829e8cb9169a7b142d616dd193e9c762d1759f66385809120c3ce4b325d not found: ID does not exist" containerID="eeea5829e8cb9169a7b142d616dd193e9c762d1759f66385809120c3ce4b325d"
Sep 09 14:42:58.265417 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:58.265332    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeea5829e8cb9169a7b142d616dd193e9c762d1759f66385809120c3ce4b325d"} err="failed to get container status \"eeea5829e8cb9169a7b142d616dd193e9c762d1759f66385809120c3ce4b325d\": rpc error: code = NotFound desc = could not find container \"eeea5829e8cb9169a7b142d616dd193e9c762d1759f66385809120c3ce4b325d\": container with ID starting with eeea5829e8cb9169a7b142d616dd193e9c762d1759f66385809120c3ce4b325d not found: ID does not exist"
Sep 09 14:42:58.279376 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:58.279305    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b7c47c475-k7ckn"]
Sep 09 14:42:58.282435 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:58.282392    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7b7c47c475-k7ckn"]
Sep 09 14:42:58.976160 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:58.976126    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:42:59.113382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.113347    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b7c47c475-qh2ng"]
Sep 09 14:42:59.113725 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.113712    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99ede34-e72b-4660-886c-8b615fd7d532" containerName="manager"
Sep 09 14:42:59.113780 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.113726    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99ede34-e72b-4660-886c-8b615fd7d532" containerName="manager"
Sep 09 14:42:59.113813 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.113788    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="49674920-0231-4c9e-b0b7-8250892a22bd" containerName="istio-proxy"
Sep 09 14:42:59.113813 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.113796    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d99ede34-e72b-4660-886c-8b615fd7d532" containerName="manager"
Sep 09 14:42:59.118013 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.117996    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b7c47c475-qh2ng"
Sep 09 14:42:59.121103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.121073    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 14:42:59.121103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.121096    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mb8vb\""
Sep 09 14:42:59.121317 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.121113    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 14:42:59.121317 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.121219    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 14:42:59.128064 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.128041    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b7c47c475-qh2ng"]
Sep 09 14:42:59.256398 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.256299    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b468e852-a85d-404f-a2bf-d282c37a2194-metrics-certs\") pod \"maas-controller-7b7c47c475-qh2ng\" (UID: \"b468e852-a85d-404f-a2bf-d282c37a2194\") " pod="opendatahub/maas-controller-7b7c47c475-qh2ng"
Sep 09 14:42:59.256559 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.256423    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccr9x\" (UniqueName: \"kubernetes.io/projected/b468e852-a85d-404f-a2bf-d282c37a2194-kube-api-access-ccr9x\") pod \"maas-controller-7b7c47c475-qh2ng\" (UID: \"b468e852-a85d-404f-a2bf-d282c37a2194\") " pod="opendatahub/maas-controller-7b7c47c475-qh2ng"
Sep 09 14:42:59.256559 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.256454    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b468e852-a85d-404f-a2bf-d282c37a2194-webhook-cert\") pod \"maas-controller-7b7c47c475-qh2ng\" (UID: \"b468e852-a85d-404f-a2bf-d282c37a2194\") " pod="opendatahub/maas-controller-7b7c47c475-qh2ng"
Sep 09 14:42:59.357768 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.357732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b468e852-a85d-404f-a2bf-d282c37a2194-metrics-certs\") pod \"maas-controller-7b7c47c475-qh2ng\" (UID: \"b468e852-a85d-404f-a2bf-d282c37a2194\") " pod="opendatahub/maas-controller-7b7c47c475-qh2ng"
Sep 09 14:42:59.357922 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.357811    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccr9x\" (UniqueName: \"kubernetes.io/projected/b468e852-a85d-404f-a2bf-d282c37a2194-kube-api-access-ccr9x\") pod \"maas-controller-7b7c47c475-qh2ng\" (UID: \"b468e852-a85d-404f-a2bf-d282c37a2194\") " pod="opendatahub/maas-controller-7b7c47c475-qh2ng"
Sep 09 14:42:59.357922 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.357835    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b468e852-a85d-404f-a2bf-d282c37a2194-webhook-cert\") pod \"maas-controller-7b7c47c475-qh2ng\" (UID: \"b468e852-a85d-404f-a2bf-d282c37a2194\") " pod="opendatahub/maas-controller-7b7c47c475-qh2ng"
Sep 09 14:42:59.360279 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.360255    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b468e852-a85d-404f-a2bf-d282c37a2194-metrics-certs\") pod \"maas-controller-7b7c47c475-qh2ng\" (UID: \"b468e852-a85d-404f-a2bf-d282c37a2194\") " pod="opendatahub/maas-controller-7b7c47c475-qh2ng"
Sep 09 14:42:59.360405 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.360280    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b468e852-a85d-404f-a2bf-d282c37a2194-webhook-cert\") pod \"maas-controller-7b7c47c475-qh2ng\" (UID: \"b468e852-a85d-404f-a2bf-d282c37a2194\") " pod="opendatahub/maas-controller-7b7c47c475-qh2ng"
Sep 09 14:42:59.365798 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.365775    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccr9x\" (UniqueName: \"kubernetes.io/projected/b468e852-a85d-404f-a2bf-d282c37a2194-kube-api-access-ccr9x\") pod \"maas-controller-7b7c47c475-qh2ng\" (UID: \"b468e852-a85d-404f-a2bf-d282c37a2194\") " pod="opendatahub/maas-controller-7b7c47c475-qh2ng"
Sep 09 14:42:59.428669 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.428627    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b7c47c475-qh2ng"
Sep 09 14:42:59.700798 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.700771    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b7c47c475-qh2ng"]
Sep 09 14:42:59.703305 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:42:59.703277    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb468e852_a85d_404f_a2bf_d282c37a2194.slice/crio-e37c323a7212e478ff94036c9947a7c83897d24ac0de1f15f64f5fcbdd0ec9ac WatchSource:0}: Error finding container e37c323a7212e478ff94036c9947a7c83897d24ac0de1f15f64f5fcbdd0ec9ac: Status 404 returned error can't find the container with id e37c323a7212e478ff94036c9947a7c83897d24ac0de1f15f64f5fcbdd0ec9ac
Sep 09 14:42:59.799565 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:42:59.799524    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d99ede34-e72b-4660-886c-8b615fd7d532" path="/var/lib/kubelet/pods/d99ede34-e72b-4660-886c-8b615fd7d532/volumes"
Sep 09 14:43:00.266181 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:43:00.266138    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b7c47c475-qh2ng" event={"ID":"b468e852-a85d-404f-a2bf-d282c37a2194","Type":"ContainerStarted","Data":"e37c323a7212e478ff94036c9947a7c83897d24ac0de1f15f64f5fcbdd0ec9ac"}
Sep 09 14:43:03.283527 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:43:03.283484    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b7c47c475-qh2ng" event={"ID":"b468e852-a85d-404f-a2bf-d282c37a2194","Type":"ContainerStarted","Data":"504aa4d6487f9e278642a884a36bbbc041e37cc46ebdf17cf32ed0ef8f0f18bf"}
Sep 09 14:43:03.283930 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:43:03.283615    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b7c47c475-qh2ng"
Sep 09 14:43:03.300487 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:43:03.300387    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b7c47c475-qh2ng" podStartSLOduration=0.964656537 podStartE2EDuration="4.300371991s" totalImagesPullingTime="3.335715454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:43:03.299810016 +0000 UTC m=+1948.026350137" watchObservedRunningTime="2026-09-09 14:43:03.300371991 +0000 UTC m=+1948.026912092"
Sep 09 14:43:14.291032 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:43:14.291001    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b7c47c475-qh2ng"
Sep 09 14:43:36.469103 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:43:36.469016    2562 scope.go:117] "RemoveContainer" containerID="3f1069a444d37efeff5dcfe991366d4986bb85ddd5d0a68f6bd8703a43f186c1"
Sep 09 14:44:18.037093 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.037050    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"]
Sep 09 14:44:18.037629 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.037337    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr" podUID="b1ca0f14-cd6a-4b6a-85a7-275268321d77" containerName="manager" containerID="cri-o://621d0c3d4ba55c535aba733d32a02adbafdaa813a82fafdea03fe2f5ff4971ec" gracePeriod=10
Sep 09 14:44:18.283359 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.283328    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"
Sep 09 14:44:18.337846 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.337811    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1ca0f14-cd6a-4b6a-85a7-275268321d77-extensions-socket-volume\") pod \"b1ca0f14-cd6a-4b6a-85a7-275268321d77\" (UID: \"b1ca0f14-cd6a-4b6a-85a7-275268321d77\") "
Sep 09 14:44:18.338010 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.337876    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nszp8\" (UniqueName: \"kubernetes.io/projected/b1ca0f14-cd6a-4b6a-85a7-275268321d77-kube-api-access-nszp8\") pod \"b1ca0f14-cd6a-4b6a-85a7-275268321d77\" (UID: \"b1ca0f14-cd6a-4b6a-85a7-275268321d77\") "
Sep 09 14:44:18.338260 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.338232    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1ca0f14-cd6a-4b6a-85a7-275268321d77-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b1ca0f14-cd6a-4b6a-85a7-275268321d77" (UID: "b1ca0f14-cd6a-4b6a-85a7-275268321d77"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 14:44:18.339857 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.339831    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1ca0f14-cd6a-4b6a-85a7-275268321d77-kube-api-access-nszp8" (OuterVolumeSpecName: "kube-api-access-nszp8") pod "b1ca0f14-cd6a-4b6a-85a7-275268321d77" (UID: "b1ca0f14-cd6a-4b6a-85a7-275268321d77"). InnerVolumeSpecName "kube-api-access-nszp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 14:44:18.439255 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.439221    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1ca0f14-cd6a-4b6a-85a7-275268321d77-extensions-socket-volume\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:44:18.439255 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.439249    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nszp8\" (UniqueName: \"kubernetes.io/projected/b1ca0f14-cd6a-4b6a-85a7-275268321d77-kube-api-access-nszp8\") on node \"ip-10-0-140-6.ec2.internal\" DevicePath \"\""
Sep 09 14:44:18.684119 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.684027    2562 generic.go:356] "Generic (PLEG): container finished" podID="b1ca0f14-cd6a-4b6a-85a7-275268321d77" containerID="621d0c3d4ba55c535aba733d32a02adbafdaa813a82fafdea03fe2f5ff4971ec" exitCode=0
Sep 09 14:44:18.684119 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.684079    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"
Sep 09 14:44:18.684119 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.684104    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr" event={"ID":"b1ca0f14-cd6a-4b6a-85a7-275268321d77","Type":"ContainerDied","Data":"621d0c3d4ba55c535aba733d32a02adbafdaa813a82fafdea03fe2f5ff4971ec"}
Sep 09 14:44:18.684510 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.684220    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr" event={"ID":"b1ca0f14-cd6a-4b6a-85a7-275268321d77","Type":"ContainerDied","Data":"97a42f4dda08931258f10d56606e7ab16feefc613bb38bdb93e48f17ee19c0f2"}
Sep 09 14:44:18.684510 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.684253    2562 scope.go:117] "RemoveContainer" containerID="621d0c3d4ba55c535aba733d32a02adbafdaa813a82fafdea03fe2f5ff4971ec"
Sep 09 14:44:18.698534 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.698513    2562 scope.go:117] "RemoveContainer" containerID="621d0c3d4ba55c535aba733d32a02adbafdaa813a82fafdea03fe2f5ff4971ec"
Sep 09 14:44:18.698847 ip-10-0-140-6 kubenswrapper[2562]: E0909 14:44:18.698827    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"621d0c3d4ba55c535aba733d32a02adbafdaa813a82fafdea03fe2f5ff4971ec\": container with ID starting with 621d0c3d4ba55c535aba733d32a02adbafdaa813a82fafdea03fe2f5ff4971ec not found: ID does not exist" containerID="621d0c3d4ba55c535aba733d32a02adbafdaa813a82fafdea03fe2f5ff4971ec"
Sep 09 14:44:18.698895 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.698857    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"621d0c3d4ba55c535aba733d32a02adbafdaa813a82fafdea03fe2f5ff4971ec"} err="failed to get container status \"621d0c3d4ba55c535aba733d32a02adbafdaa813a82fafdea03fe2f5ff4971ec\": rpc error: code = NotFound desc = could not find container \"621d0c3d4ba55c535aba733d32a02adbafdaa813a82fafdea03fe2f5ff4971ec\": container with ID starting with 621d0c3d4ba55c535aba733d32a02adbafdaa813a82fafdea03fe2f5ff4971ec not found: ID does not exist"
Sep 09 14:44:18.706031 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.706005    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"]
Sep 09 14:44:18.709099 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:18.709074    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nt4jr"]
Sep 09 14:44:19.799903 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:19.799871    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1ca0f14-cd6a-4b6a-85a7-275268321d77" path="/var/lib/kubelet/pods/b1ca0f14-cd6a-4b6a-85a7-275268321d77/volumes"
Sep 09 14:44:27.760353 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:44:27.760315    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:45:00.144990 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:00.144909    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816085-lzvzn"]
Sep 09 14:45:00.145488 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:00.145338    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1ca0f14-cd6a-4b6a-85a7-275268321d77" containerName="manager"
Sep 09 14:45:00.145488 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:00.145353    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1ca0f14-cd6a-4b6a-85a7-275268321d77" containerName="manager"
Sep 09 14:45:00.145488 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:00.145429    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1ca0f14-cd6a-4b6a-85a7-275268321d77" containerName="manager"
Sep 09 14:45:00.148450 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:00.148433    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816085-lzvzn"
Sep 09 14:45:00.153690 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:00.153665    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-znjjn\""
Sep 09 14:45:00.159261 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:00.159237    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816085-lzvzn"]
Sep 09 14:45:00.159692 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:00.159675    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816085-lzvzn"
Sep 09 14:45:00.429625 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:00.429601    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816085-lzvzn"]
Sep 09 14:45:00.431785 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:45:00.431759    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70874583_b55b_4625_96f5_e4dd5fa26931.slice/crio-31668924d763f4a6964b068d437cc28c4c2144350c2d0753c77f7de994582a97 WatchSource:0}: Error finding container 31668924d763f4a6964b068d437cc28c4c2144350c2d0753c77f7de994582a97: Status 404 returned error can't find the container with id 31668924d763f4a6964b068d437cc28c4c2144350c2d0753c77f7de994582a97
Sep 09 14:45:00.894038 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:00.894003    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816085-lzvzn" event={"ID":"70874583-b55b-4625-96f5-e4dd5fa26931","Type":"ContainerStarted","Data":"bf8b1e6e5dcd2b0582a8cadbba0cfd0ec977dbdf35562084fe96d7bb9f1f5961"}
Sep 09 14:45:00.894228 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:00.894056    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816085-lzvzn" event={"ID":"70874583-b55b-4625-96f5-e4dd5fa26931","Type":"ContainerStarted","Data":"31668924d763f4a6964b068d437cc28c4c2144350c2d0753c77f7de994582a97"}
Sep 09 14:45:00.909237 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:00.909192    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816085-lzvzn" podStartSLOduration=0.909153807 podStartE2EDuration="909.153807ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:45:00.907812744 +0000 UTC m=+2065.634352875" watchObservedRunningTime="2026-09-09 14:45:00.909153807 +0000 UTC m=+2065.635693908"
Sep 09 14:45:01.900105 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:01.900067    2562 generic.go:356] "Generic (PLEG): container finished" podID="70874583-b55b-4625-96f5-e4dd5fa26931" containerID="bf8b1e6e5dcd2b0582a8cadbba0cfd0ec977dbdf35562084fe96d7bb9f1f5961" exitCode=0
Sep 09 14:45:01.900509 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:01.900156    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816085-lzvzn" event={"ID":"70874583-b55b-4625-96f5-e4dd5fa26931","Type":"ContainerDied","Data":"bf8b1e6e5dcd2b0582a8cadbba0cfd0ec977dbdf35562084fe96d7bb9f1f5961"}
Sep 09 14:45:03.035666 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:03.035641    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816085-lzvzn"
Sep 09 14:45:03.912004 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:03.911973    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816085-lzvzn"
Sep 09 14:45:03.912200 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:03.912017    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816085-lzvzn" event={"ID":"70874583-b55b-4625-96f5-e4dd5fa26931","Type":"ContainerDied","Data":"31668924d763f4a6964b068d437cc28c4c2144350c2d0753c77f7de994582a97"}
Sep 09 14:45:03.912200 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:03.912072    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31668924d763f4a6964b068d437cc28c4c2144350c2d0753c77f7de994582a97"
Sep 09 14:45:10.111417 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:10.111385    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:45:18.783197 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:18.783147    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kx2tc"]
Sep 09 14:45:18.783582 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:18.783548    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70874583-b55b-4625-96f5-e4dd5fa26931" containerName="cleanup"
Sep 09 14:45:18.783582 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:18.783559    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="70874583-b55b-4625-96f5-e4dd5fa26931" containerName="cleanup"
Sep 09 14:45:18.783652 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:18.783629    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="70874583-b55b-4625-96f5-e4dd5fa26931" containerName="cleanup"
Sep 09 14:45:18.786731 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:18.786716    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kx2tc"
Sep 09 14:45:18.789009 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:18.788982    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-w9wb4\""
Sep 09 14:45:18.799950 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:18.799925    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kx2tc"]
Sep 09 14:45:18.851760 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:18.851729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4b0ee57-7f6c-417b-8594-3c7e0b8a4e8f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kx2tc\" (UID: \"e4b0ee57-7f6c-417b-8594-3c7e0b8a4e8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kx2tc"
Sep 09 14:45:18.851914 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:18.851778    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bph2t\" (UniqueName: \"kubernetes.io/projected/e4b0ee57-7f6c-417b-8594-3c7e0b8a4e8f-kube-api-access-bph2t\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kx2tc\" (UID: \"e4b0ee57-7f6c-417b-8594-3c7e0b8a4e8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kx2tc"
Sep 09 14:45:18.953254 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:18.953217    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bph2t\" (UniqueName: \"kubernetes.io/projected/e4b0ee57-7f6c-417b-8594-3c7e0b8a4e8f-kube-api-access-bph2t\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kx2tc\" (UID: \"e4b0ee57-7f6c-417b-8594-3c7e0b8a4e8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kx2tc"
Sep 09 14:45:18.953419 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:18.953298    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4b0ee57-7f6c-417b-8594-3c7e0b8a4e8f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kx2tc\" (UID: \"e4b0ee57-7f6c-417b-8594-3c7e0b8a4e8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kx2tc"
Sep 09 14:45:18.953640 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:18.953614    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4b0ee57-7f6c-417b-8594-3c7e0b8a4e8f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kx2tc\" (UID: \"e4b0ee57-7f6c-417b-8594-3c7e0b8a4e8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kx2tc"
Sep 09 14:45:18.961179 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:18.961147    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bph2t\" (UniqueName: \"kubernetes.io/projected/e4b0ee57-7f6c-417b-8594-3c7e0b8a4e8f-kube-api-access-bph2t\") pod \"kuadrant-operator-controller-manager-5769f99d9f-kx2tc\" (UID: \"e4b0ee57-7f6c-417b-8594-3c7e0b8a4e8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kx2tc"
Sep 09 14:45:19.096193 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:19.096138    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kx2tc"
Sep 09 14:45:19.373111 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:19.373082    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kx2tc"]
Sep 09 14:45:19.375020 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:45:19.374996    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b0ee57_7f6c_417b_8594_3c7e0b8a4e8f.slice/crio-85995b60de02dc9f4594128c3a4b12360cb7f98b942f2a66fea39ff6956e89c6 WatchSource:0}: Error finding container 85995b60de02dc9f4594128c3a4b12360cb7f98b942f2a66fea39ff6956e89c6: Status 404 returned error can't find the container with id 85995b60de02dc9f4594128c3a4b12360cb7f98b942f2a66fea39ff6956e89c6
Sep 09 14:45:19.992671 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:19.992634    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kx2tc" event={"ID":"e4b0ee57-7f6c-417b-8594-3c7e0b8a4e8f","Type":"ContainerStarted","Data":"5d26beb0646340de9c057a45a299e2b6b215462973274448662aa1b98ff9746a"}
Sep 09 14:45:19.993042 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:19.992700    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kx2tc" event={"ID":"e4b0ee57-7f6c-417b-8594-3c7e0b8a4e8f","Type":"ContainerStarted","Data":"85995b60de02dc9f4594128c3a4b12360cb7f98b942f2a66fea39ff6956e89c6"}
Sep 09 14:45:19.993042 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:19.992753    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kx2tc"
Sep 09 14:45:20.035035 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:20.034975    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kx2tc" podStartSLOduration=2.034957248 podStartE2EDuration="2.034957248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:45:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:45:20.032061019 +0000 UTC m=+2084.758601119" watchObservedRunningTime="2026-09-09 14:45:20.034957248 +0000 UTC m=+2084.761497350"
Sep 09 14:45:31.000397 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:31.000365    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-kx2tc"
Sep 09 14:45:35.983866 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:35.983838    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:45:35.991165 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:35.991140    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:45:36.503969 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:36.503934    2562 scope.go:117] "RemoveContainer" containerID="a82e02e217e0386cc4e75d9ad3d7533392e9304e8f8ce81593fcb8260f92970e"
Sep 09 14:45:36.514382 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:36.514359    2562 scope.go:117] "RemoveContainer" containerID="02ecf12fa866709babd81becec1ea05c1061d79029ecf8bc5142c62c4c9eda38"
Sep 09 14:45:52.720811 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:45:52.720770    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:46:02.721155 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:46:02.721112    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:46:10.238662 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:46:10.238612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:46:48.013500 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:46:48.013418    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:46:52.173484 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:46:52.173445    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:46:53.685814 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:46:53.685775    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:47:36.544256 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:36.544218    2562 scope.go:117] "RemoveContainer" containerID="87671a64c44d513b04cafefcb9481ce638917aaf329dfda960e87bff937c5389"
Sep 09 14:47:36.552342 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:36.552323    2562 scope.go:117] "RemoveContainer" containerID="98cea834c620c3ae2f114c7adb3903f4ba0687df7c21e2e2fe2aa01161549b6b"
Sep 09 14:47:36.780798 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:36.780768    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56f77dbb54-2rzr4_bd471663-9bbd-4225-9f6a-7112a569384e/authorino/0.log"
Sep 09 14:47:42.211873 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:42.211838    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-v9xsl_0227f62c-bc6c-4b9e-b528-20b855650eb0/manager/0.log"
Sep 09 14:47:42.331970 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:42.331947    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-27sgh_f5df07d3-a53d-4f55-bc5f-071b93d4ed9d/manager/0.log"
Sep 09 14:47:42.487264 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:42.487191    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b7c47c475-qh2ng_b468e852-a85d-404f-a2bf-d282c37a2194/manager/0.log"
Sep 09 14:47:42.607052 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:42.607019    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-9jrwg_3aa94433-337d-43ac-87c4-0b6474d25b18/server/0.log"
Sep 09 14:47:42.868370 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:42.868340    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-686db84dc8-8wff4_1215e5a3-04eb-4bbc-9dd9-c17fc34257e3/copy-manifests/0.log"
Sep 09 14:47:42.875077 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:42.875047    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-686db84dc8-8wff4_1215e5a3-04eb-4bbc-9dd9-c17fc34257e3/manager/0.log"
Sep 09 14:47:43.737741 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:43.737714    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29816070-wp8zs_fc648229-a694-4547-a410-a81940b9f1de/cleanup/0.log"
Sep 09 14:47:43.857934 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:43.857908    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29816085-lzvzn_70874583-b55b-4625-96f5-e4dd5fa26931/cleanup/0.log"
Sep 09 14:47:44.773085 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:44.773046    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56f77dbb54-2rzr4_bd471663-9bbd-4225-9f6a-7112a569384e/authorino/0.log"
Sep 09 14:47:45.265720 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:45.265688    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-kx2tc_e4b0ee57-7f6c-417b-8594-3c7e0b8a4e8f/manager/0.log"
Sep 09 14:47:45.841588 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:45.841553    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87_6ae263f7-ae5b-40f4-a969-b94f1127a452/istio-proxy/0.log"
Sep 09 14:47:46.317546 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:46.317517    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hsjqp_dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9/istio-proxy/1.log"
Sep 09 14:47:46.564360 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:46.564324    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sslq8_add57211-b174-481b-b9b7-d75980ab301c/payload-processing/0.log"
Sep 09 14:47:46.676338 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:46.676274    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cd68d9db8-hbl96_755fce16-cc81-4661-8e58-2fee5c71966f/router/0.log"
Sep 09 14:47:47.016645 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:47.016571    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-wplnm_611e687e-e928-4ab3-b534-7a53568c38db/main/0.log"
Sep 09 14:47:53.375246 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:53.375211    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tq4f9/must-gather-j9frt"]
Sep 09 14:47:53.378825 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:53.378802    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tq4f9/must-gather-j9frt"
Sep 09 14:47:53.381259 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:53.381232    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tq4f9\"/\"default-dockercfg-4q82f\""
Sep 09 14:47:53.381963 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:53.381941    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tq4f9\"/\"openshift-service-ca.crt\""
Sep 09 14:47:53.381963 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:53.381958    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tq4f9\"/\"kube-root-ca.crt\""
Sep 09 14:47:53.387432 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:53.387410    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tq4f9/must-gather-j9frt"]
Sep 09 14:47:53.475277 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:53.475253    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj5zx\" (UniqueName: \"kubernetes.io/projected/5394e0f1-65ec-4bdb-ae79-5717317136df-kube-api-access-tj5zx\") pod \"must-gather-j9frt\" (UID: \"5394e0f1-65ec-4bdb-ae79-5717317136df\") " pod="openshift-must-gather-tq4f9/must-gather-j9frt"
Sep 09 14:47:53.475391 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:53.475283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5394e0f1-65ec-4bdb-ae79-5717317136df-must-gather-output\") pod \"must-gather-j9frt\" (UID: \"5394e0f1-65ec-4bdb-ae79-5717317136df\") " pod="openshift-must-gather-tq4f9/must-gather-j9frt"
Sep 09 14:47:53.576131 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:53.576104    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj5zx\" (UniqueName: \"kubernetes.io/projected/5394e0f1-65ec-4bdb-ae79-5717317136df-kube-api-access-tj5zx\") pod \"must-gather-j9frt\" (UID: \"5394e0f1-65ec-4bdb-ae79-5717317136df\") " pod="openshift-must-gather-tq4f9/must-gather-j9frt"
Sep 09 14:47:53.576271 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:53.576135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5394e0f1-65ec-4bdb-ae79-5717317136df-must-gather-output\") pod \"must-gather-j9frt\" (UID: \"5394e0f1-65ec-4bdb-ae79-5717317136df\") " pod="openshift-must-gather-tq4f9/must-gather-j9frt"
Sep 09 14:47:53.576479 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:53.576460    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5394e0f1-65ec-4bdb-ae79-5717317136df-must-gather-output\") pod \"must-gather-j9frt\" (UID: \"5394e0f1-65ec-4bdb-ae79-5717317136df\") " pod="openshift-must-gather-tq4f9/must-gather-j9frt"
Sep 09 14:47:53.591878 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:53.591857    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj5zx\" (UniqueName: \"kubernetes.io/projected/5394e0f1-65ec-4bdb-ae79-5717317136df-kube-api-access-tj5zx\") pod \"must-gather-j9frt\" (UID: \"5394e0f1-65ec-4bdb-ae79-5717317136df\") " pod="openshift-must-gather-tq4f9/must-gather-j9frt"
Sep 09 14:47:53.688924 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:53.688876    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tq4f9/must-gather-j9frt"
Sep 09 14:47:53.961992 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:53.961966    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tq4f9/must-gather-j9frt"]
Sep 09 14:47:53.963679 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:47:53.963654    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5394e0f1_65ec_4bdb_ae79_5717317136df.slice/crio-48fdd63b06c90d37415d0c8f79d3e2577b983b8435e97cd02f06450c7ba815d2 WatchSource:0}: Error finding container 48fdd63b06c90d37415d0c8f79d3e2577b983b8435e97cd02f06450c7ba815d2: Status 404 returned error can't find the container with id 48fdd63b06c90d37415d0c8f79d3e2577b983b8435e97cd02f06450c7ba815d2
Sep 09 14:47:53.968735 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:53.968712    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 14:47:54.605157 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:54.605120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:47:54.706000 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:54.705959    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log" limit=1024
Sep 09 14:47:54.799014 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:54.798990    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tq4f9/must-gather-j9frt" event={"ID":"5394e0f1-65ec-4bdb-ae79-5717317136df","Type":"ContainerStarted","Data":"48fdd63b06c90d37415d0c8f79d3e2577b983b8435e97cd02f06450c7ba815d2"}
Sep 09 14:47:55.808049 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:55.808012    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tq4f9/must-gather-j9frt" event={"ID":"5394e0f1-65ec-4bdb-ae79-5717317136df","Type":"ContainerStarted","Data":"b9489807d719f5e9710a88fc38323570e1adb8bd42594b611ab443c7932cae7e"}
Sep 09 14:47:55.808520 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:55.808057    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tq4f9/must-gather-j9frt" event={"ID":"5394e0f1-65ec-4bdb-ae79-5717317136df","Type":"ContainerStarted","Data":"dcf812f6f5d32d36a367a6e42bcbd7c400b7199ee13d929ef633a969e7d63888"}
Sep 09 14:47:55.825367 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:55.825313    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tq4f9/must-gather-j9frt" podStartSLOduration=2.005241285 podStartE2EDuration="2.825293441s" totalImagesPullingTime="820.052156ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 14:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:47:55.825004509 +0000 UTC m=+2240.551544611" watchObservedRunningTime="2026-09-09 14:47:55.825293441 +0000 UTC m=+2240.551833542"
Sep 09 14:47:56.343804 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:56.343767    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-klmjq_b1c849d7-1e16-4ef7-84e0-9e4236a59980/global-pull-secret-syncer/0.log"
Sep 09 14:47:56.392886 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:56.392856    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jjjx6_2c3ec5b7-c4fb-40cb-9d26-06234099fb6b/konnectivity-agent/0.log"
Sep 09 14:47:56.502555 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:47:56.502520    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-6.ec2.internal_9978dbafece0809c5d3fcebbfbd299df/haproxy/0.log"
Sep 09 14:48:01.484189 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:01.483530    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56f77dbb54-2rzr4_bd471663-9bbd-4225-9f6a-7112a569384e/authorino/0.log"
Sep 09 14:48:01.653604 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:01.653560    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-kx2tc_e4b0ee57-7f6c-417b-8594-3c7e0b8a4e8f/manager/0.log"
Sep 09 14:48:03.582988 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:03.582952    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-dlzvp_78d7aa56-30f6-44a0-9fb2-c37ecc381b62/cluster-monitoring-operator/0.log"
Sep 09 14:48:03.748427 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:03.748395    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8hzwz_d3529c80-4d1c-44c0-8718-99a4fa84694c/node-exporter/0.log"
Sep 09 14:48:03.766548 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:03.766517    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8hzwz_d3529c80-4d1c-44c0-8718-99a4fa84694c/kube-rbac-proxy/0.log"
Sep 09 14:48:03.788200 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:03.788158    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8hzwz_d3529c80-4d1c-44c0-8718-99a4fa84694c/init-textfile/0.log"
Sep 09 14:48:04.223761 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:04.223727    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-7c9ww_8a154390-4edb-4199-9e71-aca0d4b79a92/prometheus-operator-admission-webhook/0.log"
Sep 09 14:48:05.853243 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:05.853203    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"]
Sep 09 14:48:05.866664 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:05.866601    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"]
Sep 09 14:48:05.866897 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:05.866777    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.014918 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.014881    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee39f7ae-b773-4e20-b680-6fff730ac6eb-lib-modules\") pod \"perf-node-gather-daemonset-4rd86\" (UID: \"ee39f7ae-b773-4e20-b680-6fff730ac6eb\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.015234 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.015210    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwxlj\" (UniqueName: \"kubernetes.io/projected/ee39f7ae-b773-4e20-b680-6fff730ac6eb-kube-api-access-rwxlj\") pod \"perf-node-gather-daemonset-4rd86\" (UID: \"ee39f7ae-b773-4e20-b680-6fff730ac6eb\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.015421 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.015405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ee39f7ae-b773-4e20-b680-6fff730ac6eb-podres\") pod \"perf-node-gather-daemonset-4rd86\" (UID: \"ee39f7ae-b773-4e20-b680-6fff730ac6eb\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.015584 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.015570    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee39f7ae-b773-4e20-b680-6fff730ac6eb-sys\") pod \"perf-node-gather-daemonset-4rd86\" (UID: \"ee39f7ae-b773-4e20-b680-6fff730ac6eb\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.015702 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.015690    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ee39f7ae-b773-4e20-b680-6fff730ac6eb-proc\") pod \"perf-node-gather-daemonset-4rd86\" (UID: \"ee39f7ae-b773-4e20-b680-6fff730ac6eb\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.117326 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.117229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ee39f7ae-b773-4e20-b680-6fff730ac6eb-podres\") pod \"perf-node-gather-daemonset-4rd86\" (UID: \"ee39f7ae-b773-4e20-b680-6fff730ac6eb\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.117326 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.117312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee39f7ae-b773-4e20-b680-6fff730ac6eb-sys\") pod \"perf-node-gather-daemonset-4rd86\" (UID: \"ee39f7ae-b773-4e20-b680-6fff730ac6eb\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.117570 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.117341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ee39f7ae-b773-4e20-b680-6fff730ac6eb-proc\") pod \"perf-node-gather-daemonset-4rd86\" (UID: \"ee39f7ae-b773-4e20-b680-6fff730ac6eb\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.117570 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.117415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee39f7ae-b773-4e20-b680-6fff730ac6eb-lib-modules\") pod \"perf-node-gather-daemonset-4rd86\" (UID: \"ee39f7ae-b773-4e20-b680-6fff730ac6eb\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.117570 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.117474    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwxlj\" (UniqueName: \"kubernetes.io/projected/ee39f7ae-b773-4e20-b680-6fff730ac6eb-kube-api-access-rwxlj\") pod \"perf-node-gather-daemonset-4rd86\" (UID: \"ee39f7ae-b773-4e20-b680-6fff730ac6eb\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.117985 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.117955    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ee39f7ae-b773-4e20-b680-6fff730ac6eb-podres\") pod \"perf-node-gather-daemonset-4rd86\" (UID: \"ee39f7ae-b773-4e20-b680-6fff730ac6eb\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.118094 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.118030    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ee39f7ae-b773-4e20-b680-6fff730ac6eb-sys\") pod \"perf-node-gather-daemonset-4rd86\" (UID: \"ee39f7ae-b773-4e20-b680-6fff730ac6eb\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.118094 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.118077    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ee39f7ae-b773-4e20-b680-6fff730ac6eb-proc\") pod \"perf-node-gather-daemonset-4rd86\" (UID: \"ee39f7ae-b773-4e20-b680-6fff730ac6eb\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.118238 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.118190    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ee39f7ae-b773-4e20-b680-6fff730ac6eb-lib-modules\") pod \"perf-node-gather-daemonset-4rd86\" (UID: \"ee39f7ae-b773-4e20-b680-6fff730ac6eb\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.125549 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.125517    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwxlj\" (UniqueName: \"kubernetes.io/projected/ee39f7ae-b773-4e20-b680-6fff730ac6eb-kube-api-access-rwxlj\") pod \"perf-node-gather-daemonset-4rd86\" (UID: \"ee39f7ae-b773-4e20-b680-6fff730ac6eb\") " pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.186775 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.186744    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/1.log"
Sep 09 14:48:06.192944 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.192900    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.195771 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.195737    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-wbt89_6ee3ce3e-01df-4ee9-a69c-0a3c709a8117/console-operator/2.log"
Sep 09 14:48:06.482544 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.482513    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"]
Sep 09 14:48:06.484648 ip-10-0-140-6 kubenswrapper[2562]: W0909 14:48:06.484620    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podee39f7ae_b773_4e20_b680_6fff730ac6eb.slice/crio-b215ce5decf40cfd8402d0397db32fd55275f99a50e1d524104ef8ae2c20d7d4 WatchSource:0}: Error finding container b215ce5decf40cfd8402d0397db32fd55275f99a50e1d524104ef8ae2c20d7d4: Status 404 returned error can't find the container with id b215ce5decf40cfd8402d0397db32fd55275f99a50e1d524104ef8ae2c20d7d4
Sep 09 14:48:06.771914 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.771838    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-v9mkl_3dd40e10-d3bd-44fd-abc3-8cf1210acd7f/download-server/0.log"
Sep 09 14:48:06.895542 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.895501    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86" event={"ID":"ee39f7ae-b773-4e20-b680-6fff730ac6eb","Type":"ContainerStarted","Data":"7ae4dcb8203a9ccfa3844bae0533a94536bf8ce97dc7ee402b8764109b6a9625"}
Sep 09 14:48:06.896819 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.896795    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:06.897021 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.897002    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86" event={"ID":"ee39f7ae-b773-4e20-b680-6fff730ac6eb","Type":"ContainerStarted","Data":"b215ce5decf40cfd8402d0397db32fd55275f99a50e1d524104ef8ae2c20d7d4"}
Sep 09 14:48:06.913923 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:06.913864    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86" podStartSLOduration=1.9138466200000002 podStartE2EDuration="1.91384662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 14:48:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 14:48:06.910880218 +0000 UTC m=+2251.637420319" watchObservedRunningTime="2026-09-09 14:48:06.91384662 +0000 UTC m=+2251.640386721"
Sep 09 14:48:07.408234 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:07.408201    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-w6lnf_a0c3cd09-c929-4fe8-8508-0099cbb7e1db/volume-data-source-validator/0.log"
Sep 09 14:48:08.421620 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:08.421576    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4w2mf_f692545a-25d0-42aa-acaa-57d3c20c4ac9/dns/0.log"
Sep 09 14:48:08.441204 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:08.441178    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4w2mf_f692545a-25d0-42aa-acaa-57d3c20c4ac9/kube-rbac-proxy/0.log"
Sep 09 14:48:08.687393 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:08.687321    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qb5mh_ff4bddfd-4a5d-48a4-a767-3a2a114b2a73/dns-node-resolver/0.log"
Sep 09 14:48:09.273030 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:09.272997    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f26x4_e92fae6c-046f-4d03-86a4-76c97d721a66/node-ca/0.log"
Sep 09 14:48:10.226737 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:10.226690    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87_6ae263f7-ae5b-40f4-a969-b94f1127a452/istio-proxy/0.log"
Sep 09 14:48:10.519122 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:10.519039    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hsjqp_dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9/istio-proxy/0.log"
Sep 09 14:48:10.535493 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:10.535464    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hsjqp_dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9/istio-proxy/1.log"
Sep 09 14:48:10.632564 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:10.632531    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sslq8_add57211-b174-481b-b9b7-d75980ab301c/payload-processing/0.log"
Sep 09 14:48:10.655300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:10.655262    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cd68d9db8-hbl96_755fce16-cc81-4661-8e58-2fee5c71966f/router/0.log"
Sep 09 14:48:11.480733 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:11.480698    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g6g92_e92f8856-f50c-4c13-b7d0-d9c4c5038953/serve-healthcheck-canary/0.log"
Sep 09 14:48:11.962453 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:11.962416    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-rdvmw_169c00d2-dfda-468c-8753-f18fdcf2d4e6/insights-operator/0.log"
Sep 09 14:48:11.963437 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:11.963412    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-rdvmw_169c00d2-dfda-468c-8753-f18fdcf2d4e6/insights-operator/1.log"
Sep 09 14:48:12.142907 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:12.142870    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gvhz4_6e192feb-9db9-49fb-ad44-193782cc8ca9/kube-rbac-proxy/0.log"
Sep 09 14:48:12.165156 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:12.165125    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gvhz4_6e192feb-9db9-49fb-ad44-193782cc8ca9/exporter/0.log"
Sep 09 14:48:12.185482 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:12.185456    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gvhz4_6e192feb-9db9-49fb-ad44-193782cc8ca9/extractor/0.log"
Sep 09 14:48:13.920036 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:13.920010    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tq4f9/perf-node-gather-daemonset-4rd86"
Sep 09 14:48:14.340259 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:14.340231    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-v9xsl_0227f62c-bc6c-4b9e-b528-20b855650eb0/manager/0.log"
Sep 09 14:48:14.665399 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:14.665307    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-27sgh_f5df07d3-a53d-4f55-bc5f-071b93d4ed9d/manager/0.log"
Sep 09 14:48:14.742398 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:14.742342    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7b7c47c475-qh2ng_b468e852-a85d-404f-a2bf-d282c37a2194/manager/0.log"
Sep 09 14:48:14.763696 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:14.763665    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-9jrwg_3aa94433-337d-43ac-87c4-0b6474d25b18/server/0.log"
Sep 09 14:48:14.867274 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:14.867242    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-686db84dc8-8wff4_1215e5a3-04eb-4bbc-9dd9-c17fc34257e3/manager/0.log"
Sep 09 14:48:14.886384 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:14.886354    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-686db84dc8-8wff4_1215e5a3-04eb-4bbc-9dd9-c17fc34257e3/copy-manifests/0.log"
Sep 09 14:48:16.231033 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:16.230997    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87_6ae263f7-ae5b-40f4-a969-b94f1127a452/istio-proxy/0.log"
Sep 09 14:48:16.394415 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:16.394385    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-784f875f86-rczvl_433da259-09d6-4085-82f5-9689ed5dc8b6/manager/0.log"
Sep 09 14:48:16.494735 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:16.494642    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hsjqp_dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9/istio-proxy/0.log"
Sep 09 14:48:16.508552 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:16.508519    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hsjqp_dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9/istio-proxy/1.log"
Sep 09 14:48:16.588564 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:16.588508    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sslq8_add57211-b174-481b-b9b7-d75980ab301c/payload-processing/0.log"
Sep 09 14:48:16.601618 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:16.601591    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cd68d9db8-hbl96_755fce16-cc81-4661-8e58-2fee5c71966f/router/0.log"
Sep 09 14:48:17.997193 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:17.997099    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7zj87_6ae263f7-ae5b-40f4-a969-b94f1127a452/istio-proxy/0.log"
Sep 09 14:48:18.274696 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:18.274614    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hsjqp_dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9/istio-proxy/0.log"
Sep 09 14:48:18.289218 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:18.289164    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hsjqp_dbf1d5b3-2b0a-4214-a7b2-eb6854ca36c9/istio-proxy/1.log"
Sep 09 14:48:18.359048 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:18.359018    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sslq8_add57211-b174-481b-b9b7-d75980ab301c/payload-processing/0.log"
Sep 09 14:48:18.375587 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:18.375554    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cd68d9db8-hbl96_755fce16-cc81-4661-8e58-2fee5c71966f/router/0.log"
Sep 09 14:48:21.256861 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:21.256830    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-b2rhm_2e6b02e2-28ae-4caa-a679-0a6b0884a2db/migrator/0.log"
Sep 09 14:48:21.275906 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:21.275876    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-b2rhm_2e6b02e2-28ae-4caa-a679-0a6b0884a2db/graceful-termination/0.log"
Sep 09 14:48:21.610122 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:21.610074    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-jj6kk_69326219-c4b6-4bfa-b215-8b1eaeb1cac4/kube-storage-version-migrator-operator/1.log"
Sep 09 14:48:21.611989 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:21.611960    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-jj6kk_69326219-c4b6-4bfa-b215-8b1eaeb1cac4/kube-storage-version-migrator-operator/0.log"
Sep 09 14:48:22.551855 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:22.551822    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kr62x_0030a1f3-11e1-4418-b9ce-0733cc4b2812/kube-multus-additional-cni-plugins/0.log"
Sep 09 14:48:22.571842 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:22.571812    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kr62x_0030a1f3-11e1-4418-b9ce-0733cc4b2812/egress-router-binary-copy/0.log"
Sep 09 14:48:22.597417 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:22.597395    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kr62x_0030a1f3-11e1-4418-b9ce-0733cc4b2812/cni-plugins/0.log"
Sep 09 14:48:22.618037 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:22.618015    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kr62x_0030a1f3-11e1-4418-b9ce-0733cc4b2812/bond-cni-plugin/0.log"
Sep 09 14:48:22.639583 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:22.639555    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kr62x_0030a1f3-11e1-4418-b9ce-0733cc4b2812/routeoverride-cni/0.log"
Sep 09 14:48:22.659949 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:22.659921    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kr62x_0030a1f3-11e1-4418-b9ce-0733cc4b2812/whereabouts-cni-bincopy/0.log"
Sep 09 14:48:22.679300 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:22.679274    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kr62x_0030a1f3-11e1-4418-b9ce-0733cc4b2812/whereabouts-cni/0.log"
Sep 09 14:48:23.072850 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:23.072821    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-h9phn_bba35853-8627-4c40-9fb6-6b927c715b3c/kube-multus/0.log"
Sep 09 14:48:23.171420 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:23.171393    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kmvpw_686c69bf-f095-4d1a-b378-11e19b6f9e8d/network-metrics-daemon/0.log"
Sep 09 14:48:23.185903 ip-10-0-140-6 kubenswrapper[2562]: I0909 14:48:23.185878    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kmvpw_686c69bf-f095-4d1a-b378-11e19b6f9e8d/kube-rbac-proxy/0.log"